Jul 30 19:37:36.817395 ip-10-0-135-254 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 19:37:36.817409 ip-10-0-135-254 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 19:37:36.817419 ip-10-0-135-254 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 19:37:36.817726 ip-10-0-135-254 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 19:37:46.983981 ip-10-0-135-254 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 19:37:46.984018 ip-10-0-135-254 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5ffe95e5af7a4fb0a9ff97b4ab2ff3e9 --
Jul 30 19:39:16.131111 ip-10-0-135-254 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 19:39:16.575425 ip-10-0-135-254 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 19:39:16.575425 ip-10-0-135-254 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 19:39:16.575425 ip-10-0-135-254 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 19:39:16.575425 ip-10-0-135-254 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 19:39:16.575990 ip-10-0-135-254 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 19:39:16.576422 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.576357    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 19:39:16.582129 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582115    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:16.582129 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582128    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582131    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582135    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582138    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582141    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582144    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582147    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582149    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582153    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582156    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582159    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582161    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582164    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582167    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582169    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582172    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582175    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582177    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582187    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582189    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:16.582196 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582192    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582195    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582198    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582201    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582203    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582206    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582209    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582211    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582214    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582218    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582222    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582225    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582228    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582231    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582234    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582238    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582240    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582243    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582245    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:16.582675 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582248    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582251    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582254    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582257    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582259    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582262    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582265    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582268    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582272    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582274    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582278    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582280    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582283    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582285    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582288    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582291    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582294    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582296    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582299    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:16.583142 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582304    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582308    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582311    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582314    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582317    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582319    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582322    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582325    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582327    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582330    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582332    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582335    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582337    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582340    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582342    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582345    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582347    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582350    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582353    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582355    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:16.583717 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582358    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582360    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582363    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582365    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582368    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582371    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582373    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582376    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582379    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582382    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582385    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582387    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582390    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582392    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582395    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582397    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582400    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582402    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582405    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.582407    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:16.584215 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583070    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583076    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583079    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583081    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583085    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583087    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583091    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583094    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583096    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583099    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583101    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583105    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583107    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583110    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583113    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583115    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583118    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583121    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583123    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583126    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:16.584699 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583130    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583133    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583135    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583138    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583140    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583143    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583146    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583148    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583151    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583153    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583156    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583159    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583161    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583163    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583166    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583168    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583171    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583174    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583176    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583179    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:16.585199 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583181    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583183    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583187    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583189    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583193    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583195    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583200    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583204    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583208    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583210    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583213    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583215    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583218    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583221    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583223    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583226    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583228    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583231    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583233    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583236    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:16.585694 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583239    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583241    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583244    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583246    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583248    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583251    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583255    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583258    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583261    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583264    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583267    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583269    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583272    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583275    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583277    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583280    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583282    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583285    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583288    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:16.586232 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583290    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583294    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583298    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583301    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583304    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583306    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583309    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583312    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583314    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583317    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583319    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583322    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583324    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583327    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583329    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583332    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583334    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583337    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583339    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:16.586692 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583342    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583677    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583682    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583685    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583688    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583690    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583693    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583695    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583698    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583701    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583703    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583706    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583709    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583712    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583714    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583717    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583720    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583723    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583728    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583730    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:16.587166 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583733    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583736    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583738    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583741    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583744    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583748    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583752    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583755    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583757    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583760    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583762    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583765    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583768    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583770    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583773    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583775    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583779    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583782    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583785    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:16.587651 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583788    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583791    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583794    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583798    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583801    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583805    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583808    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583811    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583814    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583818    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583821    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583825    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583827    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583830    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583832    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583835    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583837    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583840    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583843    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583845    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:16.588135 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583848    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583850    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583852    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583855    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583857    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583873    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583876    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583878    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583881    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583884    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583886    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583889    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583892    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583894    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583897    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583899    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583902    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583907    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583911    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:16.588610 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583913    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583916    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583919    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583921    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583925    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583928    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583931    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583934    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583936    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583939    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583942    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583944    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583947    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583949    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583952    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583955    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583957    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583960    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583962    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583965    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583967    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:16.589087 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.583970    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584035    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584042    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584048    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584052    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584056    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584059    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584063    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584069    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584075    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584078    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584084    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584087    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584094    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584098    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584103    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584106    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584109    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584113    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584118    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584122    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584127    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584130    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584133    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 19:39:16.589602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584136    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584139    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584142    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584146    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584149    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584152    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584155    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584158    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584161    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584164    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584167    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584170    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584173    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584176    2561 flags.go:64] FLAG: --enable-server="true"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584179    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584184    2561 flags.go:64] FLAG: --event-burst="100"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584187    2561 flags.go:64] FLAG: --event-qps="50"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584191    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584194    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584197    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584201    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584204    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584207    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584211    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584214    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 19:39:16.590215 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584216    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584219    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584222    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584225    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584228    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584231    2561 flags.go:64] FLAG: --feature-gates=""
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584235    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584237    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584240    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584243    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584246    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584249    2561 flags.go:64] FLAG: --help="false"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584252    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584255    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584258    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584261    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584265    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584268    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584271    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584274    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584277    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584279    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584282    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584286    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 19:39:16.590837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584289    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584292    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584295    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584298    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584301    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584304    2561 flags.go:64] FLAG: --lock-file=""
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584307    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584310    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584313    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584318    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584321    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584323    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584326    2561 flags.go:64] FLAG: --logging-format="text"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584329    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584332    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584335    2561 flags.go:64] FLAG: --manifest-url=""
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584337    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584341    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584344    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584347    2561 flags.go:64] FLAG: --max-pods="110"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584350    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584353    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584356    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584359    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584361    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 19:39:16.591437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584364    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584367    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584373    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584377    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584380    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584383    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584385    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584390    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584393    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584396    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584399    2561 flags.go:64] FLAG: --port="10250"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584402    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584406    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d68fe425d788211a"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584409    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584412    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584415    2561 flags.go:64] FLAG: --register-node="true"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584417    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584421    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584423    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584426    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584429    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584432    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584435    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584438    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584441    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 19:39:16.592042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584443    2561 flags.go:64] FLAG: --runonce="false"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584446    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584449    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584452    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584455    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584458    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584461    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584464    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584467    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584469    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584472    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584475    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584478    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584481    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584484    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584487    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584492    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584495    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584497    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584501    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584504    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584507    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584510    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584513    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584516    2561 flags.go:64] FLAG: --v="2"
Jul 30 19:39:16.592656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584520    2561 flags.go:64] FLAG: --version="false"
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584523    2561 flags.go:64] FLAG: --vmodule=""
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584527    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584530    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584639    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584645    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584650    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584655    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584659    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584662    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584665    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584668    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584670    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584673    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584675    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584678    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584682    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584684    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584687    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584689    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:16.593296 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584692    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584695    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584697    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584700    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584702    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584706    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584708    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584711    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584714    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584717    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584721    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584725    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584755    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584768    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584771    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584774    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584777    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584781    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584784    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584787    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:16.593786 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584790    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584793    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584796    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584798    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584801    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584805    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584807    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584810    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584813    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584816    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584819    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584821    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584824    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584827    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584829    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584832    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584835    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584837    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584840    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:16.594334 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584842    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584845    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584847    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584850    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584853    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584856    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584877    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584880    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584882    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584885    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584888    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584890    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584893    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584896    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584898    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584901    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584903    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584906    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584909    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584911    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:16.594818 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584914    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584916    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584919    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584924    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584928    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584933    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584937    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584940    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584943    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584946    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584949    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584952    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584955    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584959    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584962    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584965    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584968    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584970    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584975    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:16.595370 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584978    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584981    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584983    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584986    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.584989    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.584995    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.591547    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.591559    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.591578    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.591586    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591643    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591648    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591652    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591655    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591658    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:16.595821 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591661    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591663    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591666    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591670    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591674    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591677    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591680    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591682    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591685    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591689    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591693    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591696    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591698    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591701    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591704    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591706    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591709    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591712    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591715    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:16.596201 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591717    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591720    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591722    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591725    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591727    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591730    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591732    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591735    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591737    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591740    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591742    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591745    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591747    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591750    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591752    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591754    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591757    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591759    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591762    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591764    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:16.596671 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591767    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591769    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591772    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591774    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591777    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591781    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591784    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591787    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591789    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591792    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591794    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591798    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591800    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591803    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591805    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591808    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591810    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591813    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591816    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591818    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:16.597156 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591821    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591823    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591826    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591828    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591831    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591835    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591838    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591841    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591844    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591847    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591849    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591852    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591854    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591857    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591875    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591878    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591880    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591883    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591886    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:16.597642 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591888    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591891    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591893    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591895    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591898    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591901    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591904    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591906    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591909    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591912    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591914    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591917    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591919    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591921    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591924    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:16.598108 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.591926    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.591931    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592035    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592039    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592042    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592045    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592048    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592050    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592053    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592056    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592059    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592061    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592064    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592067    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592069    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:16.598489 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592072    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592074    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592077    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592079    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592081    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592084    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592087    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592089    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592093    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592095    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592098    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592100    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592102    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592105    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592107    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592109    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592112    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592114    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592117    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:16.598855 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592119    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592122    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592124    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592128    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592132    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592134    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592137    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592140    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592143    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592146    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592149    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592152    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592155    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592158    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592161    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592163    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592166    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592169    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592173    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:16.599526 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592176    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592178    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592181    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592184    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592186    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592188    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592191    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592193    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592196    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592198    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592201    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592203    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592206    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592208    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592210    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592213    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592215    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592218    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592220    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592222    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:16.600272 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592225    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592227    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592232    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592235    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592239    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592242    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592244    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592248    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592251    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592254    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592256    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592259    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592262    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592264    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592267    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592269    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592272    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592275    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592277    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592279    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:16.601158 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592282    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592285    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592287    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592290    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592292    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592295    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592298    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:16.592300    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.592305    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.592388    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.594691    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.596399    2561 server.go:1019] "Starting client certificate rotation"
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.596493    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 19:39:16.601737 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.596526    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 19:39:16.602084 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.600824    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 19:39:16.602991 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.602974    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 19:39:16.612675 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.612663    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 30 19:39:16.616742 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.616726    2561 log.go:25] "Validated CRI v1 image API"
Jul 30 19:39:16.617614 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.617594    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 19:39:16.620173 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.620154    2561 fs.go:135] Filesystem UUIDs: map[1b645d5a-cda1-46cc-9049-234156af41e6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f9b7da3a-7a3c-4ded-bceb-0a54b9aea3ef:/dev/nvme0n1p3]
Jul 30 19:39:16.620236 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.620172    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 19:39:16.626066 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.625958    2561 manager.go:216] Machine: {Timestamp:2026-07-30 19:39:16.624578982 +0000 UTC m=+0.369018846 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095547 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21d1fce6191bce6decdf355afe5b76 SystemUUID:ec21d1fc-e619-1bce-6dec-df355afe5b76 BootID:5ffe95e5-af7a-4fb0-a9ff-97b4ab2ff3e9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:e3:65:bf:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:e3:65:bf:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:bd:be:fe:39:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 19:39:16.626066 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.626062    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 19:39:16.626168 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.626126    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 19:39:16.627154 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.627138    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 19:39:16.629556 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.629528    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 19:39:16.629683 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.629560    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-254.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 19:39:16.631080 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.631069    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 19:39:16.631113 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.631083    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 19:39:16.631113 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.631090    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 19:39:16.631848 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.631839    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 19:39:16.633795 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.633784    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 19:39:16.638965 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.638955    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 19:39:16.639085 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.639076    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 19:39:16.639116 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.639108    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 19:39:16.639927 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.639915    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 19:39:16.639964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.639945    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 19:39:16.639964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.639956    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 30 19:39:16.640013 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.639965    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 19:39:16.640263 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.640252    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 19:39:16.640305 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.640270    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 19:39:16.642418 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.642398    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 19:39:16.645273 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.645254    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 19:39:16.645390 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.645289    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 19:39:16.646101 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646089    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 19:39:16.646174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646114    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 19:39:16.646174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646121    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 19:39:16.646174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646127    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 19:39:16.646174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646135    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 19:39:16.646174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646141    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 19:39:16.646174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646170    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 19:39:16.646174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646176    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 19:39:16.646382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646187    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 19:39:16.646382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646193    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 19:39:16.646382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646201    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 19:39:16.646382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646209    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 19:39:16.646382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646234    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 19:39:16.646382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.646239    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 19:39:16.650098 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.650085    2561 server.go:1268] "Started kubelet"
Jul 30 19:39:16.650225 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.650189    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 19:39:16.650283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.650164    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 19:39:16.650283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.650270    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 19:39:16.650856 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.650834    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-254.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 19:39:16.650962 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.650857    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 19:39:16.650857 ip-10-0-135-254 systemd[1]: Started Kubernetes Kubelet.
Jul 30 19:39:16.651348 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.651324    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 19:39:16.651436 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.651360    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 19:39:16.651761 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.651744    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 19:39:16.656049 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.656029    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 19:39:16.658373 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.657262    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-254.ec2.internal.18c7288b71c603f7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-254.ec2.internal,UID:ip-10-0-135-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-254.ec2.internal,},FirstTimestamp:2026-07-30 19:39:16.650058743 +0000 UTC m=+0.394498608,LastTimestamp:2026-07-30 19:39:16.650058743 +0000 UTC m=+0.394498608,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-254.ec2.internal,}"
Jul 30 19:39:16.661768 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.661746    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 19:39:16.661768 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.661764    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 19:39:16.661939 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.661827    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:16.662550 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.662525    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 19:39:16.662550 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.662527    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 19:39:16.662550 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.662547    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 19:39:16.662721 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.662624    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 19:39:16.662721 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.662629    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 19:39:16.663410 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.663392    2561 factory.go:55] Registering systemd factory
Jul 30 19:39:16.663410 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.663412    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 30 19:39:16.663619 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.663606    2561 factory.go:153] Registering CRI-O factory
Jul 30 19:39:16.663619 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.663618    2561 factory.go:223] Registration of the crio container factory successfully
Jul 30 19:39:16.663772 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.663660    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 19:39:16.663772 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.663681    2561 factory.go:103] Registering Raw factory
Jul 30 19:39:16.663772 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.663695    2561 manager.go:1196] Started watching for new ooms in manager
Jul 30 19:39:16.664132 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.664121    2561 manager.go:349] Starting recovery of all containers
Jul 30 19:39:16.664561 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.664541    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 19:39:16.664644 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.664610    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 19:39:16.675364 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.675345    2561 manager.go:354] Recovery completed
Jul 30 19:39:16.676643 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.676596    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jzwpq"
Jul 30 19:39:16.681594 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.681572    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jzwpq"
Jul 30 19:39:16.681732 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.681721    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:16.684335 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.684320    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:16.684409 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.684346    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:16.684409 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.684356    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:16.684856 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.684841    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 19:39:16.684939 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.684855    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 19:39:16.684939 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.684886    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 19:39:16.684939 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.684893    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:16.685592 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.685578    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:16.685647 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.685606    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:16.685647 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.685618    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:16.686966 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.686950    2561 policy_none.go:49] "None policy: Start"
Jul 30 19:39:16.687043 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.686968    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 19:39:16.687043 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.686983    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 19:39:16.688926 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.688912    2561 policy_none.go:47] "Start"
Jul 30 19:39:16.715447 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.715434    2561 manager.go:337] "Starting Device Plugin manager"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.715494    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.715506    2561 server.go:87] "Starting device plugin registration server"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.715698    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.715710    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.715810    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.715918    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.715929    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.716544    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.716584    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.728946    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.730044    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.730088    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.730112    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.730151    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 19:39:16.740504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.731608    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:16.816724 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.816697    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:16.817486 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.817471    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:16.817559 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.817500    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:16.817559 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.817529    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:16.817559 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.817552    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.826552 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.826518    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.826552 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.826537    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-254.ec2.internal\": node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:16.831179 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.831158    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal"]
Jul 30 19:39:16.831268 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.831210    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:16.832523 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.832510    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:16.832593 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.832537    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:16.832593 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.832547    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:16.834831 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.834819    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:16.834945 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.834932    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.834982 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.834959    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:16.835439 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.835426    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:16.835487 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.835451    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:16.835487 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.835461    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:16.835549 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.835426    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:16.835549 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.835526    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:16.835549 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.835538    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:16.837653 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.837638    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.837720 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.837660    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:16.838256 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.838243    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:16.838311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.838267    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:16.838311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.838278    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:16.853072 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.852970    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:16.863359 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.863335    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-254.ec2.internal\" not found" node="ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.863999 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.863984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1050cce1c5898f691ebfd594fda7cf19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"1050cce1c5898f691ebfd594fda7cf19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.864079 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.864011    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1050cce1c5898f691ebfd594fda7cf19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"1050cce1c5898f691ebfd594fda7cf19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.864079 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.864037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4a8295436f2a97d041aabd413f285d2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-254.ec2.internal\" (UID: \"a4a8295436f2a97d041aabd413f285d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.867715 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.867702    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-254.ec2.internal\" not found" node="ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.953824 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:16.953805    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:16.965152 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.965133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1050cce1c5898f691ebfd594fda7cf19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"1050cce1c5898f691ebfd594fda7cf19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.965229 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.965167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4a8295436f2a97d041aabd413f285d2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-254.ec2.internal\" (UID: \"a4a8295436f2a97d041aabd413f285d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.965229 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.965192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1050cce1c5898f691ebfd594fda7cf19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"1050cce1c5898f691ebfd594fda7cf19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.965315 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.965254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4a8295436f2a97d041aabd413f285d2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-254.ec2.internal\" (UID: \"a4a8295436f2a97d041aabd413f285d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.965315 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.965254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1050cce1c5898f691ebfd594fda7cf19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"1050cce1c5898f691ebfd594fda7cf19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:16.965315 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:16.965259    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1050cce1c5898f691ebfd594fda7cf19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal\" (UID: \"1050cce1c5898f691ebfd594fda7cf19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:17.054317 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:17.054293    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:17.155074 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:17.155025    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:17.166397 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:17.166380    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:17.172523 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:17.172323    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:17.255159 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:17.255132    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:17.355604 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:17.355587    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:17.456137 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:17.456087    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:18.660821 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:18.660798    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:18.699281 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:18.699255    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 19:39:18.699672 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:18.699410    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 19:39:18.761520 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:18.761499    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:18.774828 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:18.774803    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:18.792036 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:18.791979    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 19:34:17 +0000 UTC" deadline="2027-12-23 23:00:11.384095658 +0000 UTC"
Jul 30 19:39:18.792036 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:18.792033    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12267h20m52.592068046s"
Jul 30 19:39:18.862030 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:18.861984    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:18.879783 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:18.879766    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:18.963006 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:18.962987    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-254.ec2.internal\" not found"
Jul 30 19:39:19.015115 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:19.015093    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a8295436f2a97d041aabd413f285d2.slice/crio-e7990c1a4bdd3b3cf4f3b7b1be3be7a5e4c22301326fb731bb1b22b2f11ad34e WatchSource:0}: Error finding container e7990c1a4bdd3b3cf4f3b7b1be3be7a5e4c22301326fb731bb1b22b2f11ad34e: Status 404 returned error can't find the container with id e7990c1a4bdd3b3cf4f3b7b1be3be7a5e4c22301326fb731bb1b22b2f11ad34e
Jul 30 19:39:19.020339 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.019646    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 19:39:19.026776 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.026760    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:19.038149 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:19.038130    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1050cce1c5898f691ebfd594fda7cf19.slice/crio-33b45d5ae3f370602988a419a36c5ffa8bd902517c76a0a69c738b6c8f6883c3 WatchSource:0}: Error finding container 33b45d5ae3f370602988a419a36c5ffa8bd902517c76a0a69c738b6c8f6883c3: Status 404 returned error can't find the container with id 33b45d5ae3f370602988a419a36c5ffa8bd902517c76a0a69c738b6c8f6883c3
Jul 30 19:39:19.066368 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.066349    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:19.078438 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.078418    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 19:39:19.079541 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.079530    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal"
Jul 30 19:39:19.087495 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.087480    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 19:39:19.745528 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.745495    2561 apiserver.go:52] "Watching apiserver"
Jul 30 19:39:19.754979 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.754958    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 19:39:19.757788 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.757756    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-7gqnk","kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj","openshift-cluster-node-tuning-operator/tuned-f9dmn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal","openshift-multus/multus-additional-cni-plugins-4tp65","openshift-multus/multus-zwk5n","openshift-network-diagnostics/network-check-target-qv5ss","kube-system/konnectivity-agent-7dk8g","openshift-dns/node-resolver-968bf","openshift-image-registry/node-ca-q4bfz","openshift-multus/network-metrics-daemon-bsfvg","openshift-network-operator/iptables-alerter-npldq","openshift-ovn-kubernetes/ovnkube-node-ld8sn"]
Jul 30 19:39:19.760240 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.760219    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.763097 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.763077    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5hbz8\""
Jul 30 19:39:19.763244 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.763221    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 19:39:19.763348 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.763309    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 19:39:19.763407 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.763389    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 19:39:19.763609 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.763595    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.765670 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.765651    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.766155 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.766130    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 19:39:19.767211 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.767196    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 19:39:19.767382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.767358    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 19:39:19.767382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.767373    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 19:39:19.767525 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.767399    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 19:39:19.767525 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.767445    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 19:39:19.767525 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.767482    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s7w95\""
Jul 30 19:39:19.767640 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.767600    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 19:39:19.767966 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.767944    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.768286 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.768129    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qhqtt\""
Jul 30 19:39:19.768352 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.768295    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 19:39:19.768352 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.768342    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 19:39:19.768456 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.768422    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 19:39:19.768456 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.768434    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 19:39:19.770224 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.770204    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.770712 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.770692    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:39:19.771121 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.771099    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ghwwg\""
Jul 30 19:39:19.771438 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.771426    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 19:39:19.772411 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.772395    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:19.772496 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.772455    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:19.773168 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.773145    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 19:39:19.773261 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.773173    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rtctb\""
Jul 30 19:39:19.774183 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.773918    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 19:39:19.775494 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.775465    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:19.775595 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.775561    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:19.777321 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-node-log\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.777420 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-var-lib-cni-multus\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.777420 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777345    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpw2b\" (UniqueName: \"kubernetes.io/projected/eb104d86-24bd-4152-b455-5280f8753668-kube-api-access-vpw2b\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.777420 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-systemd\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.777420 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-var-lib-kubelet\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.777420 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777458    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-cni-binary-copy\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-kubelet\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-cni-bin\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777516    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb104d86-24bd-4152-b455-5280f8753668-ovnkube-config\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-kubernetes\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777571    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-systemd-units\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb104d86-24bd-4152-b455-5280f8753668-ovn-node-metrics-cert\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-conf-dir\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-sys-fs\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwsr2\" (UniqueName: \"kubernetes.io/projected/2eca6ab1-45c1-4e73-afac-5acbbfceb046-kube-api-access-qwsr2\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.777673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x55h\" (UniqueName: \"kubernetes.io/projected/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-kube-api-access-6x55h\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-run-systemd\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-daemon-config\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-tuned\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777801    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb104d86-24bd-4152-b455-5280f8753668-env-overrides\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-socket-dir-parent\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-sysconfig\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-run-ovn\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-lib-modules\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777972    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.777994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-cni-netd\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-var-lib-kubelet\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-modprobe-d\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.778061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-sys\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtj5\" (UniqueName: \"kubernetes.io/projected/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-kube-api-access-tbtj5\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778090    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb104d86-24bd-4152-b455-5280f8753668-ovnkube-script-lib\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-cnibin\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-slash\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778141    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-var-lib-cni-bin\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-run-multus-certs\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778190    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-etc-kubernetes\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-system-cni-dir\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-cni-dir\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-os-release\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-run-netns\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-hostroot\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778302    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-host\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-socket-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778373    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-var-lib-openvswitch\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.778521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-run\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-run-ovn-kubernetes\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-run-k8s-cni-cncf-io\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-sysctl-d\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-registration-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-run-netns\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-log-socket\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-sysctl-conf\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-tmp\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-device-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778666    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-etc-openvswitch\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.779188 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.778686    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-run-openvswitch\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.779699 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.779685    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 19:39:19.780578 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.780564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:19.780942 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.780926    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 19:39:19.781051 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.781033    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n7479\""
Jul 30 19:39:19.781147 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.781054    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 19:39:19.782803 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.782789    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:19.783675 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.783656    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 19:39:19.783769 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.783705    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rxj9s\""
Jul 30 19:39:19.783951 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.783938    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 19:39:19.785124 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.785110    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:19.785187 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.785167    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:19.785488 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.785475    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 19:39:19.785553 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.785475    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 19:39:19.785620 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.785604    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zh2bj\""
Jul 30 19:39:19.785679 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.785642    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 19:39:19.787380 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.787367    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:19.789835 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.789818    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:39:19.789952 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.789936    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 19:39:19.790034 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.789943    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fm6lb\""
Jul 30 19:39:19.790034 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.789968    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 19:39:19.802435 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.802414    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sl28w"
Jul 30 19:39:19.809047 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.809027    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sl28w"
Jul 30 19:39:19.838953 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.838912    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" event={"ID":"1050cce1c5898f691ebfd594fda7cf19","Type":"ContainerStarted","Data":"33b45d5ae3f370602988a419a36c5ffa8bd902517c76a0a69c738b6c8f6883c3"}
Jul 30 19:39:19.840201 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.840179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" event={"ID":"a4a8295436f2a97d041aabd413f285d2","Type":"ContainerStarted","Data":"e7990c1a4bdd3b3cf4f3b7b1be3be7a5e4c22301326fb731bb1b22b2f11ad34e"}
Jul 30 19:39:19.868287 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.868266    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 19:39:19.879507 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb104d86-24bd-4152-b455-5280f8753668-ovnkube-config\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.879621 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-kubernetes\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.879621 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-systemd-units\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.879621 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb104d86-24bd-4152-b455-5280f8753668-ovn-node-metrics-cert\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.879621 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-conf-dir\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.879621 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-system-cni-dir\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.879814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-kubernetes\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.879814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879641    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:19.879814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:19.879814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879679    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-systemd-units\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.879814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-sys-fs\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.879814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwsr2\" (UniqueName: \"kubernetes.io/projected/2eca6ab1-45c1-4e73-afac-5acbbfceb046-kube-api-access-qwsr2\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.879814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879745    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-sys-fs\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.879814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x55h\" (UniqueName: \"kubernetes.io/projected/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-kube-api-access-6x55h\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.879814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-os-release\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.879814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879812    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88042802-62d0-4a1d-97f9-6471afa98d05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b118d49-f09f-41b4-8960-189b923082f0-dbus\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-run-systemd\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-daemon-config\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-tuned\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879957    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc9e19c5-f02f-4948-989d-f3a1f4cd28fe-host\") pod \"node-ca-q4bfz\" (UID: \"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe\") " pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.879987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-conf-dir\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880029    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb104d86-24bd-4152-b455-5280f8753668-env-overrides\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-socket-dir-parent\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-sysconfig\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a724735-f963-4de4-818e-0dd9f65bbaa9-agent-certs\") pod \"konnectivity-agent-7dk8g\" (UID: \"7a724735-f963-4de4-818e-0dd9f65bbaa9\") " pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-run-ovn\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-lib-modules\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.880210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880213    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9ea39fa-373b-467f-948d-d7ade24a496b-host-slash\") pod \"iptables-alerter-npldq\" (UID: \"d9ea39fa-373b-467f-948d-d7ade24a496b\") " pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-cni-netd\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-var-lib-kubelet\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880330    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-modprobe-d\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880372    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-run-ovn\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880387    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-run-systemd\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-cni-netd\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-sys\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtj5\" (UniqueName: \"kubernetes.io/projected/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-kube-api-access-tbtj5\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-sys\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a724735-f963-4de4-818e-0dd9f65bbaa9-konnectivity-ca\") pod \"konnectivity-agent-7dk8g\" (UID: \"7a724735-f963-4de4-818e-0dd9f65bbaa9\") " pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb104d86-24bd-4152-b455-5280f8753668-ovnkube-script-lib\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-daemon-config\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-cnibin\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr6mp\" (UniqueName: \"kubernetes.io/projected/66d5706a-702f-4e2f-a517-683598ce3f44-kube-api-access-wr6mp\") pod \"node-resolver-968bf\" (UID: \"66d5706a-702f-4e2f-a517-683598ce3f44\") " pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:19.880964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb104d86-24bd-4152-b455-5280f8753668-ovnkube-config\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9ea39fa-373b-467f-948d-d7ade24a496b-iptables-alerter-script\") pod \"iptables-alerter-npldq\" (UID: \"d9ea39fa-373b-467f-948d-d7ade24a496b\") " pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880674    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-slash\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880690    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-sysconfig\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880700    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-var-lib-cni-bin\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-run-multus-certs\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880341    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-var-lib-kubelet\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880746    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-etc-kubernetes\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-modprobe-d\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880773    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb104d86-24bd-4152-b455-5280f8753668-env-overrides\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x8xc\" (UniqueName: \"kubernetes.io/projected/88042802-62d0-4a1d-97f9-6471afa98d05-kube-api-access-6x8xc\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-socket-dir-parent\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880838    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-etc-kubernetes\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b118d49-f09f-41b4-8960-189b923082f0-kubelet-config\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880854    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-cnibin\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-slash\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880871    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-var-lib-cni-bin\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.881757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqf7d\" (UniqueName: \"kubernetes.io/projected/dc9e19c5-f02f-4948-989d-f3a1f4cd28fe-kube-api-access-vqf7d\") pod \"node-ca-q4bfz\" (UID: \"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe\") " pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-run-multus-certs\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880941    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-lib-modules\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.880974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-system-cni-dir\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-cni-dir\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881032    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-system-cni-dir\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881067    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-os-release\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-run-netns\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-hostroot\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881157    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-os-release\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881162    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-host\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-multus-cni-dir\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72vz4\" (UniqueName: \"kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4\") pod \"network-check-target-qv5ss\" (UID: \"c5a2be49-dba4-4ba3-b11c-26710086017c\") " pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881202    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-host\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881218    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-run-netns\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbdxh\" (UniqueName: \"kubernetes.io/projected/02b82ed8-8246-442b-b355-1c07f8c70acc-kube-api-access-gbdxh\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881226    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb104d86-24bd-4152-b455-5280f8753668-ovnkube-script-lib\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881240    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-hostroot\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.882449 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881247    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-socket-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-var-lib-openvswitch\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-run\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88042802-62d0-4a1d-97f9-6471afa98d05-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881324    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-socket-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88042802-62d0-4a1d-97f9-6471afa98d05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-run-ovn-kubernetes\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881390    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-run\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-run-k8s-cni-cncf-io\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-sysctl-d\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881446    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-var-lib-openvswitch\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881457    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-cnibin\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66d5706a-702f-4e2f-a517-683598ce3f44-hosts-file\") pod \"node-resolver-968bf\" (UID: \"66d5706a-702f-4e2f-a517-683598ce3f44\") " pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881499    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-run-ovn-kubernetes\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-registration-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-run-netns\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881557    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-sysctl-d\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.883130 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881571    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-registration-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-log-socket\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881600    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-run-k8s-cni-cncf-io\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-sysctl-conf\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-run-netns\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881627    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-tmp\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881651    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d5706a-702f-4e2f-a517-683598ce3f44-tmp-dir\") pod \"node-resolver-968bf\" (UID: \"66d5706a-702f-4e2f-a517-683598ce3f44\") " pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881688    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc9e19c5-f02f-4948-989d-f3a1f4cd28fe-serviceca\") pod \"node-ca-q4bfz\" (UID: \"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe\") " pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-889wb\" (UniqueName: \"kubernetes.io/projected/d9ea39fa-373b-467f-948d-d7ade24a496b-kube-api-access-889wb\") pod \"iptables-alerter-npldq\" (UID: \"d9ea39fa-373b-467f-948d-d7ade24a496b\") " pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-device-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881737    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-sysctl-conf\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-etc-openvswitch\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-log-socket\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-run-openvswitch\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-node-log\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-run-openvswitch\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-var-lib-cni-multus\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.883796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpw2b\" (UniqueName: \"kubernetes.io/projected/eb104d86-24bd-4152-b455-5280f8753668-kube-api-access-vpw2b\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881865    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-host-var-lib-cni-multus\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-systemd\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-node-log\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-var-lib-kubelet\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881942    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881809    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-device-dir\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-etc-openvswitch\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-cni-binary-copy\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.882010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-kubelet\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.882015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-var-lib-kubelet\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.881957    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-systemd\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.882032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-cni-bin\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.882048    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eca6ab1-45c1-4e73-afac-5acbbfceb046-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.882070    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.882104    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-cni-bin\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.884700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.882114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb104d86-24bd-4152-b455-5280f8753668-host-kubelet\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.885582 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.882484    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-cni-binary-copy\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.885582 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.884005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-etc-tuned\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.885582 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.884040    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-tmp\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.885582 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.884137    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb104d86-24bd-4152-b455-5280f8753668-ovn-node-metrics-cert\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.885825 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.885796    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:19.888282 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.888231    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x55h\" (UniqueName: \"kubernetes.io/projected/d6a4cff9-ed0a-43ab-b6b7-199bbdd66954-kube-api-access-6x55h\") pod \"multus-zwk5n\" (UID: \"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954\") " pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:19.888407 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.888383    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwsr2\" (UniqueName: \"kubernetes.io/projected/2eca6ab1-45c1-4e73-afac-5acbbfceb046-kube-api-access-qwsr2\") pod \"aws-ebs-csi-driver-node-j2tjj\" (UID: \"2eca6ab1-45c1-4e73-afac-5acbbfceb046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:19.888748 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.888730    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtj5\" (UniqueName: \"kubernetes.io/projected/ac7207e7-2de5-4600-8cd5-a1c40d94c1a6-kube-api-access-tbtj5\") pod \"tuned-f9dmn\" (UID: \"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6\") " pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:19.889380 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.889358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpw2b\" (UniqueName: \"kubernetes.io/projected/eb104d86-24bd-4152-b455-5280f8753668-kube-api-access-vpw2b\") pod \"ovnkube-node-ld8sn\" (UID: \"eb104d86-24bd-4152-b455-5280f8753668\") " pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:19.982648 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x8xc\" (UniqueName: \"kubernetes.io/projected/88042802-62d0-4a1d-97f9-6471afa98d05-kube-api-access-6x8xc\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.982731 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b118d49-f09f-41b4-8960-189b923082f0-kubelet-config\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:19.982731 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf7d\" (UniqueName: \"kubernetes.io/projected/dc9e19c5-f02f-4948-989d-f3a1f4cd28fe-kube-api-access-vqf7d\") pod \"node-ca-q4bfz\" (UID: \"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe\") " pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:19.982731 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982704    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72vz4\" (UniqueName: \"kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4\") pod \"network-check-target-qv5ss\" (UID: \"c5a2be49-dba4-4ba3-b11c-26710086017c\") " pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:19.982731 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbdxh\" (UniqueName: \"kubernetes.io/projected/02b82ed8-8246-442b-b355-1c07f8c70acc-kube-api-access-gbdxh\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:19.982909 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88042802-62d0-4a1d-97f9-6471afa98d05-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.982909 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88042802-62d0-4a1d-97f9-6471afa98d05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.982909 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-cnibin\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.982909 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66d5706a-702f-4e2f-a517-683598ce3f44-hosts-file\") pod \"node-resolver-968bf\" (UID: \"66d5706a-702f-4e2f-a517-683598ce3f44\") " pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:19.982909 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d5706a-702f-4e2f-a517-683598ce3f44-tmp-dir\") pod \"node-resolver-968bf\" (UID: \"66d5706a-702f-4e2f-a517-683598ce3f44\") " pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:19.982909 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc9e19c5-f02f-4948-989d-f3a1f4cd28fe-serviceca\") pod \"node-ca-q4bfz\" (UID: \"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe\") " pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:19.982909 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-889wb\" (UniqueName: \"kubernetes.io/projected/d9ea39fa-373b-467f-948d-d7ade24a496b-kube-api-access-889wb\") pod \"iptables-alerter-npldq\" (UID: \"d9ea39fa-373b-467f-948d-d7ade24a496b\") " pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:19.982909 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982896    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b118d49-f09f-41b4-8960-189b923082f0-kubelet-config\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:19.982909 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-system-cni-dir\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982931    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.982951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-cnibin\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.982995    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.983048    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret podName:8b118d49-f09f-41b4-8960-189b923082f0 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:20.483028805 +0000 UTC m=+3.123443879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret") pod "global-pull-secret-syncer-7gqnk" (UID: "8b118d49-f09f-41b4-8960-189b923082f0") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983069    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-system-cni-dir\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66d5706a-702f-4e2f-a517-683598ce3f44-hosts-file\") pod \"node-resolver-968bf\" (UID: \"66d5706a-702f-4e2f-a517-683598ce3f44\") " pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-os-release\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88042802-62d0-4a1d-97f9-6471afa98d05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b118d49-f09f-41b4-8960-189b923082f0-dbus\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:19.983284 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc9e19c5-f02f-4948-989d-f3a1f4cd28fe-host\") pod \"node-ca-q4bfz\" (UID: \"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe\") " pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983323    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-os-release\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a724735-f963-4de4-818e-0dd9f65bbaa9-agent-certs\") pod \"konnectivity-agent-7dk8g\" (UID: \"7a724735-f963-4de4-818e-0dd9f65bbaa9\") " pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.983331    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9ea39fa-373b-467f-948d-d7ade24a496b-host-slash\") pod \"iptables-alerter-npldq\" (UID: \"d9ea39fa-373b-467f-948d-d7ade24a496b\") " pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.983378    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs podName:02b82ed8-8246-442b-b355-1c07f8c70acc nodeName:}" failed. No retries permitted until 2026-07-30 19:39:20.483363854 +0000 UTC m=+3.123778914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs") pod "network-metrics-daemon-bsfvg" (UID: "02b82ed8-8246-442b-b355-1c07f8c70acc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983379    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b118d49-f09f-41b4-8960-189b923082f0-dbus\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983384    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d5706a-702f-4e2f-a517-683598ce3f44-tmp-dir\") pod \"node-resolver-968bf\" (UID: \"66d5706a-702f-4e2f-a517-683598ce3f44\") " pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983412    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc9e19c5-f02f-4948-989d-f3a1f4cd28fe-serviceca\") pod \"node-ca-q4bfz\" (UID: \"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe\") " pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983399    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9ea39fa-373b-467f-948d-d7ade24a496b-host-slash\") pod \"iptables-alerter-npldq\" (UID: \"d9ea39fa-373b-467f-948d-d7ade24a496b\") " pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a724735-f963-4de4-818e-0dd9f65bbaa9-konnectivity-ca\") pod \"konnectivity-agent-7dk8g\" (UID: \"7a724735-f963-4de4-818e-0dd9f65bbaa9\") " pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983442    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc9e19c5-f02f-4948-989d-f3a1f4cd28fe-host\") pod \"node-ca-q4bfz\" (UID: \"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe\") " pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr6mp\" (UniqueName: \"kubernetes.io/projected/66d5706a-702f-4e2f-a517-683598ce3f44-kube-api-access-wr6mp\") pod \"node-resolver-968bf\" (UID: \"66d5706a-702f-4e2f-a517-683598ce3f44\") " pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9ea39fa-373b-467f-948d-d7ade24a496b-iptables-alerter-script\") pod \"iptables-alerter-npldq\" (UID: \"d9ea39fa-373b-467f-948d-d7ade24a496b\") " pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983587    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88042802-62d0-4a1d-97f9-6471afa98d05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.983763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983631    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88042802-62d0-4a1d-97f9-6471afa98d05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.984532 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.983948    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88042802-62d0-4a1d-97f9-6471afa98d05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.984532 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.984001    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a724735-f963-4de4-818e-0dd9f65bbaa9-konnectivity-ca\") pod \"konnectivity-agent-7dk8g\" (UID: \"7a724735-f963-4de4-818e-0dd9f65bbaa9\") " pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:19.984532 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.984010    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9ea39fa-373b-467f-948d-d7ade24a496b-iptables-alerter-script\") pod \"iptables-alerter-npldq\" (UID: \"d9ea39fa-373b-467f-948d-d7ade24a496b\") " pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:19.984532 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.984301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88042802-62d0-4a1d-97f9-6471afa98d05-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.985613 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.985591    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a724735-f963-4de4-818e-0dd9f65bbaa9-agent-certs\") pod \"konnectivity-agent-7dk8g\" (UID: \"7a724735-f963-4de4-818e-0dd9f65bbaa9\") " pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:19.989510 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.989491    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:19.989644 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.989517    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:19.989644 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.989530    2561 projected.go:196] Error preparing data for projected volume kube-api-access-72vz4 for pod openshift-network-diagnostics/network-check-target-qv5ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:19.989644 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:19.989583    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4 podName:c5a2be49-dba4-4ba3-b11c-26710086017c nodeName:}" failed. No retries permitted until 2026-07-30 19:39:20.4895689 +0000 UTC m=+3.129983978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-72vz4" (UniqueName: "kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4") pod "network-check-target-qv5ss" (UID: "c5a2be49-dba4-4ba3-b11c-26710086017c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:19.991444 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.991424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-889wb\" (UniqueName: \"kubernetes.io/projected/d9ea39fa-373b-467f-948d-d7ade24a496b-kube-api-access-889wb\") pod \"iptables-alerter-npldq\" (UID: \"d9ea39fa-373b-467f-948d-d7ade24a496b\") " pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:19.992038 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.992019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x8xc\" (UniqueName: \"kubernetes.io/projected/88042802-62d0-4a1d-97f9-6471afa98d05-kube-api-access-6x8xc\") pod \"multus-additional-cni-plugins-4tp65\" (UID: \"88042802-62d0-4a1d-97f9-6471afa98d05\") " pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:19.992316 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.992292    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqf7d\" (UniqueName: \"kubernetes.io/projected/dc9e19c5-f02f-4948-989d-f3a1f4cd28fe-kube-api-access-vqf7d\") pod \"node-ca-q4bfz\" (UID: \"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe\") " pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:19.992945 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.992906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr6mp\" (UniqueName: \"kubernetes.io/projected/66d5706a-702f-4e2f-a517-683598ce3f44-kube-api-access-wr6mp\") pod \"node-resolver-968bf\" (UID: \"66d5706a-702f-4e2f-a517-683598ce3f44\") " pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:19.993423 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:19.993402    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbdxh\" (UniqueName: \"kubernetes.io/projected/02b82ed8-8246-442b-b355-1c07f8c70acc-kube-api-access-gbdxh\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:20.071443 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.071399    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj"
Jul 30 19:39:20.078395 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.078380    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:20.080584 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:20.080565    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eca6ab1_45c1_4e73_afac_5acbbfceb046.slice/crio-8ae78eccacca37598b1bb811c8703cc9f6335262e37831561fa728b8da4699c8 WatchSource:0}: Error finding container 8ae78eccacca37598b1bb811c8703cc9f6335262e37831561fa728b8da4699c8: Status 404 returned error can't find the container with id 8ae78eccacca37598b1bb811c8703cc9f6335262e37831561fa728b8da4699c8
Jul 30 19:39:20.084589 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.084573    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zwk5n"
Jul 30 19:39:20.087967 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:20.087939    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb104d86_24bd_4152_b455_5280f8753668.slice/crio-7e1ab8b7b7d92c96c9be9c02074417fbf6b1d50c4d26a2157797cadffdca5001 WatchSource:0}: Error finding container 7e1ab8b7b7d92c96c9be9c02074417fbf6b1d50c4d26a2157797cadffdca5001: Status 404 returned error can't find the container with id 7e1ab8b7b7d92c96c9be9c02074417fbf6b1d50c4d26a2157797cadffdca5001
Jul 30 19:39:20.091695 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.091672    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f9dmn"
Jul 30 19:39:20.093799 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:20.093779    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a4cff9_ed0a_43ab_b6b7_199bbdd66954.slice/crio-79c1abe7f6baae8f57e7c41c12b4ed24a18bd96e755c42e92d9af5e356a8ce41 WatchSource:0}: Error finding container 79c1abe7f6baae8f57e7c41c12b4ed24a18bd96e755c42e92d9af5e356a8ce41: Status 404 returned error can't find the container with id 79c1abe7f6baae8f57e7c41c12b4ed24a18bd96e755c42e92d9af5e356a8ce41
Jul 30 19:39:20.096324 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.096305    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4tp65"
Jul 30 19:39:20.099470 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:20.099450    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7207e7_2de5_4600_8cd5_a1c40d94c1a6.slice/crio-1e96e8fc4349eed1bc767a9109c4606c3016504767f92d1596b5018605e8fd32 WatchSource:0}: Error finding container 1e96e8fc4349eed1bc767a9109c4606c3016504767f92d1596b5018605e8fd32: Status 404 returned error can't find the container with id 1e96e8fc4349eed1bc767a9109c4606c3016504767f92d1596b5018605e8fd32
Jul 30 19:39:20.102831 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.102813    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:20.103938 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:20.103919    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88042802_62d0_4a1d_97f9_6471afa98d05.slice/crio-de866d4981a66b10883530b6b2310d83fea9bbbd085a2d87fed54b6c5d0fc489 WatchSource:0}: Error finding container de866d4981a66b10883530b6b2310d83fea9bbbd085a2d87fed54b6c5d0fc489: Status 404 returned error can't find the container with id de866d4981a66b10883530b6b2310d83fea9bbbd085a2d87fed54b6c5d0fc489
Jul 30 19:39:20.110032 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.110015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-968bf"
Jul 30 19:39:20.112160 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:20.112139    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a724735_f963_4de4_818e_0dd9f65bbaa9.slice/crio-fd14c5beae6e0d964c0a6159a36df2ff5fc709267b6a1b6fa7bbbc418ce2e7a9 WatchSource:0}: Error finding container fd14c5beae6e0d964c0a6159a36df2ff5fc709267b6a1b6fa7bbbc418ce2e7a9: Status 404 returned error can't find the container with id fd14c5beae6e0d964c0a6159a36df2ff5fc709267b6a1b6fa7bbbc418ce2e7a9
Jul 30 19:39:20.116176 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.116160    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q4bfz"
Jul 30 19:39:20.117948 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:20.117930    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d5706a_702f_4e2f_a517_683598ce3f44.slice/crio-77ba8cb388668e5d698eab9fb444878ba8e7bcb915c293d95b76365829beb822 WatchSource:0}: Error finding container 77ba8cb388668e5d698eab9fb444878ba8e7bcb915c293d95b76365829beb822: Status 404 returned error can't find the container with id 77ba8cb388668e5d698eab9fb444878ba8e7bcb915c293d95b76365829beb822
Jul 30 19:39:20.121915 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.121881    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-npldq"
Jul 30 19:39:20.124761 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:20.124726    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9e19c5_f02f_4948_989d_f3a1f4cd28fe.slice/crio-8fc92f96ccdd6a00279fee8f706ca61d3fb7e34146c63ce17a500480766c7843 WatchSource:0}: Error finding container 8fc92f96ccdd6a00279fee8f706ca61d3fb7e34146c63ce17a500480766c7843: Status 404 returned error can't find the container with id 8fc92f96ccdd6a00279fee8f706ca61d3fb7e34146c63ce17a500480766c7843
Jul 30 19:39:20.132111 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:20.132090    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ea39fa_373b_467f_948d_d7ade24a496b.slice/crio-40e1184d5178d1be08aef615e08be2eaf30b88fc6a03e26c3b6767cf4eac0e3e WatchSource:0}: Error finding container 40e1184d5178d1be08aef615e08be2eaf30b88fc6a03e26c3b6767cf4eac0e3e: Status 404 returned error can't find the container with id 40e1184d5178d1be08aef615e08be2eaf30b88fc6a03e26c3b6767cf4eac0e3e
Jul 30 19:39:20.487791 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.487715    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:20.487791 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.487758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:20.488030 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:20.487921    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:20.488030 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:20.487975    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs podName:02b82ed8-8246-442b-b355-1c07f8c70acc nodeName:}" failed. No retries permitted until 2026-07-30 19:39:21.487956535 +0000 UTC m=+4.128371608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs") pod "network-metrics-daemon-bsfvg" (UID: "02b82ed8-8246-442b-b355-1c07f8c70acc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:20.488295 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:20.488267    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:20.488382 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:20.488343    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret podName:8b118d49-f09f-41b4-8960-189b923082f0 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:21.488323472 +0000 UTC m=+4.128738536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret") pod "global-pull-secret-syncer-7gqnk" (UID: "8b118d49-f09f-41b4-8960-189b923082f0") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:20.588723 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.588681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72vz4\" (UniqueName: \"kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4\") pod \"network-check-target-qv5ss\" (UID: \"c5a2be49-dba4-4ba3-b11c-26710086017c\") " pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:20.588872 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:20.588817    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:20.588872 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:20.588836    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:20.588872 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:20.588844    2561 projected.go:196] Error preparing data for projected volume kube-api-access-72vz4 for pod openshift-network-diagnostics/network-check-target-qv5ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:20.589028 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:20.588910    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4 podName:c5a2be49-dba4-4ba3-b11c-26710086017c nodeName:}" failed. No retries permitted until 2026-07-30 19:39:21.58888045 +0000 UTC m=+4.229295530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-72vz4" (UniqueName: "kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4") pod "network-check-target-qv5ss" (UID: "c5a2be49-dba4-4ba3-b11c-26710086017c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:20.812299 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.812175    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 19:34:19 +0000 UTC" deadline="2028-04-27 11:19:26.113039842 +0000 UTC"
Jul 30 19:39:20.812299 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.812242    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15279h40m5.300801087s"
Jul 30 19:39:20.843699 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.843656    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-968bf" event={"ID":"66d5706a-702f-4e2f-a517-683598ce3f44","Type":"ContainerStarted","Data":"77ba8cb388668e5d698eab9fb444878ba8e7bcb915c293d95b76365829beb822"}
Jul 30 19:39:20.845144 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.845119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" event={"ID":"eb104d86-24bd-4152-b455-5280f8753668","Type":"ContainerStarted","Data":"7e1ab8b7b7d92c96c9be9c02074417fbf6b1d50c4d26a2157797cadffdca5001"}
Jul 30 19:39:20.847120 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.847092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-npldq" event={"ID":"d9ea39fa-373b-467f-948d-d7ade24a496b","Type":"ContainerStarted","Data":"40e1184d5178d1be08aef615e08be2eaf30b88fc6a03e26c3b6767cf4eac0e3e"}
Jul 30 19:39:20.848464 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.848423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7dk8g" event={"ID":"7a724735-f963-4de4-818e-0dd9f65bbaa9","Type":"ContainerStarted","Data":"fd14c5beae6e0d964c0a6159a36df2ff5fc709267b6a1b6fa7bbbc418ce2e7a9"}
Jul 30 19:39:20.850326 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.850269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tp65" event={"ID":"88042802-62d0-4a1d-97f9-6471afa98d05","Type":"ContainerStarted","Data":"de866d4981a66b10883530b6b2310d83fea9bbbd085a2d87fed54b6c5d0fc489"}
Jul 30 19:39:20.851609 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.851567    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f9dmn" event={"ID":"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6","Type":"ContainerStarted","Data":"1e96e8fc4349eed1bc767a9109c4606c3016504767f92d1596b5018605e8fd32"}
Jul 30 19:39:20.853544 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.853518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zwk5n" event={"ID":"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954","Type":"ContainerStarted","Data":"79c1abe7f6baae8f57e7c41c12b4ed24a18bd96e755c42e92d9af5e356a8ce41"}
Jul 30 19:39:20.854968 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.854944    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj" event={"ID":"2eca6ab1-45c1-4e73-afac-5acbbfceb046","Type":"ContainerStarted","Data":"8ae78eccacca37598b1bb811c8703cc9f6335262e37831561fa728b8da4699c8"}
Jul 30 19:39:20.857368 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:20.857324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q4bfz" event={"ID":"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe","Type":"ContainerStarted","Data":"8fc92f96ccdd6a00279fee8f706ca61d3fb7e34146c63ce17a500480766c7843"}
Jul 30 19:39:21.496199 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:21.495446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:21.496199 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:21.495493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:21.496199 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.495670    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:21.496199 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.495731    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs podName:02b82ed8-8246-442b-b355-1c07f8c70acc nodeName:}" failed. No retries permitted until 2026-07-30 19:39:23.495713222 +0000 UTC m=+6.136128303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs") pod "network-metrics-daemon-bsfvg" (UID: "02b82ed8-8246-442b-b355-1c07f8c70acc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:21.496199 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.496120    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:21.496199 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.496165    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret podName:8b118d49-f09f-41b4-8960-189b923082f0 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:23.496152065 +0000 UTC m=+6.136567126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret") pod "global-pull-secret-syncer-7gqnk" (UID: "8b118d49-f09f-41b4-8960-189b923082f0") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:21.596196 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:21.596167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72vz4\" (UniqueName: \"kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4\") pod \"network-check-target-qv5ss\" (UID: \"c5a2be49-dba4-4ba3-b11c-26710086017c\") " pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:21.596426 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.596409    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:21.596494 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.596432    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:21.596494 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.596445    2561 projected.go:196] Error preparing data for projected volume kube-api-access-72vz4 for pod openshift-network-diagnostics/network-check-target-qv5ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:21.596600 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.596500    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4 podName:c5a2be49-dba4-4ba3-b11c-26710086017c nodeName:}" failed. No retries permitted until 2026-07-30 19:39:23.596481502 +0000 UTC m=+6.236896577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-72vz4" (UniqueName: "kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4") pod "network-check-target-qv5ss" (UID: "c5a2be49-dba4-4ba3-b11c-26710086017c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:21.814742 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:21.813114    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 19:34:19 +0000 UTC" deadline="2028-03-12 07:46:57.083131407 +0000 UTC"
Jul 30 19:39:21.814742 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:21.813331    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14172h7m35.269807844s"
Jul 30 19:39:21.839037 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:21.838966    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:21.839163 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.839090    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:21.839472 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:21.839451    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:21.839569 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.839549    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:21.839632 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:21.839614    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:21.839700 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:21.839680    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:21.887444 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:21.887349    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" event={"ID":"a4a8295436f2a97d041aabd413f285d2","Type":"ContainerStarted","Data":"809b10842bb536a23378a32ed7189aa62716cdf09946d5fab3cd71f2532227d5"}
Jul 30 19:39:21.902950 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:21.902903    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-254.ec2.internal" podStartSLOduration=2.902872539 podStartE2EDuration="2.902872539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:21.901959146 +0000 UTC m=+4.542374226" watchObservedRunningTime="2026-07-30 19:39:21.902872539 +0000 UTC m=+4.543287623"
Jul 30 19:39:22.899871 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:22.899784    2561 generic.go:356] "Generic (PLEG): container finished" podID="1050cce1c5898f691ebfd594fda7cf19" containerID="8141d59a1c83bf6d8c65c8be8d43aad8ede727235ea12d08bd4137a50ed256b7" exitCode=0
Jul 30 19:39:22.900320 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:22.899965    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" event={"ID":"1050cce1c5898f691ebfd594fda7cf19","Type":"ContainerDied","Data":"8141d59a1c83bf6d8c65c8be8d43aad8ede727235ea12d08bd4137a50ed256b7"}
Jul 30 19:39:23.513398 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:23.513358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:23.513563 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:23.513412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:23.513563 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.513490    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:23.513563 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.513554    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:23.513726 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.513559    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret podName:8b118d49-f09f-41b4-8960-189b923082f0 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:27.513539145 +0000 UTC m=+10.153954213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret") pod "global-pull-secret-syncer-7gqnk" (UID: "8b118d49-f09f-41b4-8960-189b923082f0") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:23.513726 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.513616    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs podName:02b82ed8-8246-442b-b355-1c07f8c70acc nodeName:}" failed. No retries permitted until 2026-07-30 19:39:27.513599727 +0000 UTC m=+10.154014787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs") pod "network-metrics-daemon-bsfvg" (UID: "02b82ed8-8246-442b-b355-1c07f8c70acc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:23.614879 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:23.614309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72vz4\" (UniqueName: \"kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4\") pod \"network-check-target-qv5ss\" (UID: \"c5a2be49-dba4-4ba3-b11c-26710086017c\") " pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:23.614879 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.614470    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:23.614879 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.614489    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:23.614879 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.614501    2561 projected.go:196] Error preparing data for projected volume kube-api-access-72vz4 for pod openshift-network-diagnostics/network-check-target-qv5ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:23.614879 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.614552    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4 podName:c5a2be49-dba4-4ba3-b11c-26710086017c nodeName:}" failed. No retries permitted until 2026-07-30 19:39:27.614535331 +0000 UTC m=+10.254950394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-72vz4" (UniqueName: "kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4") pod "network-check-target-qv5ss" (UID: "c5a2be49-dba4-4ba3-b11c-26710086017c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:23.839989 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:23.839201    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:23.839989 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.839323    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:23.839989 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:23.839689    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:23.839989 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.839783    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:23.839989 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:23.839837    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:23.839989 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:23.839913    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:25.834857 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:25.834831    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:25.835297 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:25.834958    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:25.835297 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:25.835016    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:25.835297 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:25.835078    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:25.835297 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:25.835185    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:25.835297 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:25.835258    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:27.543982 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:27.543941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:27.544418 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:27.543989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:27.544418 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.544125    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:27.544418 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.544152    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:27.544418 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.544184    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs podName:02b82ed8-8246-442b-b355-1c07f8c70acc nodeName:}" failed. No retries permitted until 2026-07-30 19:39:35.544165618 +0000 UTC m=+18.184580678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs") pod "network-metrics-daemon-bsfvg" (UID: "02b82ed8-8246-442b-b355-1c07f8c70acc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:27.544418 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.544218    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret podName:8b118d49-f09f-41b4-8960-189b923082f0 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:35.544198694 +0000 UTC m=+18.184613771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret") pod "global-pull-secret-syncer-7gqnk" (UID: "8b118d49-f09f-41b4-8960-189b923082f0") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:27.644399 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:27.644318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72vz4\" (UniqueName: \"kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4\") pod \"network-check-target-qv5ss\" (UID: \"c5a2be49-dba4-4ba3-b11c-26710086017c\") " pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:27.644577 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.644468    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:27.644577 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.644490    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:27.644577 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.644504    2561 projected.go:196] Error preparing data for projected volume kube-api-access-72vz4 for pod openshift-network-diagnostics/network-check-target-qv5ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:27.644577 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.644562    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4 podName:c5a2be49-dba4-4ba3-b11c-26710086017c nodeName:}" failed. No retries permitted until 2026-07-30 19:39:35.644545459 +0000 UTC m=+18.284960520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-72vz4" (UniqueName: "kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4") pod "network-check-target-qv5ss" (UID: "c5a2be49-dba4-4ba3-b11c-26710086017c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:27.836008 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:27.835698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:27.836008 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.835813    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:27.836212 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:27.836166    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:27.836426 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.836263    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:27.836426 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:27.836314    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:27.836426 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:27.836387    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:29.835430 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:29.835386    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:29.835762 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:29.835386    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:29.835762 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:29.835504    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:29.835762 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:29.835527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:29.835762 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:29.835620    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:29.835762 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:29.835703    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:31.834872 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:31.834839    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:31.835346 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:31.834839    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:31.835346 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:31.834960    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:31.835346 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:31.834839    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:31.835346 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:31.835098    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:31.835346 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:31.835232    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:33.834561 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:33.834531    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:33.835010 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:33.834535    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:33.835010 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:33.834647    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:33.835010 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:33.834541    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:33.835010 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:33.834748    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:33.835010 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:33.834858    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:35.608748 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:35.608717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:35.609209 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:35.608760    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:35.609209 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.608876    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:35.609209 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.608943    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs podName:02b82ed8-8246-442b-b355-1c07f8c70acc nodeName:}" failed. No retries permitted until 2026-07-30 19:39:51.608929142 +0000 UTC m=+34.249344212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs") pod "network-metrics-daemon-bsfvg" (UID: "02b82ed8-8246-442b-b355-1c07f8c70acc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:35.609209 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.608876    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:35.609209 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.609021    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret podName:8b118d49-f09f-41b4-8960-189b923082f0 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:51.609009172 +0000 UTC m=+34.249424238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret") pod "global-pull-secret-syncer-7gqnk" (UID: "8b118d49-f09f-41b4-8960-189b923082f0") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:35.709190 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:35.709154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72vz4\" (UniqueName: \"kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4\") pod \"network-check-target-qv5ss\" (UID: \"c5a2be49-dba4-4ba3-b11c-26710086017c\") " pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:35.709341 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.709305    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:35.709341 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.709322    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:35.709341 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.709331    2561 projected.go:196] Error preparing data for projected volume kube-api-access-72vz4 for pod openshift-network-diagnostics/network-check-target-qv5ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:35.709495 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.709391    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4 podName:c5a2be49-dba4-4ba3-b11c-26710086017c nodeName:}" failed. No retries permitted until 2026-07-30 19:39:51.709373864 +0000 UTC m=+34.349788935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-72vz4" (UniqueName: "kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4") pod "network-check-target-qv5ss" (UID: "c5a2be49-dba4-4ba3-b11c-26710086017c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:35.835219 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:35.835186    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:35.835219 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:35.835205    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:35.835219 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:35.835194    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:35.835481 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.835336    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:35.835481 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.835397    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:35.835481 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:35.835448    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:37.835370 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:37.835339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:37.835838 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:37.835444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:37.835838 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:37.835457    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:37.835838 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:37.835520    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:37.835838 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:37.835558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:37.835838 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:37.835666    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:38.930584 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:38.930282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" event={"ID":"1050cce1c5898f691ebfd594fda7cf19","Type":"ContainerStarted","Data":"112a5e43f4ac1296bac2ff8bc0da780b356f547d32d1a3fa199920b2a303026a"}
Jul 30 19:39:38.938166 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:38.937999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7dk8g" event={"ID":"7a724735-f963-4de4-818e-0dd9f65bbaa9","Type":"ContainerStarted","Data":"d24717d007934195553f9eff2c80a82dca3358de812cbce5d9bf86d5c029571f"}
Jul 30 19:39:38.940035 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:38.939998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tp65" event={"ID":"88042802-62d0-4a1d-97f9-6471afa98d05","Type":"ContainerStarted","Data":"6850a56ad91a268c795c01017344097d1fa79d85bf6cf9021fd562f792a961f2"}
Jul 30 19:39:38.942218 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:38.942194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f9dmn" event={"ID":"ac7207e7-2de5-4600-8cd5-a1c40d94c1a6","Type":"ContainerStarted","Data":"86c4412a14b68b9727bb9b0181421b58e26dc2348d6e73ae6946a7e21b9864cb"}
Jul 30 19:39:38.951956 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:38.951881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" event={"ID":"eb104d86-24bd-4152-b455-5280f8753668","Type":"ContainerStarted","Data":"efc92d531d37bae675d7ef9be4539c3b36028cb6496385afe0e7631a2183e0cc"}
Jul 30 19:39:38.963425 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:38.963388    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f9dmn" podStartSLOduration=2.348267741 podStartE2EDuration="20.963376978s" totalImagesPullingTime="18.615109237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:38.963135988 +0000 UTC m=+21.603551071" watchObservedRunningTime="2026-07-30 19:39:38.963376978 +0000 UTC m=+21.603792078"
Jul 30 19:39:38.963531 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:38.963505    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-254.ec2.internal" podStartSLOduration=19.963495815 podStartE2EDuration="19.963495815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:38.947704587 +0000 UTC m=+21.588119702" watchObservedRunningTime="2026-07-30 19:39:38.963495815 +0000 UTC m=+21.603910896"
Jul 30 19:39:39.013712 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.013673    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7dk8g" podStartSLOduration=6.320031325 podStartE2EDuration="21.013659055s" totalImagesPullingTime="14.69362773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:39.013223394 +0000 UTC m=+21.653638475" watchObservedRunningTime="2026-07-30 19:39:39.013659055 +0000 UTC m=+21.654074135"
Jul 30 19:39:39.834868 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.834673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:39.835033 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.834673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:39.835033 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:39.834975    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:39.835168 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:39.835047    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:39.835168 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.834736    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:39.835168 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:39.835140    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:39.955084 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.955054    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-npldq" event={"ID":"d9ea39fa-373b-467f-948d-d7ade24a496b","Type":"ContainerStarted","Data":"0122670eeaaa21416bd49a07c778b28459d8fc99988ceb9b36b1d14c58bd28ee"}
Jul 30 19:39:39.956322 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.956303    2561 generic.go:356] "Generic (PLEG): container finished" podID="88042802-62d0-4a1d-97f9-6471afa98d05" containerID="6850a56ad91a268c795c01017344097d1fa79d85bf6cf9021fd562f792a961f2" exitCode=0
Jul 30 19:39:39.956389 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.956360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tp65" event={"ID":"88042802-62d0-4a1d-97f9-6471afa98d05","Type":"ContainerDied","Data":"6850a56ad91a268c795c01017344097d1fa79d85bf6cf9021fd562f792a961f2"}
Jul 30 19:39:39.957784 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.957756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zwk5n" event={"ID":"d6a4cff9-ed0a-43ab-b6b7-199bbdd66954","Type":"ContainerStarted","Data":"01d090eb93b63f6582043d32c060bda5ce376d06aba8e866a19356619d9e37cd"}
Jul 30 19:39:39.959040 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.959022    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj" event={"ID":"2eca6ab1-45c1-4e73-afac-5acbbfceb046","Type":"ContainerStarted","Data":"43fa333487291c5becc2ff43918b9e1e19ef30b6690e4ffd55af672ecbe9c992"}
Jul 30 19:39:39.960482 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.960457    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q4bfz" event={"ID":"dc9e19c5-f02f-4948-989d-f3a1f4cd28fe","Type":"ContainerStarted","Data":"ff64b06c04ba41b69511799800f4ef462ae178f3b0d1a0eed2042fcbd28948c9"}
Jul 30 19:39:39.961772 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.961754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-968bf" event={"ID":"66d5706a-702f-4e2f-a517-683598ce3f44","Type":"ContainerStarted","Data":"52fb480ba4cbce38588c696424e3e375e82624a4dbaaacf889504bd0fbf34eb0"}
Jul 30 19:39:39.964395 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.964379    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:39:39.964666 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.964650    2561 generic.go:356] "Generic (PLEG): container finished" podID="eb104d86-24bd-4152-b455-5280f8753668" containerID="1973289a8f9a3fef9d5d83dcef846fde49a96635054dcf9948e949bd6d35e692" exitCode=1
Jul 30 19:39:39.964743 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.964727    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" event={"ID":"eb104d86-24bd-4152-b455-5280f8753668","Type":"ContainerStarted","Data":"2e34f368f059b2749494fe831006b4aa21e90c4cbada9dd34acb84888ab6c27f"}
Jul 30 19:39:39.964796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.964785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" event={"ID":"eb104d86-24bd-4152-b455-5280f8753668","Type":"ContainerStarted","Data":"44076e913fb0269055a3b2388b8428fc45ba611b422d438d4a8bace428486abd"}
Jul 30 19:39:39.964831 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.964818    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" event={"ID":"eb104d86-24bd-4152-b455-5280f8753668","Type":"ContainerStarted","Data":"5d744298f7dc15024fa834c861135a80fe27bd0c60b387ce069e5ef6ba3697f3"}
Jul 30 19:39:39.964860 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.964845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" event={"ID":"eb104d86-24bd-4152-b455-5280f8753668","Type":"ContainerStarted","Data":"e764bbe580185114aab2d13092e3fd6febdcf62af09ec58202af8e0fd9fc8b1d"}
Jul 30 19:39:39.964922 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.964875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" event={"ID":"eb104d86-24bd-4152-b455-5280f8753668","Type":"ContainerDied","Data":"1973289a8f9a3fef9d5d83dcef846fde49a96635054dcf9948e949bd6d35e692"}
Jul 30 19:39:39.987951 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.986250    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zwk5n" podStartSLOduration=3.014975867 podStartE2EDuration="21.986234824s" totalImagesPullingTime="18.971258957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:39.985831984 +0000 UTC m=+22.626247064" watchObservedRunningTime="2026-07-30 19:39:39.986234824 +0000 UTC m=+22.626649907"
Jul 30 19:39:39.987951 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:39.986737    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-npldq" podStartSLOduration=3.422078131 podStartE2EDuration="21.986728384s" totalImagesPullingTime="18.564650253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:39.969730873 +0000 UTC m=+22.610145964" watchObservedRunningTime="2026-07-30 19:39:39.986728384 +0000 UTC m=+22.627143458"
Jul 30 19:39:40.019825 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:40.019792    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-968bf" podStartSLOduration=3.423645849 podStartE2EDuration="22.019781107s" totalImagesPullingTime="18.596135258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:40.019228177 +0000 UTC m=+22.659643257" watchObservedRunningTime="2026-07-30 19:39:40.019781107 +0000 UTC m=+22.660196187"
Jul 30 19:39:40.036452 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:40.036402    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q4bfz" podStartSLOduration=3.447808084 podStartE2EDuration="22.036391848s" totalImagesPullingTime="18.588583764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:40.036253747 +0000 UTC m=+22.676668827" watchObservedRunningTime="2026-07-30 19:39:40.036391848 +0000 UTC m=+22.676806928"
Jul 30 19:39:40.364687 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:40.364664    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 19:39:40.580727 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:40.580673    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:40.581258 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:40.581243    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:40.831542 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:40.831415    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T19:39:40.364682413Z","UUID":"e4f22ba2-333b-4b99-a823-0bc9d36f5c6a","Handler":null,"Name":"","Endpoint":""}
Jul 30 19:39:40.833118 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:40.833099    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 19:39:40.833118 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:40.833131    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 19:39:40.968747 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:40.968714    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj" event={"ID":"2eca6ab1-45c1-4e73-afac-5acbbfceb046","Type":"ContainerStarted","Data":"abc485b161666dd08f16ed4d53e26c0ac550bac14d4089e312012718b94a98bf"}
Jul 30 19:39:41.834650 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:41.834440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:41.834846 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:41.834492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:41.834846 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:41.834740    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:41.834846 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:41.834532    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:41.835029 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:41.834844    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:41.835029 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:41.834933    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:41.975155 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:41.975133    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:39:41.975729 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:41.975704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" event={"ID":"eb104d86-24bd-4152-b455-5280f8753668","Type":"ContainerStarted","Data":"9ed87f29ec31dad044b47b6c8d1b9e833d272f1c9ca96863fef3b402fa181da7"}
Jul 30 19:39:41.978146 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:41.978122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj" event={"ID":"2eca6ab1-45c1-4e73-afac-5acbbfceb046","Type":"ContainerStarted","Data":"345dbba2874886bd98ffac87847ab4740424cd8d839fc4a94c0b2f23e46b32de"}
Jul 30 19:39:41.978240 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:41.978172    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 30 19:39:41.996389 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:41.996350    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2tjj" podStartSLOduration=3.586999783 podStartE2EDuration="24.996339818s" totalImagesPullingTime="21.409340035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:41.99629574 +0000 UTC m=+24.636710820" watchObservedRunningTime="2026-07-30 19:39:41.996339818 +0000 UTC m=+24.636754898"
Jul 30 19:39:43.835105 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:43.834841    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:43.835792 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:43.834849    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:43.835792 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:43.835130    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:43.835792 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:43.834939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:43.835792 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:43.835239    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:43.835792 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:43.835320    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:43.986568 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:43.986543    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:39:43.986924 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:43.986902    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" event={"ID":"eb104d86-24bd-4152-b455-5280f8753668","Type":"ContainerStarted","Data":"e76946e81b7a2213acfe8626212bd42c83750ded387d8b625dcf9d09e0355bda"}
Jul 30 19:39:43.987162 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:43.987146    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:43.987243 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:43.987210    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:43.987434 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:43.987416    2561 scope.go:117] "RemoveContainer" containerID="1973289a8f9a3fef9d5d83dcef846fde49a96635054dcf9948e949bd6d35e692"
Jul 30 19:39:44.004679 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:44.004663    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:44.168382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:44.168297    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:44.168519 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:44.168410    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 30 19:39:44.169189 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:44.169132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7dk8g"
Jul 30 19:39:45.545250 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.545221    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7gqnk"]
Jul 30 19:39:45.545591 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.545354    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:45.545591 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:45.545436    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:45.548528 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.548255    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bsfvg"]
Jul 30 19:39:45.548528 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.548372    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:45.548528 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:45.548470    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:45.549134 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.549108    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qv5ss"]
Jul 30 19:39:45.549235 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.549218    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:45.549344 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:45.549314    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:45.993523 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.993487    2561 generic.go:356] "Generic (PLEG): container finished" podID="88042802-62d0-4a1d-97f9-6471afa98d05" containerID="cb4547553ae10fb0b042cc9adf3a6962e85c58f1848712a1afe92c1796ca414a" exitCode=0
Jul 30 19:39:45.993678 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.993590    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tp65" event={"ID":"88042802-62d0-4a1d-97f9-6471afa98d05","Type":"ContainerDied","Data":"cb4547553ae10fb0b042cc9adf3a6962e85c58f1848712a1afe92c1796ca414a"}
Jul 30 19:39:45.998283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.998263    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:39:45.998713 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.998690    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" event={"ID":"eb104d86-24bd-4152-b455-5280f8753668","Type":"ContainerStarted","Data":"b39c1f372f152861757bd22babcb3a19a12daca353c47059b0e5ef0bcb5f4b3f"}
Jul 30 19:39:45.999024 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:45.998999    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:46.014847 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:46.014823    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:39:46.040424 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:46.040387    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" podStartSLOduration=10.379256704 podStartE2EDuration="29.040375463s" totalImagesPullingTime="18.661118759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:46.038842826 +0000 UTC m=+28.679257907" watchObservedRunningTime="2026-07-30 19:39:46.040375463 +0000 UTC m=+28.680790543"
Jul 30 19:39:46.834845 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:46.834814    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:46.835268 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:46.834963    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:47.002795 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:47.002768    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tp65" event={"ID":"88042802-62d0-4a1d-97f9-6471afa98d05","Type":"ContainerStarted","Data":"2963069b98377374571a6bdca4184be927b4607774145813113bf6e53d7cc0a4"}
Jul 30 19:39:47.835489 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:47.835280    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:47.835831 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:47.835360    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:47.835831 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:47.835519    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:47.835831 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:47.835599    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:48.007253 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:48.007224    2561 generic.go:356] "Generic (PLEG): container finished" podID="88042802-62d0-4a1d-97f9-6471afa98d05" containerID="2963069b98377374571a6bdca4184be927b4607774145813113bf6e53d7cc0a4" exitCode=0
Jul 30 19:39:48.007389 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:48.007331    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tp65" event={"ID":"88042802-62d0-4a1d-97f9-6471afa98d05","Type":"ContainerDied","Data":"2963069b98377374571a6bdca4184be927b4607774145813113bf6e53d7cc0a4"}
Jul 30 19:39:48.017442 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:48.017409    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn" podUID="eb104d86-24bd-4152-b455-5280f8753668" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 30 19:39:48.835105 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:48.835064    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:48.835248 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:48.835200    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:49.835103 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:49.835025    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:49.835103 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:49.835045    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:49.835834 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:49.835145    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsfvg" podUID="02b82ed8-8246-442b-b355-1c07f8c70acc"
Jul 30 19:39:49.835834 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:49.835264    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gqnk" podUID="8b118d49-f09f-41b4-8960-189b923082f0"
Jul 30 19:39:50.014486 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:50.014457    2561 generic.go:356] "Generic (PLEG): container finished" podID="88042802-62d0-4a1d-97f9-6471afa98d05" containerID="3ff613252fc4a1195df47d9bd1f3b8202cf6f93dac4d5aaeee5dc19a57cb55bf" exitCode=0
Jul 30 19:39:50.014653 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:50.014500    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tp65" event={"ID":"88042802-62d0-4a1d-97f9-6471afa98d05","Type":"ContainerDied","Data":"3ff613252fc4a1195df47d9bd1f3b8202cf6f93dac4d5aaeee5dc19a57cb55bf"}
Jul 30 19:39:50.834596 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:50.834571    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:50.834772 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:50.834668    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qv5ss" podUID="c5a2be49-dba4-4ba3-b11c-26710086017c"
Jul 30 19:39:51.630856 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.630820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:51.631326 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.630949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:51.631326 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:51.630977    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:51.631326 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:51.631047    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret podName:8b118d49-f09f-41b4-8960-189b923082f0 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:23.631026286 +0000 UTC m=+66.271441361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret") pod "global-pull-secret-syncer-7gqnk" (UID: "8b118d49-f09f-41b4-8960-189b923082f0") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:51.631326 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:51.631119    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:51.631326 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:51.631178    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs podName:02b82ed8-8246-442b-b355-1c07f8c70acc nodeName:}" failed. No retries permitted until 2026-07-30 19:40:23.631161156 +0000 UTC m=+66.271576230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs") pod "network-metrics-daemon-bsfvg" (UID: "02b82ed8-8246-442b-b355-1c07f8c70acc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:51.713746 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.713692    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-254.ec2.internal" event="NodeReady"
Jul 30 19:39:51.713863 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.713787    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 19:39:51.731901 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.731869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72vz4\" (UniqueName: \"kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4\") pod \"network-check-target-qv5ss\" (UID: \"c5a2be49-dba4-4ba3-b11c-26710086017c\") " pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:51.732045 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:51.732027    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:51.732104 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:51.732051    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:51.732104 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:51.732061    2561 projected.go:196] Error preparing data for projected volume kube-api-access-72vz4 for pod openshift-network-diagnostics/network-check-target-qv5ss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:51.732104 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:51.732101    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4 podName:c5a2be49-dba4-4ba3-b11c-26710086017c nodeName:}" failed. No retries permitted until 2026-07-30 19:40:23.732089574 +0000 UTC m=+66.372504632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-72vz4" (UniqueName: "kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4") pod "network-check-target-qv5ss" (UID: "c5a2be49-dba4-4ba3-b11c-26710086017c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:51.749060 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.749039    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-688f467c-w8dhs"]
Jul 30 19:39:51.810137 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.810115    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"]
Jul 30 19:39:51.810262 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.810246    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:51.813198 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.813050    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2dgvw\""
Jul 30 19:39:51.813198 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.813069    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 19:39:51.813198 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.813050    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 19:39:51.813198 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.813185    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 19:39:51.823059 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.823042    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 19:39:51.823433 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.823415    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"]
Jul 30 19:39:51.823551 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.823534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:39:51.826291 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.826244    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 30 19:39:51.826386 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.826300    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:39:51.826386 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.826301    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 30 19:39:51.826386 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.826375    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zv7z8\""
Jul 30 19:39:51.841029 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.841006    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-rqlds"]
Jul 30 19:39:51.841117 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.841107    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:51.841182 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.841122    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:39:51.841564 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.841541    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:39:51.844040 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.844020    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:39:51.844187 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.844119    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 30 19:39:51.844187 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.844160    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 30 19:39:51.844187 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.844171    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 19:39:51.844446 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.844267    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p96kd\""
Jul 30 19:39:51.844446 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.844381    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 19:39:51.844446 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.844404    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 30 19:39:51.844600 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.844587    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zqvbn\""
Jul 30 19:39:51.866591 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.866573    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz"]
Jul 30 19:39:51.866695 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.866679    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:51.869382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.869362    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 30 19:39:51.869473 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.869362    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q6gkp\""
Jul 30 19:39:51.869473 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.869368    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 30 19:39:51.869473 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.869435    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 19:39:51.869691 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.869668    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 19:39:51.874994 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.874970    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 30 19:39:51.890748 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.890723    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz"
Jul 30 19:39:51.893289 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.893269    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:39:51.893289 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.893269    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lt6zj\""
Jul 30 19:39:51.893594 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.893566    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 30 19:39:51.894864 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.894846    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86c87c77cd-zw8kz"]
Jul 30 19:39:51.907596 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.907576    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"]
Jul 30 19:39:51.907715 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.907696    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:51.910460 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.910444    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 19:39:51.910668 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.910649    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x4t8n\""
Jul 30 19:39:51.910759 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.910685    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 30 19:39:51.910759 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.910718    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 19:39:51.910871 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.910758    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 30 19:39:51.910871 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.910822    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 30 19:39:51.911002 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.910916    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 30 19:39:51.926480 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.926454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:39:51.931636 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.931619    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"]
Jul 30 19:39:51.931739 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.931722    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:51.933043 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c61ae08-b999-49da-b893-8795ad8e7b0d-ca-trust-extracted\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:51.933149 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhn2n\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-kube-api-access-mhn2n\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:51.933149 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:39:51.933149 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933120    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-certificates\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:51.933311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/967aac46-da82-4cda-ab62-bf9e6715f85b-serving-cert\") pod \"service-ca-operator-784f97bcf6-shwpt\" (UID: \"967aac46-da82-4cda-ab62-bf9e6715f85b\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:51.933311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-image-registry-private-configuration\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:51.933311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-bound-sa-token\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:51.933311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crgwz\" (UniqueName: \"kubernetes.io/projected/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-kube-api-access-crgwz\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:39:51.933515 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tlsh\" (UniqueName: \"kubernetes.io/projected/967aac46-da82-4cda-ab62-bf9e6715f85b-kube-api-access-2tlsh\") pod \"service-ca-operator-784f97bcf6-shwpt\" (UID: \"967aac46-da82-4cda-ab62-bf9e6715f85b\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:51.933515 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-trusted-ca\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:51.933515 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933394    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/967aac46-da82-4cda-ab62-bf9e6715f85b-config\") pod \"service-ca-operator-784f97bcf6-shwpt\" (UID: \"967aac46-da82-4cda-ab62-bf9e6715f85b\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:51.933515 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:51.933515 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.933444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-installation-pull-secrets\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:51.934635 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.934577    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 30 19:39:51.934635 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.934596    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:39:51.934779 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.934634    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 30 19:39:51.934839 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.934800    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 30 19:39:51.934839 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.934825    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wz8w7\""
Jul 30 19:39:51.943764 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.943746    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-fcfsk"]
Jul 30 19:39:51.943877 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.943863    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:39:51.947692 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.947147    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 30 19:39:51.947692 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.947663    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f4zw8\""
Jul 30 19:39:51.947834 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.947766    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 30 19:39:51.954028 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.954007    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"]
Jul 30 19:39:51.954295 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.954147    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:51.957629 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.957569    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 30 19:39:51.957629 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.957602    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:39:51.957629 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.957615    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 30 19:39:51.957844 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.957748    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 30 19:39:51.957909 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.957841    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zwwnz\""
Jul 30 19:39:51.963681 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.963663    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 30 19:39:51.970097 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.970055    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-688f467c-w8dhs"]
Jul 30 19:39:51.970097 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.970085    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz"]
Jul 30 19:39:51.970205 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.970105    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"]
Jul 30 19:39:51.970205 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.970129    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"]
Jul 30 19:39:51.970205 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.970152    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"]
Jul 30 19:39:51.970205 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.970169    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"]
Jul 30 19:39:51.970205 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.970186    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-fcfsk"]
Jul 30 19:39:51.970407 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.970246    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:51.970407 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.970288    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-74wzd"]
Jul 30 19:39:51.974388 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.974185    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 30 19:39:51.974388 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.974249    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d6dks\""
Jul 30 19:39:51.974388 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.974193    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 19:39:51.975308 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.975288    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 30 19:39:51.975400 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.975327    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 19:39:51.984106 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.984090    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq"]
Jul 30 19:39:51.984226 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.984209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:51.986633 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.986615    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 19:39:51.986850 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.986835    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj98q\""
Jul 30 19:39:51.986955 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.986915    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 19:39:51.998261 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.998244    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fftjg"]
Jul 30 19:39:51.998358 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:51.998341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq"
Jul 30 19:39:52.000977 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.000957    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 19:39:52.001064 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.000999    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 19:39:52.001064 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.001046    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fjwdd\""
Jul 30 19:39:52.007643 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.007620    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:39:52.012940 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.012924    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86c87c77cd-zw8kz"]
Jul 30 19:39:52.013022 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.012949    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-rqlds"]
Jul 30 19:39:52.013022 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.012964    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fftjg"]
Jul 30 19:39:52.013022 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.012980    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"]
Jul 30 19:39:52.013141 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.013041    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fftjg"
Jul 30 19:39:52.013141 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.013068    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-74wzd"]
Jul 30 19:39:52.013141 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.013088    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq"]
Jul 30 19:39:52.015798 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.015780    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 19:39:52.015798 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.015796    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 19:39:52.015977 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.015799    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rlq6w\""
Jul 30 19:39:52.015977 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.015842    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 19:39:52.034283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-certificates\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.034369 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:39:52.034369 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034319    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e504161-83cf-456c-a22c-b931f7229f6b-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:39:52.034474 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-image-registry-private-configuration\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.034474 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-bound-sa-token\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.034575 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-stats-auth\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.034575 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc9d5\" (UniqueName: \"kubernetes.io/projected/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-kube-api-access-hc9d5\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.034575 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crgwz\" (UniqueName: \"kubernetes.io/projected/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-kube-api-access-crgwz\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:39:52.034575 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbw5r\" (UniqueName: \"kubernetes.io/projected/07a83901-0254-4f62-be31-1d43d8ab70c4-kube-api-access-rbw5r\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.034765 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07a83901-0254-4f62-be31-1d43d8ab70c4-tmp\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.034765 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/07a83901-0254-4f62-be31-1d43d8ab70c4-snapshots\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.034765 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a83901-0254-4f62-be31-1d43d8ab70c4-service-ca-bundle\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.034765 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-installation-pull-secrets\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.034765 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c61ae08-b999-49da-b893-8795ad8e7b0d-ca-trust-extracted\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.035101 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-certificates\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.035101 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.034914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c07eb7f6-b249-4a53-96ec-055a46e4330c-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-j5vtm\" (UID: \"c07eb7f6-b249-4a53-96ec-055a46e4330c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:52.035101 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035005    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.035101 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:39:52.035101 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035066    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c07eb7f6-b249-4a53-96ec-055a46e4330c-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-j5vtm\" (UID: \"c07eb7f6-b249-4a53-96ec-055a46e4330c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:52.035101 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035092    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a83901-0254-4f62-be31-1d43d8ab70c4-trusted-ca-bundle\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.035372 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.035197    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 19:39:52.035372 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.035372 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035233    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8766n\" (UniqueName: \"kubernetes.io/projected/209c514e-4f86-4faf-919b-551402c28e8c-kube-api-access-8766n\") pod \"volume-data-source-validator-5b8776669-prwbz\" (UID: \"209c514e-4f86-4faf-919b-551402c28e8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz"
Jul 30 19:39:52.035372 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.035251    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls podName:7682cb80-12da-47d5-9ecf-9dbe7ae8d862 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:52.535232337 +0000 UTC m=+35.175647410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-qxbk5" (UID: "7682cb80-12da-47d5-9ecf-9dbe7ae8d862") : secret "samples-operator-tls" not found
Jul 30 19:39:52.035372 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tlsh\" (UniqueName: \"kubernetes.io/projected/967aac46-da82-4cda-ab62-bf9e6715f85b-kube-api-access-2tlsh\") pod \"service-ca-operator-784f97bcf6-shwpt\" (UID: \"967aac46-da82-4cda-ab62-bf9e6715f85b\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:52.035372 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrpf\" (UniqueName: \"kubernetes.io/projected/c07eb7f6-b249-4a53-96ec-055a46e4330c-kube-api-access-sxrpf\") pod \"kube-storage-version-migrator-operator-7878f4b88c-j5vtm\" (UID: \"c07eb7f6-b249-4a53-96ec-055a46e4330c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:52.035372 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-default-certificate\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.035372 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-trusted-ca\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.035744 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/967aac46-da82-4cda-ab62-bf9e6715f85b-config\") pod \"service-ca-operator-784f97bcf6-shwpt\" (UID: \"967aac46-da82-4cda-ab62-bf9e6715f85b\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:52.035744 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.035744 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07a83901-0254-4f62-be31-1d43d8ab70c4-serving-cert\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.035744 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhn2n\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-kube-api-access-mhn2n\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.035744 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035522    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/967aac46-da82-4cda-ab62-bf9e6715f85b-serving-cert\") pod \"service-ca-operator-784f97bcf6-shwpt\" (UID: \"967aac46-da82-4cda-ab62-bf9e6715f85b\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:52.036460 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.035060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c61ae08-b999-49da-b893-8795ad8e7b0d-ca-trust-extracted\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.036460 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.036109    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/967aac46-da82-4cda-ab62-bf9e6715f85b-config\") pod \"service-ca-operator-784f97bcf6-shwpt\" (UID: \"967aac46-da82-4cda-ab62-bf9e6715f85b\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:52.036460 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.036302    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 19:39:52.036460 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.036318    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-688f467c-w8dhs: secret "image-registry-tls" not found
Jul 30 19:39:52.036460 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.036432    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls podName:5c61ae08-b999-49da-b893-8795ad8e7b0d nodeName:}" failed. No retries permitted until 2026-07-30 19:39:52.536414535 +0000 UTC m=+35.176829593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls") pod "image-registry-688f467c-w8dhs" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d") : secret "image-registry-tls" not found
Jul 30 19:39:52.037027 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.036986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-trusted-ca\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.039555 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.039534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/967aac46-da82-4cda-ab62-bf9e6715f85b-serving-cert\") pod \"service-ca-operator-784f97bcf6-shwpt\" (UID: \"967aac46-da82-4cda-ab62-bf9e6715f85b\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:52.039678 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.039656    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-installation-pull-secrets\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.039737 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.039664    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-image-registry-private-configuration\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.043467 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.043430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tlsh\" (UniqueName: \"kubernetes.io/projected/967aac46-da82-4cda-ab62-bf9e6715f85b-kube-api-access-2tlsh\") pod \"service-ca-operator-784f97bcf6-shwpt\" (UID: \"967aac46-da82-4cda-ab62-bf9e6715f85b\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:52.043960 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.043941    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crgwz\" (UniqueName: \"kubernetes.io/projected/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-kube-api-access-crgwz\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:39:52.044046 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.043963    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhn2n\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-kube-api-access-mhn2n\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.044292 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.044270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-bound-sa-token\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.136758 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.136738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.136857 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.136775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c07eb7f6-b249-4a53-96ec-055a46e4330c-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-j5vtm\" (UID: \"c07eb7f6-b249-4a53-96ec-055a46e4330c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:52.136857 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.136791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a83901-0254-4f62-be31-1d43d8ab70c4-trusted-ca-bundle\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.136857 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.136812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.137047 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.136862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:52.137047 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.136903    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 19:39:52.137047 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.136912    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/059ae0e7-1f8f-4604-ac8e-408810ec9693-cert\") pod \"ingress-canary-fftjg\" (UID: \"059ae0e7-1f8f-4604-ac8e-408810ec9693\") " pod="openshift-ingress-canary/ingress-canary-fftjg"
Jul 30 19:39:52.137047 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.136939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8766n\" (UniqueName: \"kubernetes.io/projected/209c514e-4f86-4faf-919b-551402c28e8c-kube-api-access-8766n\") pod \"volume-data-source-validator-5b8776669-prwbz\" (UID: \"209c514e-4f86-4faf-919b-551402c28e8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz"
Jul 30 19:39:52.137047 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.136997    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kppgm\" (UniqueName: \"kubernetes.io/projected/f41539d0-5113-4e86-a7e3-9ebff9ee5631-kube-api-access-kppgm\") pod \"network-check-source-65bdbbff45-c65pq\" (UID: \"f41539d0-5113-4e86-a7e3-9ebff9ee5631\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq"
Jul 30 19:39:52.137047 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137039    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.137324 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.137067    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:52.6370376 +0000 UTC m=+35.277452674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : secret "router-metrics-certs-default" not found
Jul 30 19:39:52.137324 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrpf\" (UniqueName: \"kubernetes.io/projected/c07eb7f6-b249-4a53-96ec-055a46e4330c-kube-api-access-sxrpf\") pod \"kube-storage-version-migrator-operator-7878f4b88c-j5vtm\" (UID: \"c07eb7f6-b249-4a53-96ec-055a46e4330c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:52.137324 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.137185    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:52.63717235 +0000 UTC m=+35.277587408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : configmap references non-existent config key: service-ca.crt
Jul 30 19:39:52.137324 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137207    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-default-certificate\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.137324 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07a83901-0254-4f62-be31-1d43d8ab70c4-serving-cert\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.137324 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgj78\" (UniqueName: \"kubernetes.io/projected/883492c1-b9b3-4281-9928-4c3bc84bf805-kube-api-access-sgj78\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.137324 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2fvg\" (UniqueName: \"kubernetes.io/projected/17e8b2b9-1baf-4271-9291-5820bfc1d24e-kube-api-access-k2fvg\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137412    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhkzw\" (UniqueName: \"kubernetes.io/projected/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-kube-api-access-nhkzw\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17e8b2b9-1baf-4271-9291-5820bfc1d24e-config\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137487    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c07eb7f6-b249-4a53-96ec-055a46e4330c-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-j5vtm\" (UID: \"c07eb7f6-b249-4a53-96ec-055a46e4330c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e504161-83cf-456c-a22c-b931f7229f6b-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137572    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-stats-auth\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc9d5\" (UniqueName: \"kubernetes.io/projected/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-kube-api-access-hc9d5\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.137604    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbw5r\" (UniqueName: \"kubernetes.io/projected/07a83901-0254-4f62-be31-1d43d8ab70c4-kube-api-access-rbw5r\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.137664 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.137665    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert podName:6e504161-83cf-456c-a22c-b931f7229f6b nodeName:}" failed. No retries permitted until 2026-07-30 19:39:52.637639919 +0000 UTC m=+35.278054991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-d6pb4" (UID: "6e504161-83cf-456c-a22c-b931f7229f6b") : secret "networking-console-plugin-cert" not found
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137693    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17e8b2b9-1baf-4271-9291-5820bfc1d24e-serving-cert\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17e8b2b9-1baf-4271-9291-5820bfc1d24e-trusted-ca\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07a83901-0254-4f62-be31-1d43d8ab70c4-tmp\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/07a83901-0254-4f62-be31-1d43d8ab70c4-snapshots\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a83901-0254-4f62-be31-1d43d8ab70c4-service-ca-bundle\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137869    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a83901-0254-4f62-be31-1d43d8ab70c4-trusted-ca-bundle\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/883492c1-b9b3-4281-9928-4c3bc84bf805-tmp-dir\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/883492c1-b9b3-4281-9928-4c3bc84bf805-config-volume\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137951    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg4mm\" (UniqueName: \"kubernetes.io/projected/059ae0e7-1f8f-4604-ac8e-408810ec9693-kube-api-access-rg4mm\") pod \"ingress-canary-fftjg\" (UID: \"059ae0e7-1f8f-4604-ac8e-408810ec9693\") " pod="openshift-ingress-canary/ingress-canary-fftjg"
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.137997    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c07eb7f6-b249-4a53-96ec-055a46e4330c-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-j5vtm\" (UID: \"c07eb7f6-b249-4a53-96ec-055a46e4330c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:52.138283 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.138179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07a83901-0254-4f62-be31-1d43d8ab70c4-tmp\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.138819 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.138370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/07a83901-0254-4f62-be31-1d43d8ab70c4-snapshots\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.138819 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.138401    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a83901-0254-4f62-be31-1d43d8ab70c4-service-ca-bundle\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.138819 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.138614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e504161-83cf-456c-a22c-b931f7229f6b-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:39:52.139798 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.139754    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07a83901-0254-4f62-be31-1d43d8ab70c4-serving-cert\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.140682 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.140663    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-default-certificate\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.140881 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.140857    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-stats-auth\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.140881 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.140875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c07eb7f6-b249-4a53-96ec-055a46e4330c-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-j5vtm\" (UID: \"c07eb7f6-b249-4a53-96ec-055a46e4330c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:52.145716 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.145690    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrpf\" (UniqueName: \"kubernetes.io/projected/c07eb7f6-b249-4a53-96ec-055a46e4330c-kube-api-access-sxrpf\") pod \"kube-storage-version-migrator-operator-7878f4b88c-j5vtm\" (UID: \"c07eb7f6-b249-4a53-96ec-055a46e4330c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:52.146336 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.146300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8766n\" (UniqueName: \"kubernetes.io/projected/209c514e-4f86-4faf-919b-551402c28e8c-kube-api-access-8766n\") pod \"volume-data-source-validator-5b8776669-prwbz\" (UID: \"209c514e-4f86-4faf-919b-551402c28e8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz"
Jul 30 19:39:52.146632 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.146608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc9d5\" (UniqueName: \"kubernetes.io/projected/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-kube-api-access-hc9d5\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.147106 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.147075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbw5r\" (UniqueName: \"kubernetes.io/projected/07a83901-0254-4f62-be31-1d43d8ab70c4-kube-api-access-rbw5r\") pod \"insights-operator-77696685b-rqlds\" (UID: \"07a83901-0254-4f62-be31-1d43d8ab70c4\") " pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.152177 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.152159    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"
Jul 30 19:39:52.176133 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.175968    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-rqlds"
Jul 30 19:39:52.200932 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.200909    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz"
Jul 30 19:39:52.238584 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/883492c1-b9b3-4281-9928-4c3bc84bf805-tmp-dir\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.238584 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238522    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/883492c1-b9b3-4281-9928-4c3bc84bf805-config-volume\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.238584 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg4mm\" (UniqueName: \"kubernetes.io/projected/059ae0e7-1f8f-4604-ac8e-408810ec9693-kube-api-access-rg4mm\") pod \"ingress-canary-fftjg\" (UID: \"059ae0e7-1f8f-4604-ac8e-408810ec9693\") " pod="openshift-ingress-canary/ingress-canary-fftjg"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238612    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/059ae0e7-1f8f-4604-ac8e-408810ec9693-cert\") pod \"ingress-canary-fftjg\" (UID: \"059ae0e7-1f8f-4604-ac8e-408810ec9693\") " pod="openshift-ingress-canary/ingress-canary-fftjg"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kppgm\" (UniqueName: \"kubernetes.io/projected/f41539d0-5113-4e86-a7e3-9ebff9ee5631-kube-api-access-kppgm\") pod \"network-check-source-65bdbbff45-c65pq\" (UID: \"f41539d0-5113-4e86-a7e3-9ebff9ee5631\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgj78\" (UniqueName: \"kubernetes.io/projected/883492c1-b9b3-4281-9928-4c3bc84bf805-kube-api-access-sgj78\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2fvg\" (UniqueName: \"kubernetes.io/projected/17e8b2b9-1baf-4271-9291-5820bfc1d24e-kube-api-access-k2fvg\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhkzw\" (UniqueName: \"kubernetes.io/projected/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-kube-api-access-nhkzw\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17e8b2b9-1baf-4271-9291-5820bfc1d24e-config\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17e8b2b9-1baf-4271-9291-5820bfc1d24e-serving-cert\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.238984 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.238935    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17e8b2b9-1baf-4271-9291-5820bfc1d24e-trusted-ca\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.239513 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.239176    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 19:39:52.239513 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.239271    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls podName:883492c1-b9b3-4281-9928-4c3bc84bf805 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:52.739250676 +0000 UTC m=+35.379665748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls") pod "dns-default-74wzd" (UID: "883492c1-b9b3-4281-9928-4c3bc84bf805") : secret "dns-default-metrics-tls" not found
Jul 30 19:39:52.239513 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.239386    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/883492c1-b9b3-4281-9928-4c3bc84bf805-tmp-dir\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.239513 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.239466    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 19:39:52.239757 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.239515    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls podName:ddfb3012-64c9-4a83-9a6f-c39b9e768cc4 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:52.739500208 +0000 UTC m=+35.379915290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-hgm8k" (UID: "ddfb3012-64c9-4a83-9a6f-c39b9e768cc4") : secret "cluster-monitoring-operator-tls" not found
Jul 30 19:39:52.240331 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.239958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17e8b2b9-1baf-4271-9291-5820bfc1d24e-trusted-ca\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.240331 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.240031    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/883492c1-b9b3-4281-9928-4c3bc84bf805-config-volume\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.240639 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.240617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:52.240717 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.240668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17e8b2b9-1baf-4271-9291-5820bfc1d24e-config\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.241020 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.241005    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"
Jul 30 19:39:52.243450 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.243432    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/059ae0e7-1f8f-4604-ac8e-408810ec9693-cert\") pod \"ingress-canary-fftjg\" (UID: \"059ae0e7-1f8f-4604-ac8e-408810ec9693\") " pod="openshift-ingress-canary/ingress-canary-fftjg"
Jul 30 19:39:52.243663 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.243644    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17e8b2b9-1baf-4271-9291-5820bfc1d24e-serving-cert\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.251345 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.251302    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhkzw\" (UniqueName: \"kubernetes.io/projected/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-kube-api-access-nhkzw\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:52.251450 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.251428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgj78\" (UniqueName: \"kubernetes.io/projected/883492c1-b9b3-4281-9928-4c3bc84bf805-kube-api-access-sgj78\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.251450 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.251434    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2fvg\" (UniqueName: \"kubernetes.io/projected/17e8b2b9-1baf-4271-9291-5820bfc1d24e-kube-api-access-k2fvg\") pod \"console-operator-5ccd6b445f-fcfsk\" (UID: \"17e8b2b9-1baf-4271-9291-5820bfc1d24e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.252337 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.251557    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kppgm\" (UniqueName: \"kubernetes.io/projected/f41539d0-5113-4e86-a7e3-9ebff9ee5631-kube-api-access-kppgm\") pod \"network-check-source-65bdbbff45-c65pq\" (UID: \"f41539d0-5113-4e86-a7e3-9ebff9ee5631\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq"
Jul 30 19:39:52.252337 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.251766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg4mm\" (UniqueName: \"kubernetes.io/projected/059ae0e7-1f8f-4604-ac8e-408810ec9693-kube-api-access-rg4mm\") pod \"ingress-canary-fftjg\" (UID: \"059ae0e7-1f8f-4604-ac8e-408810ec9693\") " pod="openshift-ingress-canary/ingress-canary-fftjg"
Jul 30 19:39:52.264646 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.264628    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:39:52.310224 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.310150    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq"
Jul 30 19:39:52.326320 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.323870    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fftjg"
Jul 30 19:39:52.404381 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.404288    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-rqlds"]
Jul 30 19:39:52.409619 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.408984    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz"]
Jul 30 19:39:52.431185 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.417302    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt"]
Jul 30 19:39:52.456438 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:52.456408    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209c514e_4f86_4faf_919b_551402c28e8c.slice/crio-0820de05197e1b3675ad4b2de4e638b0308a832b9e4649b7926ddf3adb65b1d8 WatchSource:0}: Error finding container 0820de05197e1b3675ad4b2de4e638b0308a832b9e4649b7926ddf3adb65b1d8: Status 404 returned error can't find the container with id 0820de05197e1b3675ad4b2de4e638b0308a832b9e4649b7926ddf3adb65b1d8
Jul 30 19:39:52.495986 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.495706    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm"]
Jul 30 19:39:52.498558 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:52.498528    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07eb7f6_b249_4a53_96ec_055a46e4330c.slice/crio-d665e52655dd2fcbeb14ecc71269a35655b7d7ac79927251726598b39b1ee442 WatchSource:0}: Error finding container d665e52655dd2fcbeb14ecc71269a35655b7d7ac79927251726598b39b1ee442: Status 404 returned error can't find the container with id d665e52655dd2fcbeb14ecc71269a35655b7d7ac79927251726598b39b1ee442
Jul 30 19:39:52.525743 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.525708    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq"]
Jul 30 19:39:52.529927 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:52.529878    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41539d0_5113_4e86_a7e3_9ebff9ee5631.slice/crio-2e4efb60a6f06f17a23d623cdcb1e530c6bcd53adc7b47764a56fc9618c8490b WatchSource:0}: Error finding container 2e4efb60a6f06f17a23d623cdcb1e530c6bcd53adc7b47764a56fc9618c8490b: Status 404 returned error can't find the container with id 2e4efb60a6f06f17a23d623cdcb1e530c6bcd53adc7b47764a56fc9618c8490b
Jul 30 19:39:52.537088 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.537037    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-fcfsk"]
Jul 30 19:39:52.540402 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:52.540378    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e8b2b9_1baf_4271_9291_5820bfc1d24e.slice/crio-84a6d436c94e88dff2a7cdef0efa31af66fd838ce6e644db1c6b52fd4c7b8723 WatchSource:0}: Error finding container 84a6d436c94e88dff2a7cdef0efa31af66fd838ce6e644db1c6b52fd4c7b8723: Status 404 returned error can't find the container with id 84a6d436c94e88dff2a7cdef0efa31af66fd838ce6e644db1c6b52fd4c7b8723
Jul 30 19:39:52.549597 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.549576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:39:52.549766 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.549735    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 19:39:52.549882 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.549789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:52.549882 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.549814    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls podName:7682cb80-12da-47d5-9ecf-9dbe7ae8d862 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:53.549793041 +0000 UTC m=+36.190208102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-qxbk5" (UID: "7682cb80-12da-47d5-9ecf-9dbe7ae8d862") : secret "samples-operator-tls" not found
Jul 30 19:39:52.550017 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.549907    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 19:39:52.550017 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.549924    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-688f467c-w8dhs: secret "image-registry-tls" not found
Jul 30 19:39:52.550017 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.549977    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls podName:5c61ae08-b999-49da-b893-8795ad8e7b0d nodeName:}" failed. No retries permitted until 2026-07-30 19:39:53.549960583 +0000 UTC m=+36.190375644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls") pod "image-registry-688f467c-w8dhs" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d") : secret "image-registry-tls" not found
Jul 30 19:39:52.564591 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.564569    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fftjg"]
Jul 30 19:39:52.567632 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:39:52.567611    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059ae0e7_1f8f_4604_ac8e_408810ec9693.slice/crio-86666eb869894ae383ad1e05d7dc07af4f1e6ec06096161e3820f41e76fd25b2 WatchSource:0}: Error finding container 86666eb869894ae383ad1e05d7dc07af4f1e6ec06096161e3820f41e76fd25b2: Status 404 returned error can't find the container with id 86666eb869894ae383ad1e05d7dc07af4f1e6ec06096161e3820f41e76fd25b2
Jul 30 19:39:52.650790 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.650761    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:39:52.651148 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.650865    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.651148 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.650925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:52.651148 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.650942    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 19:39:52.651148 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.650982    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 19:39:52.651148 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.651003    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert podName:6e504161-83cf-456c-a22c-b931f7229f6b nodeName:}" failed. No retries permitted until 2026-07-30 19:39:53.650984413 +0000 UTC m=+36.291399475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-d6pb4" (UID: "6e504161-83cf-456c-a22c-b931f7229f6b") : secret "networking-console-plugin-cert" not found
Jul 30 19:39:52.651148 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.651034    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:53.65101892 +0000 UTC m=+36.291433981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : secret "router-metrics-certs-default" not found
Jul 30 19:39:52.651148 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.651057    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:53.651047516 +0000 UTC m=+36.291462579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : configmap references non-existent config key: service-ca.crt
Jul 30 19:39:52.751689 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.751629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:52.751689 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.751664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:52.751826 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.751793    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 19:39:52.751872 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.751837    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls podName:883492c1-b9b3-4281-9928-4c3bc84bf805 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:53.751824954 +0000 UTC m=+36.392240011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls") pod "dns-default-74wzd" (UID: "883492c1-b9b3-4281-9928-4c3bc84bf805") : secret "dns-default-metrics-tls" not found
Jul 30 19:39:52.751948 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.751934    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 19:39:52.752004 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:52.751997    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls podName:ddfb3012-64c9-4a83-9a6f-c39b9e768cc4 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:53.751979851 +0000 UTC m=+36.392394922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-hgm8k" (UID: "ddfb3012-64c9-4a83-9a6f-c39b9e768cc4") : secret "cluster-monitoring-operator-tls" not found
Jul 30 19:39:52.802293 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.802267    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:39:52.834995 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.834972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:39:52.838016 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.838000    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chvmd\""
Jul 30 19:39:52.872311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:52.872291    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:39:53.022304 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.022247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fftjg" event={"ID":"059ae0e7-1f8f-4604-ac8e-408810ec9693","Type":"ContainerStarted","Data":"86666eb869894ae383ad1e05d7dc07af4f1e6ec06096161e3820f41e76fd25b2"}
Jul 30 19:39:53.023557 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.023521    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq" event={"ID":"f41539d0-5113-4e86-a7e3-9ebff9ee5631","Type":"ContainerStarted","Data":"2e4efb60a6f06f17a23d623cdcb1e530c6bcd53adc7b47764a56fc9618c8490b"}
Jul 30 19:39:53.024735 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.024708    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rqlds" event={"ID":"07a83901-0254-4f62-be31-1d43d8ab70c4","Type":"ContainerStarted","Data":"4efefa5df258c34a077d56a0e2760a080338067ebd659d0244245224fb1074c0"}
Jul 30 19:39:53.026008 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.025979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt" event={"ID":"967aac46-da82-4cda-ab62-bf9e6715f85b","Type":"ContainerStarted","Data":"af7c902b68edf8f022766a6a8bef524fc30864afbaa5c887eaee01285a17deea"}
Jul 30 19:39:53.027260 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.027240    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm" event={"ID":"c07eb7f6-b249-4a53-96ec-055a46e4330c","Type":"ContainerStarted","Data":"d665e52655dd2fcbeb14ecc71269a35655b7d7ac79927251726598b39b1ee442"}
Jul 30 19:39:53.028489 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.028467    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz" event={"ID":"209c514e-4f86-4faf-919b-551402c28e8c","Type":"ContainerStarted","Data":"0820de05197e1b3675ad4b2de4e638b0308a832b9e4649b7926ddf3adb65b1d8"}
Jul 30 19:39:53.029594 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.029576    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" event={"ID":"17e8b2b9-1baf-4271-9291-5820bfc1d24e","Type":"ContainerStarted","Data":"84a6d436c94e88dff2a7cdef0efa31af66fd838ce6e644db1c6b52fd4c7b8723"}
Jul 30 19:39:53.558901 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.558519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:39:53.558901 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.558623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:53.558901 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.558712    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 19:39:53.558901 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.558743    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 19:39:53.558901 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.558754    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-688f467c-w8dhs: secret "image-registry-tls" not found
Jul 30 19:39:53.558901 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.558775    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls podName:7682cb80-12da-47d5-9ecf-9dbe7ae8d862 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:55.558756604 +0000 UTC m=+38.199171675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-qxbk5" (UID: "7682cb80-12da-47d5-9ecf-9dbe7ae8d862") : secret "samples-operator-tls" not found
Jul 30 19:39:53.558901 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.558791    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls podName:5c61ae08-b999-49da-b893-8795ad8e7b0d nodeName:}" failed. No retries permitted until 2026-07-30 19:39:55.558783313 +0000 UTC m=+38.199198385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls") pod "image-registry-688f467c-w8dhs" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d") : secret "image-registry-tls" not found
Jul 30 19:39:53.659170 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.659134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:53.659610 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.659200    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:53.659610 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.659317    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:39:53.659610 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.659445    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 19:39:53.659610 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.659515    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert podName:6e504161-83cf-456c-a22c-b931f7229f6b nodeName:}" failed. No retries permitted until 2026-07-30 19:39:55.659495489 +0000 UTC m=+38.299910566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-d6pb4" (UID: "6e504161-83cf-456c-a22c-b931f7229f6b") : secret "networking-console-plugin-cert" not found
Jul 30 19:39:53.659970 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.659950    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 19:39:53.660052 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.660011    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:55.659995011 +0000 UTC m=+38.300410086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : secret "router-metrics-certs-default" not found
Jul 30 19:39:53.660123 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.660092    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:55.660080095 +0000 UTC m=+38.300495169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : configmap references non-existent config key: service-ca.crt
Jul 30 19:39:53.761031 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.760125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:53.761031 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:53.760329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:53.761031 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.760535    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 19:39:53.761031 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.760589    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls podName:883492c1-b9b3-4281-9928-4c3bc84bf805 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:55.760573316 +0000 UTC m=+38.400988379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls") pod "dns-default-74wzd" (UID: "883492c1-b9b3-4281-9928-4c3bc84bf805") : secret "dns-default-metrics-tls" not found
Jul 30 19:39:53.761031 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.760945    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 19:39:53.761031 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:53.760998    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls podName:ddfb3012-64c9-4a83-9a6f-c39b9e768cc4 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:55.760981133 +0000 UTC m=+38.401396192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-hgm8k" (UID: "ddfb3012-64c9-4a83-9a6f-c39b9e768cc4") : secret "cluster-monitoring-operator-tls" not found
Jul 30 19:39:55.579820 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:55.579511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:39:55.580360 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.579720    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 19:39:55.580360 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:55.579865    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:55.580360 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.579941    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls podName:7682cb80-12da-47d5-9ecf-9dbe7ae8d862 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:59.579916607 +0000 UTC m=+42.220331677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-qxbk5" (UID: "7682cb80-12da-47d5-9ecf-9dbe7ae8d862") : secret "samples-operator-tls" not found
Jul 30 19:39:55.580360 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.580025    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 19:39:55.580360 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.580040    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-688f467c-w8dhs: secret "image-registry-tls" not found
Jul 30 19:39:55.580360 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.580088    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls podName:5c61ae08-b999-49da-b893-8795ad8e7b0d nodeName:}" failed. No retries permitted until 2026-07-30 19:39:59.580072438 +0000 UTC m=+42.220487509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls") pod "image-registry-688f467c-w8dhs" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d") : secret "image-registry-tls" not found
Jul 30 19:39:55.681211 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:55.681178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:39:55.681363 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:55.681279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:55.681363 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:55.681325    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:55.681534 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.681514    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:59.681496711 +0000 UTC m=+42.321911772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : configmap references non-existent config key: service-ca.crt
Jul 30 19:39:55.681677 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.681592    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 19:39:55.681677 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.681656    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 19:39:55.681783 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.681741    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:59.681649091 +0000 UTC m=+42.322064162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : secret "router-metrics-certs-default" not found
Jul 30 19:39:55.681783 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.681764    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert podName:6e504161-83cf-456c-a22c-b931f7229f6b nodeName:}" failed. No retries permitted until 2026-07-30 19:39:59.681752138 +0000 UTC m=+42.322167211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-d6pb4" (UID: "6e504161-83cf-456c-a22c-b931f7229f6b") : secret "networking-console-plugin-cert" not found
Jul 30 19:39:55.782528 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:55.782485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:55.782705 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.782600    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 19:39:55.782705 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.782656    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls podName:883492c1-b9b3-4281-9928-4c3bc84bf805 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:59.782639463 +0000 UTC m=+42.423054538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls") pod "dns-default-74wzd" (UID: "883492c1-b9b3-4281-9928-4c3bc84bf805") : secret "dns-default-metrics-tls" not found
Jul 30 19:39:55.782803 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:55.782726    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:55.782853 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.782842    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 19:39:55.782911 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:55.782900    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls podName:ddfb3012-64c9-4a83-9a6f-c39b9e768cc4 nodeName:}" failed. No retries permitted until 2026-07-30 19:39:59.782870138 +0000 UTC m=+42.423285196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-hgm8k" (UID: "ddfb3012-64c9-4a83-9a6f-c39b9e768cc4") : secret "cluster-monitoring-operator-tls" not found
Jul 30 19:39:56.808005 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:56.807965    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:39:56.908350 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:56.908321    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:39:59.294348 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:59.294310    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:39:59.342319 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:59.342293    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:39:59.618592 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:59.618519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:39:59.618751 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:59.618667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:39:59.618751 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.618677    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 19:39:59.618751 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.618750    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls podName:7682cb80-12da-47d5-9ecf-9dbe7ae8d862 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.618730721 +0000 UTC m=+50.259145805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-qxbk5" (UID: "7682cb80-12da-47d5-9ecf-9dbe7ae8d862") : secret "samples-operator-tls" not found
Jul 30 19:39:59.618882 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.618807    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 19:39:59.618882 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.618820    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-688f467c-w8dhs: secret "image-registry-tls" not found
Jul 30 19:39:59.618882 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.618861    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls podName:5c61ae08-b999-49da-b893-8795ad8e7b0d nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.618848978 +0000 UTC m=+50.259264042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls") pod "image-registry-688f467c-w8dhs" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d") : secret "image-registry-tls" not found
Jul 30 19:39:59.719591 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:59.719551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:59.719763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:59.719614    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:39:59.719763 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.719731    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 19:39:59.719909 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.719803    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.719786831 +0000 UTC m=+50.360201916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : secret "router-metrics-certs-default" not found
Jul 30 19:39:59.719909 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.719837    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.719826121 +0000 UTC m=+50.360241180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : configmap references non-existent config key: service-ca.crt
Jul 30 19:39:59.720019 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:59.719981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:39:59.720162 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.720137    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 19:39:59.720295 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.720199    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert podName:6e504161-83cf-456c-a22c-b931f7229f6b nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.720183438 +0000 UTC m=+50.360598502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-d6pb4" (UID: "6e504161-83cf-456c-a22c-b931f7229f6b") : secret "networking-console-plugin-cert" not found
Jul 30 19:39:59.821013 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:59.820986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:39:59.821165 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:39:59.821027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:39:59.821165 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.821083    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 19:39:59.821165 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.821145    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls podName:ddfb3012-64c9-4a83-9a6f-c39b9e768cc4 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.821125856 +0000 UTC m=+50.461540914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-hgm8k" (UID: "ddfb3012-64c9-4a83-9a6f-c39b9e768cc4") : secret "cluster-monitoring-operator-tls" not found
Jul 30 19:39:59.821269 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.821179    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 19:39:59.821269 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:39:59.821237    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls podName:883492c1-b9b3-4281-9928-4c3bc84bf805 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.821222427 +0000 UTC m=+50.461637486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls") pod "dns-default-74wzd" (UID: "883492c1-b9b3-4281-9928-4c3bc84bf805") : secret "dns-default-metrics-tls" not found
Jul 30 19:40:01.730855 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:01.730807    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:01.831312 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:01.831264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:02.712208 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:02.712175    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:03.048097 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.048053    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:03.062354 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.062005    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fftjg" event={"ID":"059ae0e7-1f8f-4604-ac8e-408810ec9693","Type":"ContainerStarted","Data":"81dae83f68a6fd551d49972636534baae720efeacf8beb5d956c80f4bc15d4d4"}
Jul 30 19:40:03.063729 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.063704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq" event={"ID":"f41539d0-5113-4e86-a7e3-9ebff9ee5631","Type":"ContainerStarted","Data":"98c4da50929f6614590d53550f18eb1c32ef277a126254a1cd95f44e78ff320e"}
Jul 30 19:40:03.066703 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.066679    2561 generic.go:356] "Generic (PLEG): container finished" podID="88042802-62d0-4a1d-97f9-6471afa98d05" containerID="ec13054ed4edf352ac9ab600d0d14cc2db890456b6a775a262d245c0bd03e898" exitCode=0
Jul 30 19:40:03.066813 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.066762    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tp65" event={"ID":"88042802-62d0-4a1d-97f9-6471afa98d05","Type":"ContainerDied","Data":"ec13054ed4edf352ac9ab600d0d14cc2db890456b6a775a262d245c0bd03e898"}
Jul 30 19:40:03.068802 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.068742    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rqlds" event={"ID":"07a83901-0254-4f62-be31-1d43d8ab70c4","Type":"ContainerStarted","Data":"2fb4612d3f866cdd15eb5e5b469db5aa7dd90ec0f27c7e40a226e330bc23d18b"}
Jul 30 19:40:03.070465 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.070445    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt" event={"ID":"967aac46-da82-4cda-ab62-bf9e6715f85b","Type":"ContainerStarted","Data":"b0f64ea254326e85073815b440737ddcaa41e5b5453b252a853148845eb2c86b"}
Jul 30 19:40:03.072097 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.072075    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm" event={"ID":"c07eb7f6-b249-4a53-96ec-055a46e4330c","Type":"ContainerStarted","Data":"ec570e852e8bb5df6fbcb083d5b0e6876be6b6bf009361b1f20604bbf29ef520"}
Jul 30 19:40:03.073990 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.073675    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz" event={"ID":"209c514e-4f86-4faf-919b-551402c28e8c","Type":"ContainerStarted","Data":"41730cc3c5bc73d88b9e34512af71cb4a2142472e49dc2d31d8a5c551631d7b4"}
Jul 30 19:40:03.076148 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.076128    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/0.log"
Jul 30 19:40:03.076230 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.076168    2561 generic.go:356] "Generic (PLEG): container finished" podID="17e8b2b9-1baf-4271-9291-5820bfc1d24e" containerID="e133863c748e4483d9adbf249355e3ab618ff3d2443ec208d07cf023e1d9d8a8" exitCode=255
Jul 30 19:40:03.076230 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.076196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" event={"ID":"17e8b2b9-1baf-4271-9291-5820bfc1d24e","Type":"ContainerDied","Data":"e133863c748e4483d9adbf249355e3ab618ff3d2443ec208d07cf023e1d9d8a8"}
Jul 30 19:40:03.076424 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.076403    2561 scope.go:117] "RemoveContainer" containerID="e133863c748e4483d9adbf249355e3ab618ff3d2443ec208d07cf023e1d9d8a8"
Jul 30 19:40:03.079327 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.078627    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fftjg" podStartSLOduration=2.408589024 podStartE2EDuration="12.078594503s" totalImagesPullingTime="9.670005479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:03.078348845 +0000 UTC m=+45.718763926" watchObservedRunningTime="2026-07-30 19:40:03.078594503 +0000 UTC m=+45.719009586"
Jul 30 19:40:03.096112 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.094505    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt" podStartSLOduration=5.31675355 podStartE2EDuration="15.094489775s" totalImagesPullingTime="9.777736225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:03.094460045 +0000 UTC m=+45.734875119" watchObservedRunningTime="2026-07-30 19:40:03.094489775 +0000 UTC m=+45.734904835"
Jul 30 19:40:03.115101 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.115063    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-rqlds" podStartSLOduration=5.331315517 podStartE2EDuration="15.115035602s" totalImagesPullingTime="9.783720085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:03.114399275 +0000 UTC m=+45.754814356" watchObservedRunningTime="2026-07-30 19:40:03.115035602 +0000 UTC m=+45.755450688"
Jul 30 19:40:03.174751 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.174691    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-prwbz" podStartSLOduration=5.393028187 podStartE2EDuration="15.174672947s" totalImagesPullingTime="9.78164476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:03.152848806 +0000 UTC m=+45.793263888" watchObservedRunningTime="2026-07-30 19:40:03.174672947 +0000 UTC m=+45.815088029"
Jul 30 19:40:03.175976 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.175926    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm" podStartSLOduration=5.436018744 podStartE2EDuration="15.175878247s" totalImagesPullingTime="9.739859503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:03.174393223 +0000 UTC m=+45.814808305" watchObservedRunningTime="2026-07-30 19:40:03.175878247 +0000 UTC m=+45.816293332"
Jul 30 19:40:03.195070 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.194995    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-c65pq" podStartSLOduration=5.4858552 podStartE2EDuration="15.19498243s" totalImagesPullingTime="9.70912723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:03.193657736 +0000 UTC m=+45.834072817" watchObservedRunningTime="2026-07-30 19:40:03.19498243 +0000 UTC m=+45.835397510"
Jul 30 19:40:03.256630 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.256542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:03.473581 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.473545    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:03.537098 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.537051    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:03.594037 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.593966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:03.681387 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.681359    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:03.773862 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.773831    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:03.930278 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.930248    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zf89s"]
Jul 30 19:40:03.952423 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.952394    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zf89s"]
Jul 30 19:40:03.952572 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.952559    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:03.955258 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.955234    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 19:40:03.955390 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.955259    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 19:40:03.955390 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:03.955284    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gccm8\""
Jul 30 19:40:04.059031 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.059001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.059031 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.059030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pj5s\" (UniqueName: \"kubernetes.io/projected/449696b7-b408-455a-8070-ee0b669b5925-kube-api-access-5pj5s\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.059357 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.059172    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/449696b7-b408-455a-8070-ee0b669b5925-data-volume\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.059357 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.059218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/449696b7-b408-455a-8070-ee0b669b5925-crio-socket\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.059357 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.059262    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.062150 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.062112    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:04.084966 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.084943    2561 generic.go:356] "Generic (PLEG): container finished" podID="88042802-62d0-4a1d-97f9-6471afa98d05" containerID="d644827f596aad8f8f5a1cac3246cadf364107884fdadffdc531ece4ae5494f4" exitCode=0
Jul 30 19:40:04.085062 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.085030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tp65" event={"ID":"88042802-62d0-4a1d-97f9-6471afa98d05","Type":"ContainerDied","Data":"d644827f596aad8f8f5a1cac3246cadf364107884fdadffdc531ece4ae5494f4"}
Jul 30 19:40:04.086738 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.086722    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/1.log"
Jul 30 19:40:04.087116 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.087101    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/0.log"
Jul 30 19:40:04.087194 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.087131    2561 generic.go:356] "Generic (PLEG): container finished" podID="17e8b2b9-1baf-4271-9291-5820bfc1d24e" containerID="5d027d726742fc88239df02cdbe787a477443905e3352b030bd45b12a9d281b7" exitCode=255
Jul 30 19:40:04.087247 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.087199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" event={"ID":"17e8b2b9-1baf-4271-9291-5820bfc1d24e","Type":"ContainerDied","Data":"5d027d726742fc88239df02cdbe787a477443905e3352b030bd45b12a9d281b7"}
Jul 30 19:40:04.087247 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.087235    2561 scope.go:117] "RemoveContainer" containerID="e133863c748e4483d9adbf249355e3ab618ff3d2443ec208d07cf023e1d9d8a8"
Jul 30 19:40:04.087435 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.087416    2561 scope.go:117] "RemoveContainer" containerID="5d027d726742fc88239df02cdbe787a477443905e3352b030bd45b12a9d281b7"
Jul 30 19:40:04.087591 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:04.087571    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fcfsk_openshift-console-operator(17e8b2b9-1baf-4271-9291-5820bfc1d24e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" podUID="17e8b2b9-1baf-4271-9291-5820bfc1d24e"
Jul 30 19:40:04.128206 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.128185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.159970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/449696b7-b408-455a-8070-ee0b669b5925-data-volume\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.160088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/449696b7-b408-455a-8070-ee0b669b5925-crio-socket\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.160177    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.160257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.160300    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pj5s\" (UniqueName: \"kubernetes.io/projected/449696b7-b408-455a-8070-ee0b669b5925-kube-api-access-5pj5s\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.160317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/449696b7-b408-455a-8070-ee0b669b5925-data-volume\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:04.160453    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:04.160469    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:04.160516    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm podName:449696b7-b408-455a-8070-ee0b669b5925 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:04.66049683 +0000 UTC m=+47.300911893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zf89s" (UID: "449696b7-b408-455a-8070-ee0b669b5925") : configmap "kube-rbac-proxy" not found
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:04.160536    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls podName:449696b7-b408-455a-8070-ee0b669b5925 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:04.660526159 +0000 UTC m=+47.300941216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zf89s" (UID: "449696b7-b408-455a-8070-ee0b669b5925") : secret "insights-runtime-extractor-tls" not found
Jul 30 19:40:04.161493 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.160691    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/449696b7-b408-455a-8070-ee0b669b5925-crio-socket\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.172131 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.172110    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pj5s\" (UniqueName: \"kubernetes.io/projected/449696b7-b408-455a-8070-ee0b669b5925-kube-api-access-5pj5s\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.388154 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.388131    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:04.488774 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.488718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:04.664139 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.664108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.664257 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:04.664153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:04.664257 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:04.664243    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 19:40:04.664372 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:04.664276    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 19:40:04.664372 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:04.664305    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls podName:449696b7-b408-455a-8070-ee0b669b5925 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:05.664288918 +0000 UTC m=+48.304703992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zf89s" (UID: "449696b7-b408-455a-8070-ee0b669b5925") : secret "insights-runtime-extractor-tls" not found
Jul 30 19:40:04.664372 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:04.664320    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm podName:449696b7-b408-455a-8070-ee0b669b5925 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:05.664313307 +0000 UTC m=+48.304728365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zf89s" (UID: "449696b7-b408-455a-8070-ee0b669b5925") : configmap "kube-rbac-proxy" not found
Jul 30 19:40:05.093786 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:05.093758    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/1.log"
Jul 30 19:40:05.094217 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:05.094148    2561 scope.go:117] "RemoveContainer" containerID="5d027d726742fc88239df02cdbe787a477443905e3352b030bd45b12a9d281b7"
Jul 30 19:40:05.094336 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:05.094311    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fcfsk_openshift-console-operator(17e8b2b9-1baf-4271-9291-5820bfc1d24e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" podUID="17e8b2b9-1baf-4271-9291-5820bfc1d24e"
Jul 30 19:40:05.097123 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:05.097097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tp65" event={"ID":"88042802-62d0-4a1d-97f9-6471afa98d05","Type":"ContainerStarted","Data":"81361bd6cc92818fceb5b554654cc917d3b1f13cfcee39cef0cff031418096a5"}
Jul 30 19:40:05.132411 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:05.132358    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4tp65" podStartSLOduration=9.139922881 podStartE2EDuration="47.132345306s" totalImagesPullingTime="37.992422425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:05.131002552 +0000 UTC m=+47.771417646" watchObservedRunningTime="2026-07-30 19:40:05.132345306 +0000 UTC m=+47.772760385"
Jul 30 19:40:05.252209 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:05.252183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:05.352473 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:05.352412    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:05.671948 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:05.671926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:05.672041 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:05.671971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:05.672082 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:05.672046    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 19:40:05.672082 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:05.672065    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 19:40:05.672146 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:05.672122    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls podName:449696b7-b408-455a-8070-ee0b669b5925 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.672106389 +0000 UTC m=+50.312521453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zf89s" (UID: "449696b7-b408-455a-8070-ee0b669b5925") : secret "insights-runtime-extractor-tls" not found
Jul 30 19:40:05.672146 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:05.672139    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm podName:449696b7-b408-455a-8070-ee0b669b5925 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:07.672131022 +0000 UTC m=+50.312546080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zf89s" (UID: "449696b7-b408-455a-8070-ee0b669b5925") : configmap "kube-rbac-proxy" not found
Jul 30 19:40:06.022770 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:06.022712    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:06.071970 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:06.071947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:06.107400 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:06.107381    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-968bf_66d5706a-702f-4e2f-a517-683598ce3f44/dns-node-resolver/0.log"
Jul 30 19:40:06.889923 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:06.889866    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:07.508871 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.508846    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q4bfz_dc9e19c5-f02f-4948-989d-f3a1f4cd28fe/node-ca/0.log"
Jul 30 19:40:07.556803 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.556781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:07.687228 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.687204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:40:07.687321 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.687260    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:07.687321 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.687290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:07.687321 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.687318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:40:07.687471 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.687349    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 19:40:07.687471 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.687364    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-688f467c-w8dhs: secret "image-registry-tls" not found
Jul 30 19:40:07.687471 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.687423    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls podName:5c61ae08-b999-49da-b893-8795ad8e7b0d nodeName:}" failed. No retries permitted until 2026-07-30 19:40:23.687409769 +0000 UTC m=+66.327824831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls") pod "image-registry-688f467c-w8dhs" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d") : secret "image-registry-tls" not found
Jul 30 19:40:07.687471 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.687434    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 19:40:07.687471 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.687445    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 19:40:07.687655 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.687499    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls podName:7682cb80-12da-47d5-9ecf-9dbe7ae8d862 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:23.687484967 +0000 UTC m=+66.327900025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-qxbk5" (UID: "7682cb80-12da-47d5-9ecf-9dbe7ae8d862") : secret "samples-operator-tls" not found
Jul 30 19:40:07.687655 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.687517    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls podName:449696b7-b408-455a-8070-ee0b669b5925 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:11.68750763 +0000 UTC m=+54.327922688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zf89s" (UID: "449696b7-b408-455a-8070-ee0b669b5925") : secret "insights-runtime-extractor-tls" not found
Jul 30 19:40:07.687806 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.687790    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/449696b7-b408-455a-8070-ee0b669b5925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:07.788148 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.788105    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:07.788148 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.788143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:07.788307 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.788206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:40:07.788307 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.788242    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 19:40:07.788307 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.788298    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:23.788282577 +0000 UTC m=+66.428697652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : secret "router-metrics-certs-default" not found
Jul 30 19:40:07.788307 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.788302    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 19:40:07.788508 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.788319    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle podName:20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:23.788307377 +0000 UTC m=+66.428722436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle") pod "router-default-86c87c77cd-zw8kz" (UID: "20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7") : configmap references non-existent config key: service-ca.crt
Jul 30 19:40:07.788508 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.788340    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert podName:6e504161-83cf-456c-a22c-b931f7229f6b nodeName:}" failed. No retries permitted until 2026-07-30 19:40:23.78833308 +0000 UTC m=+66.428748138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-d6pb4" (UID: "6e504161-83cf-456c-a22c-b931f7229f6b") : secret "networking-console-plugin-cert" not found
Jul 30 19:40:07.811691 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.811669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:07.878482 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.878463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:07.888504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.888481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:40:07.888630 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:07.888514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:40:07.888630 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.888578    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 19:40:07.888630 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.888582    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 19:40:07.888630 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.888619    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls podName:ddfb3012-64c9-4a83-9a6f-c39b9e768cc4 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:23.888607576 +0000 UTC m=+66.529022642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-hgm8k" (UID: "ddfb3012-64c9-4a83-9a6f-c39b9e768cc4") : secret "cluster-monitoring-operator-tls" not found
Jul 30 19:40:07.888798 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:07.888634    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls podName:883492c1-b9b3-4281-9928-4c3bc84bf805 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:23.888626761 +0000 UTC m=+66.529041819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls") pod "dns-default-74wzd" (UID: "883492c1-b9b3-4281-9928-4c3bc84bf805") : secret "dns-default-metrics-tls" not found
Jul 30 19:40:08.109377 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:08.109334    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fftjg_059ae0e7-1f8f-4604-ac8e-408810ec9693/serve-healthcheck-canary/0.log"
Jul 30 19:40:08.709878 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:08.709844    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-j5vtm_c07eb7f6-b249-4a53-96ec-055a46e4330c/kube-storage-version-migrator-operator/0.log"
Jul 30 19:40:09.318442 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:09.318407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:09.419058 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:09.419026    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:09.519734 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:09.519701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:10.810532 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:10.810494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:11.088549 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:11.088466    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:11.187472 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:11.187444    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:11.288602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:11.288575    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:11.389070 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:11.389043    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:11.437451 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:11.437424    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:11.506091 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:11.506061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:11.722312 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:11.722254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:11.722430 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:11.722411    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 19:40:11.722503 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:11.722476    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls podName:449696b7-b408-455a-8070-ee0b669b5925 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:19.722461404 +0000 UTC m=+62.362876461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zf89s" (UID: "449696b7-b408-455a-8070-ee0b669b5925") : secret "insights-runtime-extractor-tls" not found
Jul 30 19:40:12.265748 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:12.265711    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:40:12.266153 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:12.265774    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:40:12.266153 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:12.266100    2561 scope.go:117] "RemoveContainer" containerID="5d027d726742fc88239df02cdbe787a477443905e3352b030bd45b12a9d281b7"
Jul 30 19:40:12.266258 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:12.266238    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fcfsk_openshift-console-operator(17e8b2b9-1baf-4271-9291-5820bfc1d24e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" podUID="17e8b2b9-1baf-4271-9291-5820bfc1d24e"
Jul 30 19:40:12.308870 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:12.308840    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:12.724805 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:12.724774    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:13.110760 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:13.110684    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:13.308874 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:13.308842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:13.665031 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:13.665001    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:13.914180 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:13.914157    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:14.107797 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:14.107729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:14.305572 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:14.305538    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:14.508165 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:14.508130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:14.803613 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:14.803545    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:15.311642 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:15.311605    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:15.708807 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:15.708781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:15.758551 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:15.758529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:15.902580 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:15.902531    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:16.110606 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:16.110551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:16.307623 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:16.307599    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:17.504997 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:17.504957    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:17.705587 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:17.705556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:17.909311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:17.909275    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:18.017720 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:18.017698    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ld8sn"
Jul 30 19:40:18.082059 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:18.082025    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:18.136439 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:18.136411    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:18.314733 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:18.314677    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:19.305796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:19.305760    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:19.512964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:19.512931    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:19.786992 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:19.786955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:19.789434 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:19.789415    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/449696b7-b408-455a-8070-ee0b669b5925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zf89s\" (UID: \"449696b7-b408-455a-8070-ee0b669b5925\") " pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:19.864985 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:19.864963    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gccm8\""
Jul 30 19:40:19.872762 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:19.872743    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zf89s"
Jul 30 19:40:19.905949 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:19.905928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:19.993650 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:19.993613    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zf89s"]
Jul 30 19:40:19.998066 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:40:19.998038    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449696b7_b408_455a_8070_ee0b669b5925.slice/crio-b20689eeb09dc6cb4009d8b651f3050f72f83cf461201c48a3a3dfde2435fa76 WatchSource:0}: Error finding container b20689eeb09dc6cb4009d8b651f3050f72f83cf461201c48a3a3dfde2435fa76: Status 404 returned error can't find the container with id b20689eeb09dc6cb4009d8b651f3050f72f83cf461201c48a3a3dfde2435fa76
Jul 30 19:40:20.103616 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:20.103589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:20.142677 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:20.142654    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zf89s" event={"ID":"449696b7-b408-455a-8070-ee0b669b5925","Type":"ContainerStarted","Data":"52ff50350cb692f682dc05082a98166867fea88d297a010b9ffeb9e7dfa08005"}
Jul 30 19:40:20.142767 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:20.142707    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zf89s" event={"ID":"449696b7-b408-455a-8070-ee0b669b5925","Type":"ContainerStarted","Data":"b20689eeb09dc6cb4009d8b651f3050f72f83cf461201c48a3a3dfde2435fa76"}
Jul 30 19:40:20.506740 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:20.506718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:21.107336 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:21.107252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:21.147652 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:21.147619    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zf89s" event={"ID":"449696b7-b408-455a-8070-ee0b669b5925","Type":"ContainerStarted","Data":"1ef8563fc7469e489e290519fc1c1fd7b0b16a954c495f1a28333e424cf11d0f"}
Jul 30 19:40:21.311578 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:21.311553    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:21.506651 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:21.506628    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:22.813588 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:22.813522    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:22.865506 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:22.865479    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:23.155700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.155677    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zf89s" event={"ID":"449696b7-b408-455a-8070-ee0b669b5925","Type":"ContainerStarted","Data":"3b8a7c6f33be37dcecaad768bd6e9cfecfa77d004cdbb351de503d58b1985ef5"}
Jul 30 19:40:23.174607 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.174568    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zf89s" podStartSLOduration=17.829439405 podStartE2EDuration="20.174553823s" totalImagesPullingTime="2.345114418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:40:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:23.17454462 +0000 UTC m=+65.814959701" watchObservedRunningTime="2026-07-30 19:40:23.174553823 +0000 UTC m=+65.814968903"
Jul 30 19:40:23.722208 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.722176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:40:23.722314 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.722261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:40:23.722314 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.722297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:40:23.722393 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.722375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:40:23.724776 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.724750    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") pod \"image-registry-688f467c-w8dhs\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") " pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:40:23.724861 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.724790    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7682cb80-12da-47d5-9ecf-9dbe7ae8d862-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-qxbk5\" (UID: \"7682cb80-12da-47d5-9ecf-9dbe7ae8d862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:40:23.725236 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.725209    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 19:40:23.725336 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.725241    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 19:40:23.734481 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.734452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02b82ed8-8246-442b-b355-1c07f8c70acc-metrics-certs\") pod \"network-metrics-daemon-bsfvg\" (UID: \"02b82ed8-8246-442b-b355-1c07f8c70acc\") " pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:40:23.734558 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.734509    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b118d49-f09f-41b4-8960-189b923082f0-original-pull-secret\") pod \"global-pull-secret-syncer-7gqnk\" (UID: \"8b118d49-f09f-41b4-8960-189b923082f0\") " pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:40:23.823277 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.823246    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:23.823277 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.823285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:23.823712 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.823331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72vz4\" (UniqueName: \"kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4\") pod \"network-check-target-qv5ss\" (UID: \"c5a2be49-dba4-4ba3-b11c-26710086017c\") " pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:40:23.823712 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.823349    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:40:23.824062 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.824036    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-service-ca-bundle\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:23.825707 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.825682    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72vz4\" (UniqueName: \"kubernetes.io/projected/c5a2be49-dba4-4ba3-b11c-26710086017c-kube-api-access-72vz4\") pod \"network-check-target-qv5ss\" (UID: \"c5a2be49-dba4-4ba3-b11c-26710086017c\") " pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:40:23.825771 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.825685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e504161-83cf-456c-a22c-b931f7229f6b-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6pb4\" (UID: \"6e504161-83cf-456c-a22c-b931f7229f6b\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:40:23.825808 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.825774    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7-metrics-certs\") pod \"router-default-86c87c77cd-zw8kz\" (UID: \"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7\") " pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:23.834923 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.834880    2561 scope.go:117] "RemoveContainer" containerID="5d027d726742fc88239df02cdbe787a477443905e3352b030bd45b12a9d281b7"
Jul 30 19:40:23.922045 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.922020    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2dgvw\""
Jul 30 19:40:23.924231 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.924217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:40:23.924408 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.924341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:40:23.926958 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.926933    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/883492c1-b9b3-4281-9928-4c3bc84bf805-metrics-tls\") pod \"dns-default-74wzd\" (UID: \"883492c1-b9b3-4281-9928-4c3bc84bf805\") " pod="openshift-dns/dns-default-74wzd"
Jul 30 19:40:23.927050 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.927018    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddfb3012-64c9-4a83-9a6f-c39b9e768cc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-hgm8k\" (UID: \"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:40:23.929795 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.929771    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:40:23.936063 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.936043    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zv7z8\""
Jul 30 19:40:23.943707 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.943691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"
Jul 30 19:40:23.962812 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.962789    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p96kd\""
Jul 30 19:40:23.966056 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.966042    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gqnk"
Jul 30 19:40:23.970730 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:23.970711    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsfvg"
Jul 30 19:40:24.019838 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.019814    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x4t8n\""
Jul 30 19:40:24.027982 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.027936    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:24.050857 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.048274    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chvmd\""
Jul 30 19:40:24.054285 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.053988    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:40:24.067915 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.066341    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f4zw8\""
Jul 30 19:40:24.073860 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.073668    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"
Jul 30 19:40:24.082060 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.082037    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d6dks\""
Jul 30 19:40:24.089944 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.089919    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"
Jul 30 19:40:24.091081 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.090832    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-688f467c-w8dhs"]
Jul 30 19:40:24.101030 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.101005    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj98q\""
Jul 30 19:40:24.111177 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.108556    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-74wzd"
Jul 30 19:40:24.122522 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.119274    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5"]
Jul 30 19:40:24.164406 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.163325    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:40:24.171012 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.167433    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/1.log"
Jul 30 19:40:24.171012 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.167469    2561 generic.go:356] "Generic (PLEG): container finished" podID="17e8b2b9-1baf-4271-9291-5820bfc1d24e" containerID="7477cecbb1563bf6d75cacbcde641c93e1b6929f643fa31624550a44b09bbaff" exitCode=255
Jul 30 19:40:24.171012 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.167553    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" event={"ID":"17e8b2b9-1baf-4271-9291-5820bfc1d24e","Type":"ContainerDied","Data":"7477cecbb1563bf6d75cacbcde641c93e1b6929f643fa31624550a44b09bbaff"}
Jul 30 19:40:24.171012 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.167607    2561 scope.go:117] "RemoveContainer" containerID="5d027d726742fc88239df02cdbe787a477443905e3352b030bd45b12a9d281b7"
Jul 30 19:40:24.171012 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.170929    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7gqnk"]
Jul 30 19:40:24.172600 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.172536    2561 scope.go:117] "RemoveContainer" containerID="7477cecbb1563bf6d75cacbcde641c93e1b6929f643fa31624550a44b09bbaff"
Jul 30 19:40:24.176753 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:24.175820    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fcfsk_openshift-console-operator(17e8b2b9-1baf-4271-9291-5820bfc1d24e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" podUID="17e8b2b9-1baf-4271-9291-5820bfc1d24e"
Jul 30 19:40:24.177630 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.177476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-688f467c-w8dhs" event={"ID":"5c61ae08-b999-49da-b893-8795ad8e7b0d","Type":"ContainerStarted","Data":"e84dbde0d6732903786c07e8918dba899ab8108fb78eaf886eee8870cfe21817"}
Jul 30 19:40:24.212251 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.211845    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bsfvg"]
Jul 30 19:40:24.258197 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.257934    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86c87c77cd-zw8kz"]
Jul 30 19:40:24.259143 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:40:24.259112    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fbe8bf_fa0b_4233_b844_52ae5b5a4ee7.slice/crio-dcee49da3fbde97a7e57eb6db9d56a707b236b7b3e8f01356046f7b4cf44a296 WatchSource:0}: Error finding container dcee49da3fbde97a7e57eb6db9d56a707b236b7b3e8f01356046f7b4cf44a296: Status 404 returned error can't find the container with id dcee49da3fbde97a7e57eb6db9d56a707b236b7b3e8f01356046f7b4cf44a296
Jul 30 19:40:24.289756 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.289685    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qv5ss"]
Jul 30 19:40:24.294527 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:40:24.294496    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a2be49_dba4_4ba3_b11c_26710086017c.slice/crio-d7c017876da9e2b022ab41fc4c14dd4fd4dba2fa1dfce1661be9c5d7410638f8 WatchSource:0}: Error finding container d7c017876da9e2b022ab41fc4c14dd4fd4dba2fa1dfce1661be9c5d7410638f8: Status 404 returned error can't find the container with id d7c017876da9e2b022ab41fc4c14dd4fd4dba2fa1dfce1661be9c5d7410638f8
Jul 30 19:40:24.304727 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.304664    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4"]
Jul 30 19:40:24.353483 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.353449    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k"]
Jul 30 19:40:24.355910 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:40:24.355864    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfb3012_64c9_4a83_9a6f_c39b9e768cc4.slice/crio-d29f7a88ce4a141a893d21d0e80e7b0b96b2d0596e32bf54129e0e989f6d3928 WatchSource:0}: Error finding container d29f7a88ce4a141a893d21d0e80e7b0b96b2d0596e32bf54129e0e989f6d3928: Status 404 returned error can't find the container with id d29f7a88ce4a141a893d21d0e80e7b0b96b2d0596e32bf54129e0e989f6d3928
Jul 30 19:40:24.376226 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:24.373027    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-74wzd"]
Jul 30 19:40:25.185874 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.185782    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k" event={"ID":"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4","Type":"ContainerStarted","Data":"d29f7a88ce4a141a893d21d0e80e7b0b96b2d0596e32bf54129e0e989f6d3928"}
Jul 30 19:40:25.189285 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.189250    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4" event={"ID":"6e504161-83cf-456c-a22c-b931f7229f6b","Type":"ContainerStarted","Data":"392c209a42c9da64a6634b0e41bad256e5f3163a559d4dc5a0e9dc4c97c10052"}
Jul 30 19:40:25.191795 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.191760    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qv5ss" event={"ID":"c5a2be49-dba4-4ba3-b11c-26710086017c","Type":"ContainerStarted","Data":"d8aeccb0f1b3db5f1c5de48208f1b8d2a9bc823a63ac010af06ccecf2cc469bb"}
Jul 30 19:40:25.191925 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.191807    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qv5ss" event={"ID":"c5a2be49-dba4-4ba3-b11c-26710086017c","Type":"ContainerStarted","Data":"d7c017876da9e2b022ab41fc4c14dd4fd4dba2fa1dfce1661be9c5d7410638f8"}
Jul 30 19:40:25.192296 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.192276    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:40:25.195035 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.195007    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bsfvg" event={"ID":"02b82ed8-8246-442b-b355-1c07f8c70acc","Type":"ContainerStarted","Data":"6274136e7f847e9343b6a715b695af82d1477352c741a68099bb24364e49d0bc"}
Jul 30 19:40:25.201284 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.201179    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:40:25.206066 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.205477    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-688f467c-w8dhs" event={"ID":"5c61ae08-b999-49da-b893-8795ad8e7b0d","Type":"ContainerStarted","Data":"8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d"}
Jul 30 19:40:25.206066 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.206014    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:40:25.210274 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.209758    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qv5ss" podStartSLOduration=67.20974267 podStartE2EDuration="1m7.20974267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:25.208380555 +0000 UTC m=+67.848795636" watchObservedRunningTime="2026-07-30 19:40:25.20974267 +0000 UTC m=+67.850157752"
Jul 30 19:40:25.210376 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.210318    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74wzd" event={"ID":"883492c1-b9b3-4281-9928-4c3bc84bf805","Type":"ContainerStarted","Data":"79d1b8ef04f17a6b975df909a9bacbffaf97c1dd143e56d100d39cd888f455e1"}
Jul 30 19:40:25.215069 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.215043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86c87c77cd-zw8kz" event={"ID":"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7","Type":"ContainerStarted","Data":"f9f78fd45fe999df19de05a34b4bb0f46b812478511327683c78bc576e73be4c"}
Jul 30 19:40:25.215164 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.215091    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86c87c77cd-zw8kz" event={"ID":"20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7","Type":"ContainerStarted","Data":"dcee49da3fbde97a7e57eb6db9d56a707b236b7b3e8f01356046f7b4cf44a296"}
Jul 30 19:40:25.217704 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.217677    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7gqnk" event={"ID":"8b118d49-f09f-41b4-8960-189b923082f0","Type":"ContainerStarted","Data":"d98668ad9ade06636cea06b85c402beb12b6d1f35b2ecfbd90f0e49f414aff4d"}
Jul 30 19:40:25.221967 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.221912    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5" event={"ID":"7682cb80-12da-47d5-9ecf-9dbe7ae8d862","Type":"ContainerStarted","Data":"48621c2ea4043da7eabd60723fe591364f5db6f5d2340c197b1e6fb4134e15a1"}
Jul 30 19:40:25.229037 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.228089    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-688f467c-w8dhs" podStartSLOduration=67.228072067 podStartE2EDuration="1m7.228072067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:25.227672148 +0000 UTC m=+67.868087229" watchObservedRunningTime="2026-07-30 19:40:25.228072067 +0000 UTC m=+67.868487149"
Jul 30 19:40:25.247899 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:25.247395    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-86c87c77cd-zw8kz" podStartSLOduration=37.247379118 podStartE2EDuration="37.247379118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:25.245914813 +0000 UTC m=+67.886329892" watchObservedRunningTime="2026-07-30 19:40:25.247379118 +0000 UTC m=+67.887794200"
Jul 30 19:40:26.028547 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:26.028471    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:26.031764 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:26.031688    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:26.227862 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:26.227803    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:26.229274 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:26.229251    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86c87c77cd-zw8kz"
Jul 30 19:40:27.412134 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:27.412106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:27.517615 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:27.517583    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:27.594635 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:27.594551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:27.660162 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:27.660127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:30.196810 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.196779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:30.245592 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.245527    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7gqnk" event={"ID":"8b118d49-f09f-41b4-8960-189b923082f0","Type":"ContainerStarted","Data":"b3fba8d4b7a27244d6478f62f8b9bb33785954aba5961519361a421e7748567e"}
Jul 30 19:40:30.247336 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.247304    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5" event={"ID":"7682cb80-12da-47d5-9ecf-9dbe7ae8d862","Type":"ContainerStarted","Data":"3598f28f8a07e00d84302525646b3e6be7ae0b8bc9dadc85a5059c75733b994d"}
Jul 30 19:40:30.247467 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.247358    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5" event={"ID":"7682cb80-12da-47d5-9ecf-9dbe7ae8d862","Type":"ContainerStarted","Data":"c09b5e3cb140f1ffe5904766fb152a5206682373849488d3ffe7f7db37ba4317"}
Jul 30 19:40:30.248920 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.248879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k" event={"ID":"ddfb3012-64c9-4a83-9a6f-c39b9e768cc4","Type":"ContainerStarted","Data":"f9b7189959104fc82a567c1b9a2d5b1a3ff68b91993da8dffd5eb42614fdc3d4"}
Jul 30 19:40:30.250338 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.250313    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4" event={"ID":"6e504161-83cf-456c-a22c-b931f7229f6b","Type":"ContainerStarted","Data":"7d24a6d0f6a0e82bbab147c7658f04c60a618de1f1864cad2f42f62b1934b269"}
Jul 30 19:40:30.252142 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.252116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bsfvg" event={"ID":"02b82ed8-8246-442b-b355-1c07f8c70acc","Type":"ContainerStarted","Data":"e9307de9b4bb7c191fca2b5c84d49f7e740ee79ebba510e4bf8d3d3019f7a6e0"}
Jul 30 19:40:30.252242 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.252163    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bsfvg" event={"ID":"02b82ed8-8246-442b-b355-1c07f8c70acc","Type":"ContainerStarted","Data":"ef2e39296cd7f2bcae1d2bffc1ac7cfbcdec0e324577d90dece6627e5410b38e"}
Jul 30 19:40:30.253755 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.253725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74wzd" event={"ID":"883492c1-b9b3-4281-9928-4c3bc84bf805","Type":"ContainerStarted","Data":"c2a6904febf9edfe20565212d8fcd5a6939c9eeeb11052c1c49477b62f72d93b"}
Jul 30 19:40:30.253843 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.253772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74wzd" event={"ID":"883492c1-b9b3-4281-9928-4c3bc84bf805","Type":"ContainerStarted","Data":"be492e01df74b9bb2f62aef2a9174dc8b17ae4d2b31e0a3da6e4e4db961f2579"}
Jul 30 19:40:30.253921 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.253896    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-74wzd"
Jul 30 19:40:30.260222 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.260187    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7gqnk" podStartSLOduration=66.746238621 podStartE2EDuration="1m12.260175011s" totalImagesPullingTime="5.51393639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:30.259446811 +0000 UTC m=+72.899861891" watchObservedRunningTime="2026-07-30 19:40:30.260175011 +0000 UTC m=+72.900590069"
Jul 30 19:40:30.275096 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.275038    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-qxbk5" podStartSLOduration=36.825549795 podStartE2EDuration="42.275023449s" totalImagesPullingTime="5.449473654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:30.27455299 +0000 UTC m=+72.914968069" watchObservedRunningTime="2026-07-30 19:40:30.275023449 +0000 UTC m=+72.915438530"
Jul 30 19:40:30.314156 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.314114    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bsfvg" podStartSLOduration=67.222936658 podStartE2EDuration="1m12.314097937s" totalImagesPullingTime="5.091161279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:30.313434752 +0000 UTC m=+72.953849829" watchObservedRunningTime="2026-07-30 19:40:30.314097937 +0000 UTC m=+72.954513021"
Jul 30 19:40:30.314920 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.314872    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-74wzd" podStartSLOduration=33.997811401999996 podStartE2EDuration="39.314861343s" totalImagesPullingTime="5.317049941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:30.293232216 +0000 UTC m=+72.933647298" watchObservedRunningTime="2026-07-30 19:40:30.314861343 +0000 UTC m=+72.955276406"
Jul 30 19:40:30.333954 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.333914    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6pb4" podStartSLOduration=36.951582892 podStartE2EDuration="42.333902383s" totalImagesPullingTime="5.382319491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:30.333512424 +0000 UTC m=+72.973927505" watchObservedRunningTime="2026-07-30 19:40:30.333902383 +0000 UTC m=+72.974317454"
Jul 30 19:40:30.354436 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.354385    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-hgm8k" podStartSLOduration=36.998242789 podStartE2EDuration="42.35436856s" totalImagesPullingTime="5.356125771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:30.352977673 +0000 UTC m=+72.993392754" watchObservedRunningTime="2026-07-30 19:40:30.35436856 +0000 UTC m=+72.994783641"
Jul 30 19:40:30.393349 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.393326    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:30.393488 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.393472    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq"]
Jul 30 19:40:30.404076 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.404061    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq"
Jul 30 19:40:30.407064 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.407041    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 30 19:40:30.407166 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.407066    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5wqht\""
Jul 30 19:40:30.407601 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.407579    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq"]
Jul 30 19:40:30.480223 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.480199    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6bf8e845-73bd-441e-a535-a8931421dad6-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-4mrnq\" (UID: \"6bf8e845-73bd-441e-a535-a8931421dad6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq"
Jul 30 19:40:30.497852 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.497795    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:30.580614 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.580589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6bf8e845-73bd-441e-a535-a8931421dad6-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-4mrnq\" (UID: \"6bf8e845-73bd-441e-a535-a8931421dad6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq"
Jul 30 19:40:30.582760 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.582735    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6bf8e845-73bd-441e-a535-a8931421dad6-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-4mrnq\" (UID: \"6bf8e845-73bd-441e-a535-a8931421dad6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq"
Jul 30 19:40:30.598365 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.598347    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:30.647986 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.647964    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:30.715837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.715812    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq"
Jul 30 19:40:30.851949 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:30.851927    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq"]
Jul 30 19:40:30.854395 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:40:30.854371    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf8e845_73bd_441e_a535_a8931421dad6.slice/crio-6d937ccd7384b0ea6ad328329496eaeefc27730250b69c4d17ecf263d0605ad4 WatchSource:0}: Error finding container 6d937ccd7384b0ea6ad328329496eaeefc27730250b69c4d17ecf263d0605ad4: Status 404 returned error can't find the container with id 6d937ccd7384b0ea6ad328329496eaeefc27730250b69c4d17ecf263d0605ad4
Jul 30 19:40:31.258201 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:31.258166    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq" event={"ID":"6bf8e845-73bd-441e-a535-a8931421dad6","Type":"ContainerStarted","Data":"6d937ccd7384b0ea6ad328329496eaeefc27730250b69c4d17ecf263d0605ad4"}
Jul 30 19:40:32.265279 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:32.265258    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:40:32.265687 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:32.265306    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:40:32.265751 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:32.265684    2561 scope.go:117] "RemoveContainer" containerID="7477cecbb1563bf6d75cacbcde641c93e1b6929f643fa31624550a44b09bbaff"
Jul 30 19:40:32.265874 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:32.265853    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fcfsk_openshift-console-operator(17e8b2b9-1baf-4271-9291-5820bfc1d24e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" podUID="17e8b2b9-1baf-4271-9291-5820bfc1d24e"
Jul 30 19:40:33.218997 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:33.218961    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:33.267232 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:33.267198    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq" event={"ID":"6bf8e845-73bd-441e-a535-a8931421dad6","Type":"ContainerStarted","Data":"440dba8dbd10b9f1033f91dc25df5ab62c2a5398d7c096699931456c0d4ce94c"}
Jul 30 19:40:33.267588 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:33.267353    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq"
Jul 30 19:40:33.271869 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:33.271848    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq"
Jul 30 19:40:33.285003 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:33.284958    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-4mrnq" podStartSLOduration=1.893240993 podStartE2EDuration="3.284942742s" totalImagesPullingTime="1.391701749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:33.284511368 +0000 UTC m=+75.924926449" watchObservedRunningTime="2026-07-30 19:40:33.284942742 +0000 UTC m=+75.925357832"
Jul 30 19:40:33.288703 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:33.288667    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:33.372688 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:33.372644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:33.431895 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:33.431871    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:33.494417 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:33.494347    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:33.988998 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:33.988970    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:35.645465 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:35.645413    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:35.746861 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:35.746824    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:36.803480 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:36.803451    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:36.906166 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:36.906137    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:37.331694 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:37.331668    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:38.057409 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:38.057376    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:38.157135 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:38.157093    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:39.551929 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.551895    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:39.651332 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.651300    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:39.802643 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.802576    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:39.863738 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.863701    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5zfd4"]
Jul 30 19:40:39.868206 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.868186    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:39.871010 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.870969    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 19:40:39.871138 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.871011    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 19:40:39.871138 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.871093    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hgzkn\""
Jul 30 19:40:39.872341 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.872324    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 19:40:39.872482 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.872358    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 19:40:39.904045 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:39.904021    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:40.002075 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.002054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:40.049493 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.049469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-tls\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.049585 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.049497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtp2l\" (UniqueName: \"kubernetes.io/projected/8217d49b-b30f-485f-82f0-841ee2dd526d-kube-api-access-gtp2l\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.049585 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.049522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8217d49b-b30f-485f-82f0-841ee2dd526d-metrics-client-ca\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.049585 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.049550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.049685 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.049606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-textfile\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.049685 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.049636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.049685 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.049655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-wtmp\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.049777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.049685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8217d49b-b30f-485f-82f0-841ee2dd526d-root\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.049777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.049731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8217d49b-b30f-485f-82f0-841ee2dd526d-sys\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.104684 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.104624    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:40.150756 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.150846 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-textfile\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.150846 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.150846 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-wtmp\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.150846 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8217d49b-b30f-485f-82f0-841ee2dd526d-root\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.151084 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8217d49b-b30f-485f-82f0-841ee2dd526d-sys\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.151084 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-tls\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.151084 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtp2l\" (UniqueName: \"kubernetes.io/projected/8217d49b-b30f-485f-82f0-841ee2dd526d-kube-api-access-gtp2l\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.151084 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8217d49b-b30f-485f-82f0-841ee2dd526d-metrics-client-ca\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.151084 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150988    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8217d49b-b30f-485f-82f0-841ee2dd526d-sys\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.151084 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.151005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-wtmp\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.151084 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:40.151063    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 30 19:40:40.151522 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.151113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-textfile\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.151522 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:40.151157    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-tls podName:8217d49b-b30f-485f-82f0-841ee2dd526d nodeName:}" failed. No retries permitted until 2026-07-30 19:40:40.651136109 +0000 UTC m=+83.291551194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-tls") pod "node-exporter-5zfd4" (UID: "8217d49b-b30f-485f-82f0-841ee2dd526d") : secret "node-exporter-tls" not found
Jul 30 19:40:40.151522 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.151395    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8217d49b-b30f-485f-82f0-841ee2dd526d-metrics-client-ca\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.151522 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.151447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.151522 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.150987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8217d49b-b30f-485f-82f0-841ee2dd526d-root\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.153138 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.153122    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.161147 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.161129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtp2l\" (UniqueName: \"kubernetes.io/projected/8217d49b-b30f-485f-82f0-841ee2dd526d-kube-api-access-gtp2l\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.208234 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.208214    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:40.260405 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.260318    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-74wzd"
Jul 30 19:40:40.282434 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.282411    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:40.344291 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.344263    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:40.407244 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.407216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:40.654818 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.654793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-tls\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.657041 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.657023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8217d49b-b30f-485f-82f0-841ee2dd526d-node-exporter-tls\") pod \"node-exporter-5zfd4\" (UID: \"8217d49b-b30f-485f-82f0-841ee2dd526d\") " pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.776381 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.776319    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:40.778257 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.778240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5zfd4"
Jul 30 19:40:40.790870 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:40:40.790847    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8217d49b_b30f_485f_82f0_841ee2dd526d.slice/crio-8a3950cc65964a7f64145cea0561282bc2fd2316b269d7c8d642ac4eff69a322 WatchSource:0}: Error finding container 8a3950cc65964a7f64145cea0561282bc2fd2316b269d7c8d642ac4eff69a322: Status 404 returned error can't find the container with id 8a3950cc65964a7f64145cea0561282bc2fd2316b269d7c8d642ac4eff69a322
Jul 30 19:40:40.863114 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:40.863090    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:41.077083 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:41.077006    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:41.299564 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:41.299528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zfd4" event={"ID":"8217d49b-b30f-485f-82f0-841ee2dd526d","Type":"ContainerStarted","Data":"8a3950cc65964a7f64145cea0561282bc2fd2316b269d7c8d642ac4eff69a322"}
Jul 30 19:40:42.294115 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:42.294091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:42.308098 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:42.308065    2561 generic.go:356] "Generic (PLEG): container finished" podID="8217d49b-b30f-485f-82f0-841ee2dd526d" containerID="e754753d7a915e32a6bdeeb86d00dabbf7ee287720fcc710e0aa458a47aaea91" exitCode=0
Jul 30 19:40:42.308208 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:42.308136    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zfd4" event={"ID":"8217d49b-b30f-485f-82f0-841ee2dd526d","Type":"ContainerDied","Data":"e754753d7a915e32a6bdeeb86d00dabbf7ee287720fcc710e0aa458a47aaea91"}
Jul 30 19:40:42.391699 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:42.391676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:42.770621 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:42.770590    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:42.870239 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:42.870207    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:42.970155 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:42.970123    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:43.083737 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:43.083655    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:43.314030 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:43.313999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zfd4" event={"ID":"8217d49b-b30f-485f-82f0-841ee2dd526d","Type":"ContainerStarted","Data":"bde864d63f638e216b947ed3d9e9e6558b369c3b457c1fa44669e829aa76e693"}
Jul 30 19:40:43.314374 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:43.314047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zfd4" event={"ID":"8217d49b-b30f-485f-82f0-841ee2dd526d","Type":"ContainerStarted","Data":"1a34e89d2d4319d017bf56da9ced06b06d760ff0658eb49c00b2e4c718fbb5ed"}
Jul 30 19:40:43.334210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:43.334118    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5zfd4" podStartSLOduration=3.316865536 podStartE2EDuration="4.334105521s" totalImagesPullingTime="955.720128ms" totalInitContainerRuntime="61.519857ms" isStatefulPod=true podCreationTimestamp="2026-07-30 19:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:43.332513435 +0000 UTC m=+85.972928514" watchObservedRunningTime="2026-07-30 19:40:43.334105521 +0000 UTC m=+85.974520600"
Jul 30 19:40:43.835004 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:43.834983    2561 scope.go:117] "RemoveContainer" containerID="7477cecbb1563bf6d75cacbcde641c93e1b6929f643fa31624550a44b09bbaff"
Jul 30 19:40:43.835137 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:40:43.835116    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fcfsk_openshift-console-operator(17e8b2b9-1baf-4271-9291-5820bfc1d24e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" podUID="17e8b2b9-1baf-4271-9291-5820bfc1d24e"
Jul 30 19:40:44.579650 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:44.579613    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:44.887850 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:44.887816    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:46.131656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:46.131624    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:47.235616 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:47.235585    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:40:47.402696 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:47.402667    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:47.456856 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:47.456825    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:49.091145 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:49.091107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:49.191297 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:49.191267    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:49.244426 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:49.244395    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:49.386980 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:49.386953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:49.667936 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:49.667844    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-688f467c-w8dhs"]
Jul 30 19:40:49.735394 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:49.735366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:49.784139 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:49.784112    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:49.850179 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:49.850145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:49.903855 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:49.903836    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:52.025210 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:52.025169    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:52.127362 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:52.127328    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:52.954709 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:52.954679    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:53.054879 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:53.054847    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:56.119356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:56.119319    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:56.171298 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:56.171270    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:56.230515 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:56.230486    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qv5ss"
Jul 30 19:40:58.378048 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:58.378009    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:58.430017 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:58.429988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:58.835311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:58.835286    2561 scope.go:117] "RemoveContainer" containerID="7477cecbb1563bf6d75cacbcde641c93e1b6929f643fa31624550a44b09bbaff"
Jul 30 19:40:59.381971 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.381945    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:40:59.382320 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.382000    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" event={"ID":"17e8b2b9-1baf-4271-9291-5820bfc1d24e","Type":"ContainerStarted","Data":"f0eb758521ddd4f06d00651f4dbccc6b7ec966252eed5b57b5fcae171fb273eb"}
Jul 30 19:40:59.382320 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.382282    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:40:59.398371 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.398329    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk" podStartSLOduration=61.700435766 podStartE2EDuration="1m11.398316975s" totalImagesPullingTime="9.697881209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:59.397936848 +0000 UTC m=+102.038351962" watchObservedRunningTime="2026-07-30 19:40:59.398316975 +0000 UTC m=+102.038732055"
Jul 30 19:40:59.521712 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.521685    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-fcfsk"
Jul 30 19:40:59.691999 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.691930    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-np9p8"]
Jul 30 19:40:59.705413 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.705375    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:59.722505 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.722481    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-np9p8"]
Jul 30 19:40:59.722633 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.722569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-np9p8"
Jul 30 19:40:59.725606 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.725576    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 19:40:59.725708 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.725611    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 19:40:59.725708 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.725634    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lrq2k\""
Jul 30 19:40:59.760837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.760807    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:59.794437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.794417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mds7x\" (UniqueName: \"kubernetes.io/projected/69647bac-0a80-4a9c-acda-d6bcbe5926f3-kube-api-access-mds7x\") pod \"downloads-77c974ffcf-np9p8\" (UID: \"69647bac-0a80-4a9c-acda-d6bcbe5926f3\") " pod="openshift-console/downloads-77c974ffcf-np9p8"
Jul 30 19:40:59.826264 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.826243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:40:59.895583 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.895553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mds7x\" (UniqueName: \"kubernetes.io/projected/69647bac-0a80-4a9c-acda-d6bcbe5926f3-kube-api-access-mds7x\") pod \"downloads-77c974ffcf-np9p8\" (UID: \"69647bac-0a80-4a9c-acda-d6bcbe5926f3\") " pod="openshift-console/downloads-77c974ffcf-np9p8"
Jul 30 19:40:59.905304 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:40:59.905283    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mds7x\" (UniqueName: \"kubernetes.io/projected/69647bac-0a80-4a9c-acda-d6bcbe5926f3-kube-api-access-mds7x\") pod \"downloads-77c974ffcf-np9p8\" (UID: \"69647bac-0a80-4a9c-acda-d6bcbe5926f3\") " pod="openshift-console/downloads-77c974ffcf-np9p8"
Jul 30 19:41:00.018560 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:00.018510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:00.031549 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:00.031532    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-np9p8"
Jul 30 19:41:00.173486 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:00.173466    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-np9p8"]
Jul 30 19:41:00.175311 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:41:00.175283    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69647bac_0a80_4a9c_acda_d6bcbe5926f3.slice/crio-682cd958571ff1b7e79a6fdf676be5993d6be8913c5448f87bc3e2a7ab36cdf1 WatchSource:0}: Error finding container 682cd958571ff1b7e79a6fdf676be5993d6be8913c5448f87bc3e2a7ab36cdf1: Status 404 returned error can't find the container with id 682cd958571ff1b7e79a6fdf676be5993d6be8913c5448f87bc3e2a7ab36cdf1
Jul 30 19:41:00.196948 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:00.196920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:00.392037 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:00.392010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-np9p8" event={"ID":"69647bac-0a80-4a9c-acda-d6bcbe5926f3","Type":"ContainerStarted","Data":"682cd958571ff1b7e79a6fdf676be5993d6be8913c5448f87bc3e2a7ab36cdf1"}
Jul 30 19:41:00.429207 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:00.429180    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:00.529786 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:00.529764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:00.778069 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:00.778018    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:01.380334 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:01.380299    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:01.580392 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:01.580363    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:01.763081 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:01.763010    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:02.391177 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:02.391148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:02.520933 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:02.520902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:07.810162 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:07.810107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:07.874487 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:07.874457    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:10.146781 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.146746    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dcbd89cd5-4fdm4"]
Jul 30 19:41:10.150358 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.150335    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.153156 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.153088    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 19:41:10.153156 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.153094    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 19:41:10.153156 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.153126    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 19:41:10.154637 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.154608    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-v5sdb\""
Jul 30 19:41:10.154856 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.154838    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 19:41:10.154963 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.154876    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 19:41:10.160916 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.160361    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dcbd89cd5-4fdm4"]
Jul 30 19:41:10.273915 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.273873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-oauth-config\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.274070 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.273936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-serving-cert\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.274070 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.273963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-config\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.274070 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.273988    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-service-ca\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.274070 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.274058    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d6f8\" (UniqueName: \"kubernetes.io/projected/8101dbdb-79c8-46e4-9857-b13dbbddca60-kube-api-access-9d6f8\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.274248 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.274132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-oauth-serving-cert\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.375312 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.375270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-oauth-config\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.375467 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.375346    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-serving-cert\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.375467 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.375373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-config\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.375467 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.375396    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-service-ca\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.375467 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.375436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d6f8\" (UniqueName: \"kubernetes.io/projected/8101dbdb-79c8-46e4-9857-b13dbbddca60-kube-api-access-9d6f8\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.375670 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.375486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-oauth-serving-cert\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.376268 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.376239    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-oauth-serving-cert\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.376436 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.376393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-service-ca\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.376623 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.376596    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-config\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.378277 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.378254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-oauth-config\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.378377 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.378315    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-serving-cert\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.384000 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.383975    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d6f8\" (UniqueName: \"kubernetes.io/projected/8101dbdb-79c8-46e4-9857-b13dbbddca60-kube-api-access-9d6f8\") pod \"console-5dcbd89cd5-4fdm4\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") " pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.462595 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.462529    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:10.462865 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.462841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:10.561035 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:10.561001    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:13.799741 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:13.799704    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:14.397134 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:14.397104    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:14.451217 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:14.451180    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:14.686775 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:14.686686    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-688f467c-w8dhs" podUID="5c61ae08-b999-49da-b893-8795ad8e7b0d" containerName="registry" containerID="cri-o://8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d" gracePeriod=30
Jul 30 19:41:16.949388 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:16.949296    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dcbd89cd5-4fdm4"]
Jul 30 19:41:17.009774 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:41:17.009750    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8101dbdb_79c8_46e4_9857_b13dbbddca60.slice/crio-d13ca3186ada7cc265668e8a2cb9385d5a6bb2056ace253516de48aea0e026fb WatchSource:0}: Error finding container d13ca3186ada7cc265668e8a2cb9385d5a6bb2056ace253516de48aea0e026fb: Status 404 returned error can't find the container with id d13ca3186ada7cc265668e8a2cb9385d5a6bb2056ace253516de48aea0e026fb
Jul 30 19:41:17.029099 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.029076    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:41:17.129659 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.129634    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-image-registry-private-configuration\") pod \"5c61ae08-b999-49da-b893-8795ad8e7b0d\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") "
Jul 30 19:41:17.129799 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.129671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") pod \"5c61ae08-b999-49da-b893-8795ad8e7b0d\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") "
Jul 30 19:41:17.129799 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.129691    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-installation-pull-secrets\") pod \"5c61ae08-b999-49da-b893-8795ad8e7b0d\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") "
Jul 30 19:41:17.129799 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.129731    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c61ae08-b999-49da-b893-8795ad8e7b0d-ca-trust-extracted\") pod \"5c61ae08-b999-49da-b893-8795ad8e7b0d\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") "
Jul 30 19:41:17.129799 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.129775    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-bound-sa-token\") pod \"5c61ae08-b999-49da-b893-8795ad8e7b0d\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") "
Jul 30 19:41:17.130059 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.129815    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-trusted-ca\") pod \"5c61ae08-b999-49da-b893-8795ad8e7b0d\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") "
Jul 30 19:41:17.130059 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.129851    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhn2n\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-kube-api-access-mhn2n\") pod \"5c61ae08-b999-49da-b893-8795ad8e7b0d\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") "
Jul 30 19:41:17.130059 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.129880    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-certificates\") pod \"5c61ae08-b999-49da-b893-8795ad8e7b0d\" (UID: \"5c61ae08-b999-49da-b893-8795ad8e7b0d\") "
Jul 30 19:41:17.130747 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.130669    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5c61ae08-b999-49da-b893-8795ad8e7b0d" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:41:17.131006 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.130977    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5c61ae08-b999-49da-b893-8795ad8e7b0d" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:41:17.132094 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.132068    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5c61ae08-b999-49da-b893-8795ad8e7b0d" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:41:17.132179 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.132071    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5c61ae08-b999-49da-b893-8795ad8e7b0d" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:41:17.132220 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.132173    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5c61ae08-b999-49da-b893-8795ad8e7b0d" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:41:17.132384 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.132368    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-kube-api-access-mhn2n" (OuterVolumeSpecName: "kube-api-access-mhn2n") pod "5c61ae08-b999-49da-b893-8795ad8e7b0d" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d"). InnerVolumeSpecName "kube-api-access-mhn2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:41:17.133683 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.133653    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5c61ae08-b999-49da-b893-8795ad8e7b0d" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:41:17.138982 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.138956    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c61ae08-b999-49da-b893-8795ad8e7b0d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5c61ae08-b999-49da-b893-8795ad8e7b0d" (UID: "5c61ae08-b999-49da-b893-8795ad8e7b0d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:41:17.231174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.231142    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-bound-sa-token\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:17.231174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.231173    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-trusted-ca\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:17.231358 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.231182    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhn2n\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-kube-api-access-mhn2n\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:17.231358 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.231192    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-certificates\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:17.231358 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.231203    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-image-registry-private-configuration\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:17.231358 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.231218    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c61ae08-b999-49da-b893-8795ad8e7b0d-registry-tls\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:17.231358 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.231231    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c61ae08-b999-49da-b893-8795ad8e7b0d-installation-pull-secrets\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:17.231358 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.231244    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c61ae08-b999-49da-b893-8795ad8e7b0d-ca-trust-extracted\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:17.472506 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.472327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-np9p8" event={"ID":"69647bac-0a80-4a9c-acda-d6bcbe5926f3","Type":"ContainerStarted","Data":"15ca264f4e30cb2a64533d0fac2c203215db1789ef0406557543fc514b974d62"}
Jul 30 19:41:17.472733 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.472706    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-np9p8"
Jul 30 19:41:17.475074 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.474313    2561 generic.go:356] "Generic (PLEG): container finished" podID="5c61ae08-b999-49da-b893-8795ad8e7b0d" containerID="8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d" exitCode=0
Jul 30 19:41:17.475074 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.474464    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-688f467c-w8dhs"
Jul 30 19:41:17.475074 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.474708    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-688f467c-w8dhs" event={"ID":"5c61ae08-b999-49da-b893-8795ad8e7b0d","Type":"ContainerDied","Data":"8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d"}
Jul 30 19:41:17.475074 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.474756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-688f467c-w8dhs" event={"ID":"5c61ae08-b999-49da-b893-8795ad8e7b0d","Type":"ContainerDied","Data":"e84dbde0d6732903786c07e8918dba899ab8108fb78eaf886eee8870cfe21817"}
Jul 30 19:41:17.475074 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.474786    2561 scope.go:117] "RemoveContainer" containerID="8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d"
Jul 30 19:41:17.477417 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.477373    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dcbd89cd5-4fdm4" event={"ID":"8101dbdb-79c8-46e4-9857-b13dbbddca60","Type":"ContainerStarted","Data":"d13ca3186ada7cc265668e8a2cb9385d5a6bb2056ace253516de48aea0e026fb"}
Jul 30 19:41:17.486378 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.485952    2561 scope.go:117] "RemoveContainer" containerID="8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d"
Jul 30 19:41:17.486963 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:41:17.486935    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d\": container with ID starting with 8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d not found: ID does not exist" containerID="8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d"
Jul 30 19:41:17.487161 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.486879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-np9p8"
Jul 30 19:41:17.487161 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.486972    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d"} err="failed to get container status \"8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d\": rpc error: code = NotFound desc = could not find container \"8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d\": container with ID starting with 8a9834473f7dbaecfe134d6c2ecef4edca406baa6cfec9fef702e80004abf80d not found: ID does not exist"
Jul 30 19:41:17.492919 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.492856    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-np9p8" podStartSLOduration=1.755484768 podStartE2EDuration="18.492840344s" totalImagesPullingTime="16.737355576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:41:17.489698588 +0000 UTC m=+120.130113671" watchObservedRunningTime="2026-07-30 19:41:17.492840344 +0000 UTC m=+120.133255426"
Jul 30 19:41:17.504311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.504271    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-688f467c-w8dhs"]
Jul 30 19:41:17.506066 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.506040    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-688f467c-w8dhs"]
Jul 30 19:41:17.799609 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.799578    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:17.844016 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.843386    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c61ae08-b999-49da-b893-8795ad8e7b0d" path="/var/lib/kubelet/pods/5c61ae08-b999-49da-b893-8795ad8e7b0d/volumes"
Jul 30 19:41:17.855454 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:17.855432    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:18.394186 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.394153    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78dd44d5b8-98s4j"]
Jul 30 19:41:18.394570 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.394558    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c61ae08-b999-49da-b893-8795ad8e7b0d" containerName="registry"
Jul 30 19:41:18.394634 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.394576    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c61ae08-b999-49da-b893-8795ad8e7b0d" containerName="registry"
Jul 30 19:41:18.394711 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.394664    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c61ae08-b999-49da-b893-8795ad8e7b0d" containerName="registry"
Jul 30 19:41:18.397741 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.397719    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.408597 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.408404    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 30 19:41:18.409212 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.409188    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78dd44d5b8-98s4j"]
Jul 30 19:41:18.441518 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.441494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-oauth-config\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.441629 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.441561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-serving-cert\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.441629 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.441599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzj6\" (UniqueName: \"kubernetes.io/projected/47e75e5a-3fef-4182-9957-a7ab58562035-kube-api-access-4gzj6\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.441746 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.441650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-oauth-serving-cert\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.441746 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.441678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-service-ca\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.441746 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.441731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-console-config\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.441936 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.441754    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-trusted-ca-bundle\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.485182 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.485155    2561 generic.go:356] "Generic (PLEG): container finished" podID="967aac46-da82-4cda-ab62-bf9e6715f85b" containerID="b0f64ea254326e85073815b440737ddcaa41e5b5453b252a853148845eb2c86b" exitCode=0
Jul 30 19:41:18.485338 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.485301    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt" event={"ID":"967aac46-da82-4cda-ab62-bf9e6715f85b","Type":"ContainerDied","Data":"b0f64ea254326e85073815b440737ddcaa41e5b5453b252a853148845eb2c86b"}
Jul 30 19:41:18.485748 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.485730    2561 scope.go:117] "RemoveContainer" containerID="b0f64ea254326e85073815b440737ddcaa41e5b5453b252a853148845eb2c86b"
Jul 30 19:41:18.542832 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.542802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-oauth-serving-cert\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.542975 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.542845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-service-ca\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.542975 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.542918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-console-config\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.542975 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.542944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-trusted-ca-bundle\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.543143 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.543011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-oauth-config\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.543143 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.543084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-serving-cert\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.543143 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.543117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzj6\" (UniqueName: \"kubernetes.io/projected/47e75e5a-3fef-4182-9957-a7ab58562035-kube-api-access-4gzj6\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.543719 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.543694    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-oauth-serving-cert\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.544807 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.544005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-console-config\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.544807 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.544537    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-trusted-ca-bundle\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.544807 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.544584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-service-ca\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.546941 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.546921    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-oauth-config\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.553803 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.553779    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzj6\" (UniqueName: \"kubernetes.io/projected/47e75e5a-3fef-4182-9957-a7ab58562035-kube-api-access-4gzj6\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.557575 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.557551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-serving-cert\") pod \"console-78dd44d5b8-98s4j\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") " pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.726635 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.726598    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:18.905765 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:18.905685    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78dd44d5b8-98s4j"]
Jul 30 19:41:18.911856 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:41:18.911823    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e75e5a_3fef_4182_9957_a7ab58562035.slice/crio-666e25b765f43a7c74ff692abad893ec84d16b15e82c0453dbefaa30c85c67a5 WatchSource:0}: Error finding container 666e25b765f43a7c74ff692abad893ec84d16b15e82c0453dbefaa30c85c67a5: Status 404 returned error can't find the container with id 666e25b765f43a7c74ff692abad893ec84d16b15e82c0453dbefaa30c85c67a5
Jul 30 19:41:19.501611 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:19.500800    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-shwpt" event={"ID":"967aac46-da82-4cda-ab62-bf9e6715f85b","Type":"ContainerStarted","Data":"da849db1cc97d739b8a2afe786ab347c837a5e3d12fb11beee2f28b5a6460d08"}
Jul 30 19:41:19.502560 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:19.502531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dd44d5b8-98s4j" event={"ID":"47e75e5a-3fef-4182-9957-a7ab58562035","Type":"ContainerStarted","Data":"666e25b765f43a7c74ff692abad893ec84d16b15e82c0453dbefaa30c85c67a5"}
Jul 30 19:41:21.512926 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:21.512815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dd44d5b8-98s4j" event={"ID":"47e75e5a-3fef-4182-9957-a7ab58562035","Type":"ContainerStarted","Data":"94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117"}
Jul 30 19:41:21.514777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:21.514741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dcbd89cd5-4fdm4" event={"ID":"8101dbdb-79c8-46e4-9857-b13dbbddca60","Type":"ContainerStarted","Data":"3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994"}
Jul 30 19:41:21.531524 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:21.531452    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78dd44d5b8-98s4j" podStartSLOduration=1.379131501 podStartE2EDuration="3.531437459s" totalImagesPullingTime="2.152305958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:41:21.529866164 +0000 UTC m=+124.170281245" watchObservedRunningTime="2026-07-30 19:41:21.531437459 +0000 UTC m=+124.171852538"
Jul 30 19:41:21.546944 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:21.546879    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dcbd89cd5-4fdm4" podStartSLOduration=7.49313845 podStartE2EDuration="11.546865343s" totalImagesPullingTime="4.053726893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:41:21.545798896 +0000 UTC m=+124.186213976" watchObservedRunningTime="2026-07-30 19:41:21.546865343 +0000 UTC m=+124.187280422"
Jul 30 19:41:22.207712 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:22.207669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:22.593407 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:22.593324    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:22.802573 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:22.802532    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:22.852620 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:22.852533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:23.526014 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:23.525974    2561 generic.go:356] "Generic (PLEG): container finished" podID="c07eb7f6-b249-4a53-96ec-055a46e4330c" containerID="ec570e852e8bb5df6fbcb083d5b0e6876be6b6bf009361b1f20604bbf29ef520" exitCode=0
Jul 30 19:41:23.526196 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:23.526045    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm" event={"ID":"c07eb7f6-b249-4a53-96ec-055a46e4330c","Type":"ContainerDied","Data":"ec570e852e8bb5df6fbcb083d5b0e6876be6b6bf009361b1f20604bbf29ef520"}
Jul 30 19:41:23.526491 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:23.526466    2561 scope.go:117] "RemoveContainer" containerID="ec570e852e8bb5df6fbcb083d5b0e6876be6b6bf009361b1f20604bbf29ef520"
Jul 30 19:41:24.532404 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:24.532364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-j5vtm" event={"ID":"c07eb7f6-b249-4a53-96ec-055a46e4330c","Type":"ContainerStarted","Data":"41e6010a889554e4c70444528444d3c3e467ee0380094c733b606141c6194609"}
Jul 30 19:41:24.615171 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:24.615134    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:24.716043 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:24.716009    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:28.727597 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:28.727563    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:28.728169 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:28.727651    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:28.732218 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:28.732196    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:29.558058 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:29.558025    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:41:29.603633 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:29.603604    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dcbd89cd5-4fdm4"]
Jul 30 19:41:29.697096 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:29.697061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:29.745567 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:29.745535    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:29.801796 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:29.801768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:30.046922 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:30.046877    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:30.148355 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:30.148325    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:30.463646 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:30.463623    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:34.188193 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:34.188158    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:34.237068 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:34.237039    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:38.592228 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:38.592190    2561 generic.go:356] "Generic (PLEG): container finished" podID="07a83901-0254-4f62-be31-1d43d8ab70c4" containerID="2fb4612d3f866cdd15eb5e5b469db5aa7dd90ec0f27c7e40a226e330bc23d18b" exitCode=0
Jul 30 19:41:38.592697 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:38.592275    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rqlds" event={"ID":"07a83901-0254-4f62-be31-1d43d8ab70c4","Type":"ContainerDied","Data":"2fb4612d3f866cdd15eb5e5b469db5aa7dd90ec0f27c7e40a226e330bc23d18b"}
Jul 30 19:41:38.592799 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:38.592725    2561 scope.go:117] "RemoveContainer" containerID="2fb4612d3f866cdd15eb5e5b469db5aa7dd90ec0f27c7e40a226e330bc23d18b"
Jul 30 19:41:39.237758 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:39.237728    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:39.597707 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:39.597630    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rqlds" event={"ID":"07a83901-0254-4f62-be31-1d43d8ab70c4","Type":"ContainerStarted","Data":"bb69a84ddd9165dcf4618b6c8a3c7ca12967b0c2f43d7ebb47189eaab19e7a9b"}
Jul 30 19:41:52.859477 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:52.859448    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:52.959735 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:52.959707    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:54.623601 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:54.623559    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dcbd89cd5-4fdm4" podUID="8101dbdb-79c8-46e4-9857-b13dbbddca60" containerName="console" containerID="cri-o://3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994" gracePeriod=15
Jul 30 19:41:54.897411 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:54.897388    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:55.010799 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.010769    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-service-ca\") pod \"8101dbdb-79c8-46e4-9857-b13dbbddca60\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") "
Jul 30 19:41:55.010957 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.010839    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-oauth-serving-cert\") pod \"8101dbdb-79c8-46e4-9857-b13dbbddca60\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") "
Jul 30 19:41:55.010957 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.010871    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-oauth-config\") pod \"8101dbdb-79c8-46e4-9857-b13dbbddca60\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") "
Jul 30 19:41:55.010957 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.010933    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-config\") pod \"8101dbdb-79c8-46e4-9857-b13dbbddca60\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") "
Jul 30 19:41:55.011128 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.010966    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d6f8\" (UniqueName: \"kubernetes.io/projected/8101dbdb-79c8-46e4-9857-b13dbbddca60-kube-api-access-9d6f8\") pod \"8101dbdb-79c8-46e4-9857-b13dbbddca60\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") "
Jul 30 19:41:55.011128 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.011004    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-serving-cert\") pod \"8101dbdb-79c8-46e4-9857-b13dbbddca60\" (UID: \"8101dbdb-79c8-46e4-9857-b13dbbddca60\") "
Jul 30 19:41:55.011282 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.011252    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-service-ca" (OuterVolumeSpecName: "service-ca") pod "8101dbdb-79c8-46e4-9857-b13dbbddca60" (UID: "8101dbdb-79c8-46e4-9857-b13dbbddca60"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:41:55.011353 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.011292    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8101dbdb-79c8-46e4-9857-b13dbbddca60" (UID: "8101dbdb-79c8-46e4-9857-b13dbbddca60"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:41:55.011402 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.011378    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-config" (OuterVolumeSpecName: "console-config") pod "8101dbdb-79c8-46e4-9857-b13dbbddca60" (UID: "8101dbdb-79c8-46e4-9857-b13dbbddca60"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:41:55.011402 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.011383    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-service-ca\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:55.011504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.011420    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-oauth-serving-cert\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:55.013287 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.013252    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8101dbdb-79c8-46e4-9857-b13dbbddca60-kube-api-access-9d6f8" (OuterVolumeSpecName: "kube-api-access-9d6f8") pod "8101dbdb-79c8-46e4-9857-b13dbbddca60" (UID: "8101dbdb-79c8-46e4-9857-b13dbbddca60"). InnerVolumeSpecName "kube-api-access-9d6f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:41:55.013393 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.013286    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8101dbdb-79c8-46e4-9857-b13dbbddca60" (UID: "8101dbdb-79c8-46e4-9857-b13dbbddca60"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:41:55.013393 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.013297    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8101dbdb-79c8-46e4-9857-b13dbbddca60" (UID: "8101dbdb-79c8-46e4-9857-b13dbbddca60"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:41:55.111953 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.111927    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-oauth-config\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:55.111953 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.111949    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-config\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:55.112079 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.111964    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d6f8\" (UniqueName: \"kubernetes.io/projected/8101dbdb-79c8-46e4-9857-b13dbbddca60-kube-api-access-9d6f8\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:55.112079 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.111976    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8101dbdb-79c8-46e4-9857-b13dbbddca60-console-serving-cert\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:41:55.661159 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.661118    2561 generic.go:356] "Generic (PLEG): container finished" podID="8101dbdb-79c8-46e4-9857-b13dbbddca60" containerID="3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994" exitCode=0
Jul 30 19:41:55.661506 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.661181    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dcbd89cd5-4fdm4"
Jul 30 19:41:55.661506 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.661220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dcbd89cd5-4fdm4" event={"ID":"8101dbdb-79c8-46e4-9857-b13dbbddca60","Type":"ContainerDied","Data":"3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994"}
Jul 30 19:41:55.661506 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.661284    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dcbd89cd5-4fdm4" event={"ID":"8101dbdb-79c8-46e4-9857-b13dbbddca60","Type":"ContainerDied","Data":"d13ca3186ada7cc265668e8a2cb9385d5a6bb2056ace253516de48aea0e026fb"}
Jul 30 19:41:55.661506 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.661309    2561 scope.go:117] "RemoveContainer" containerID="3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994"
Jul 30 19:41:55.670098 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.670080    2561 scope.go:117] "RemoveContainer" containerID="3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994"
Jul 30 19:41:55.670364 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:41:55.670341    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994\": container with ID starting with 3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994 not found: ID does not exist" containerID="3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994"
Jul 30 19:41:55.670431 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.670372    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994"} err="failed to get container status \"3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994\": rpc error: code = NotFound desc = could not find container \"3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994\": container with ID starting with 3370621ee0ea49c876a256b851534997306ac1b4c9c12c5e3028943df8f41994 not found: ID does not exist"
Jul 30 19:41:55.681811 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.681786    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dcbd89cd5-4fdm4"]
Jul 30 19:41:55.684949 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.684920    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dcbd89cd5-4fdm4"]
Jul 30 19:41:55.839156 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.839136    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8101dbdb-79c8-46e4-9857-b13dbbddca60" path="/var/lib/kubelet/pods/8101dbdb-79c8-46e4-9857-b13dbbddca60/volumes"
Jul 30 19:41:55.895620 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.895596    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:55.965563 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:55.965512    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:59.205413 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:59.205375    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:59.254070 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:59.254042    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:41:59.897182 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:59.897141    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ffb7cbcf9-9c9k4"]
Jul 30 19:41:59.897599 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:59.897577    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8101dbdb-79c8-46e4-9857-b13dbbddca60" containerName="console"
Jul 30 19:41:59.897599 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:59.897598    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8101dbdb-79c8-46e4-9857-b13dbbddca60" containerName="console"
Jul 30 19:41:59.897790 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:59.897678    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8101dbdb-79c8-46e4-9857-b13dbbddca60" containerName="console"
Jul 30 19:41:59.929486 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:59.929462    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffb7cbcf9-9c9k4"]
Jul 30 19:41:59.929602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:59.929563    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:41:59.948401 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:41:59.948369    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:00.043003 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.042973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-config\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.043003 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.043002    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-trusted-ca-bundle\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.043152 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.043025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-service-ca\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.043152 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.043050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-oauth-config\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.043152 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.043134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-serving-cert\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.043249 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.043170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-oauth-serving-cert\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.043249 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.043186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzdmg\" (UniqueName: \"kubernetes.io/projected/be194680-1d57-4d98-b7aa-6bf22b06ec43-kube-api-access-mzdmg\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.045505 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.045485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:00.143591 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.143567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-config\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.143707 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.143596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-trusted-ca-bundle\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.143707 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.143621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-service-ca\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.143707 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.143659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-oauth-config\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.143707 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.143700    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-serving-cert\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.143907 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.143730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-oauth-serving-cert\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.143907 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.143754    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzdmg\" (UniqueName: \"kubernetes.io/projected/be194680-1d57-4d98-b7aa-6bf22b06ec43-kube-api-access-mzdmg\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.144495 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.144467    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-config\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.144607 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.144493    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-oauth-serving-cert\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.144607 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.144478    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-service-ca\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.144767 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.144746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-trusted-ca-bundle\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.146358 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.146326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-serving-cert\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.146479 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.146439    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-oauth-config\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.148277 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.148223    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:00.151346 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.151324    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzdmg\" (UniqueName: \"kubernetes.io/projected/be194680-1d57-4d98-b7aa-6bf22b06ec43-kube-api-access-mzdmg\") pod \"console-7ffb7cbcf9-9c9k4\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") " pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.238508 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.238484    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:00.245711 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.245688    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:00.391955 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.391829    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffb7cbcf9-9c9k4"]
Jul 30 19:42:00.394783 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:42:00.394759    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe194680_1d57_4d98_b7aa_6bf22b06ec43.slice/crio-584fc75762e4bebd955928063c379a8520ce9562e12260bcf6c2bf0f96f867d9 WatchSource:0}: Error finding container 584fc75762e4bebd955928063c379a8520ce9562e12260bcf6c2bf0f96f867d9: Status 404 returned error can't find the container with id 584fc75762e4bebd955928063c379a8520ce9562e12260bcf6c2bf0f96f867d9
Jul 30 19:42:00.683268 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.683197    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb7cbcf9-9c9k4" event={"ID":"be194680-1d57-4d98-b7aa-6bf22b06ec43","Type":"ContainerStarted","Data":"a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9"}
Jul 30 19:42:00.683268 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.683245    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb7cbcf9-9c9k4" event={"ID":"be194680-1d57-4d98-b7aa-6bf22b06ec43","Type":"ContainerStarted","Data":"584fc75762e4bebd955928063c379a8520ce9562e12260bcf6c2bf0f96f867d9"}
Jul 30 19:42:00.703648 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.703602    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ffb7cbcf9-9c9k4" podStartSLOduration=1.703586727 podStartE2EDuration="1.703586727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:42:00.701657492 +0000 UTC m=+163.342072573" watchObservedRunningTime="2026-07-30 19:42:00.703586727 +0000 UTC m=+163.344001807"
Jul 30 19:42:00.706328 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.706296    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:00.760056 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:00.760028    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:07.809366 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:07.809327    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:07.909600 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:07.909550    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:10.057223 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:10.057190    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:10.239543 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:10.239506    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:10.239667 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:10.239566    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:10.244282 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:10.244261    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:10.727695 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:10.727677    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:42:10.769513 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:10.769488    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78dd44d5b8-98s4j"]
Jul 30 19:42:10.868026 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:10.867994    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:10.968511 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:10.968478    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:11.018878 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:11.018808    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:35.791924 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:35.791836    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78dd44d5b8-98s4j" podUID="47e75e5a-3fef-4182-9957-a7ab58562035" containerName="console" containerID="cri-o://94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117" gracePeriod=15
Jul 30 19:42:36.026714 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.026692    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:42:36.083013 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.082961    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gzj6\" (UniqueName: \"kubernetes.io/projected/47e75e5a-3fef-4182-9957-a7ab58562035-kube-api-access-4gzj6\") pod \"47e75e5a-3fef-4182-9957-a7ab58562035\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") "
Jul 30 19:42:36.083013 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.082988    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-oauth-serving-cert\") pod \"47e75e5a-3fef-4182-9957-a7ab58562035\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") "
Jul 30 19:42:36.083164 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083023    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-trusted-ca-bundle\") pod \"47e75e5a-3fef-4182-9957-a7ab58562035\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") "
Jul 30 19:42:36.083164 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083040    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-console-config\") pod \"47e75e5a-3fef-4182-9957-a7ab58562035\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") "
Jul 30 19:42:36.083274 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083167    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-oauth-config\") pod \"47e75e5a-3fef-4182-9957-a7ab58562035\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") "
Jul 30 19:42:36.083274 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083205    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-serving-cert\") pod \"47e75e5a-3fef-4182-9957-a7ab58562035\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") "
Jul 30 19:42:36.083274 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-service-ca\") pod \"47e75e5a-3fef-4182-9957-a7ab58562035\" (UID: \"47e75e5a-3fef-4182-9957-a7ab58562035\") "
Jul 30 19:42:36.083399 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083340    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "47e75e5a-3fef-4182-9957-a7ab58562035" (UID: "47e75e5a-3fef-4182-9957-a7ab58562035"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:36.083457 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083409    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "47e75e5a-3fef-4182-9957-a7ab58562035" (UID: "47e75e5a-3fef-4182-9957-a7ab58562035"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:36.083457 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083424    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-console-config" (OuterVolumeSpecName: "console-config") pod "47e75e5a-3fef-4182-9957-a7ab58562035" (UID: "47e75e5a-3fef-4182-9957-a7ab58562035"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:36.083677 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083656    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-service-ca" (OuterVolumeSpecName: "service-ca") pod "47e75e5a-3fef-4182-9957-a7ab58562035" (UID: "47e75e5a-3fef-4182-9957-a7ab58562035"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:36.083747 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083668    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-oauth-serving-cert\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:42:36.083747 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083703    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-trusted-ca-bundle\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:42:36.083747 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.083719    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-console-config\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:42:36.085181 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.085149    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "47e75e5a-3fef-4182-9957-a7ab58562035" (UID: "47e75e5a-3fef-4182-9957-a7ab58562035"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:36.085265 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.085175    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e75e5a-3fef-4182-9957-a7ab58562035-kube-api-access-4gzj6" (OuterVolumeSpecName: "kube-api-access-4gzj6") pod "47e75e5a-3fef-4182-9957-a7ab58562035" (UID: "47e75e5a-3fef-4182-9957-a7ab58562035"). InnerVolumeSpecName "kube-api-access-4gzj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:42:36.085265 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.085197    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "47e75e5a-3fef-4182-9957-a7ab58562035" (UID: "47e75e5a-3fef-4182-9957-a7ab58562035"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:36.184193 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.184171    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-oauth-config\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:42:36.184193 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.184191    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47e75e5a-3fef-4182-9957-a7ab58562035-console-serving-cert\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:42:36.184302 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.184200    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47e75e5a-3fef-4182-9957-a7ab58562035-service-ca\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:42:36.184302 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.184209    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gzj6\" (UniqueName: \"kubernetes.io/projected/47e75e5a-3fef-4182-9957-a7ab58562035-kube-api-access-4gzj6\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:42:36.832625 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.832578    2561 generic.go:356] "Generic (PLEG): container finished" podID="47e75e5a-3fef-4182-9957-a7ab58562035" containerID="94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117" exitCode=0
Jul 30 19:42:36.833078 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.832640    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dd44d5b8-98s4j"
Jul 30 19:42:36.833078 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.832673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dd44d5b8-98s4j" event={"ID":"47e75e5a-3fef-4182-9957-a7ab58562035","Type":"ContainerDied","Data":"94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117"}
Jul 30 19:42:36.833078 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.832741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dd44d5b8-98s4j" event={"ID":"47e75e5a-3fef-4182-9957-a7ab58562035","Type":"ContainerDied","Data":"666e25b765f43a7c74ff692abad893ec84d16b15e82c0453dbefaa30c85c67a5"}
Jul 30 19:42:36.833078 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.832766    2561 scope.go:117] "RemoveContainer" containerID="94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117"
Jul 30 19:42:36.844425 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.844405    2561 scope.go:117] "RemoveContainer" containerID="94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117"
Jul 30 19:42:36.845267 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:42:36.845242    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117\": container with ID starting with 94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117 not found: ID does not exist" containerID="94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117"
Jul 30 19:42:36.845340 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.845275    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117"} err="failed to get container status \"94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117\": rpc error: code = NotFound desc = could not find container \"94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117\": container with ID starting with 94a8a7757825a275dda9741d40dedbfd7e742f89a682b689bcc89d1da55dd117 not found: ID does not exist"
Jul 30 19:42:36.854071 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.854046    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78dd44d5b8-98s4j"]
Jul 30 19:42:36.858226 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:36.858201    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78dd44d5b8-98s4j"]
Jul 30 19:42:37.840380 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:37.840344    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e75e5a-3fef-4182-9957-a7ab58562035" path="/var/lib/kubelet/pods/47e75e5a-3fef-4182-9957-a7ab58562035/volumes"
Jul 30 19:42:51.351520 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.351486    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:51.445952 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.445904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:51.930618 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.930585    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"]
Jul 30 19:42:51.930941 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.930924    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e75e5a-3fef-4182-9957-a7ab58562035" containerName="console"
Jul 30 19:42:51.931006 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.930943    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e75e5a-3fef-4182-9957-a7ab58562035" containerName="console"
Jul 30 19:42:51.931044 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.931006    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e75e5a-3fef-4182-9957-a7ab58562035" containerName="console"
Jul 30 19:42:51.934182 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.934161    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:51.937330 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.937305    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8nb6p\""
Jul 30 19:42:51.937470 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.937350    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 19:42:51.937470 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.937349    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 19:42:51.942604 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.942578    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"]
Jul 30 19:42:51.994420 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.994395    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:51.994521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.994425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zl2z\" (UniqueName: \"kubernetes.io/projected/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-kube-api-access-9zl2z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:51.994521 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:51.994464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:52.095504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:52.095473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:52.095631 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:52.095537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:52.095631 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:52.095570    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zl2z\" (UniqueName: \"kubernetes.io/projected/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-kube-api-access-9zl2z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:52.095864 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:52.095837    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:52.095974 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:52.095906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:52.103859 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:52.103835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zl2z\" (UniqueName: \"kubernetes.io/projected/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-kube-api-access-9zl2z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:52.244588 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:52.244527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:42:52.368183 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:52.368160    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"]
Jul 30 19:42:52.370366 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:42:52.370338    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a02e22_3cbf_4346_b91b_ed08668fe8c5.slice/crio-99a8a582bb952ee8e2fe5831273a736a54774ee0af6773d5c28fb9c926a2d32b WatchSource:0}: Error finding container 99a8a582bb952ee8e2fe5831273a736a54774ee0af6773d5c28fb9c926a2d32b: Status 404 returned error can't find the container with id 99a8a582bb952ee8e2fe5831273a736a54774ee0af6773d5c28fb9c926a2d32b
Jul 30 19:42:52.896155 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:52.896119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z" event={"ID":"b4a02e22-3cbf-4346-b91b-ed08668fe8c5","Type":"ContainerStarted","Data":"99a8a582bb952ee8e2fe5831273a736a54774ee0af6773d5c28fb9c926a2d32b"}
Jul 30 19:42:53.449432 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:53.449385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:42:59.927834 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:59.927802    2561 generic.go:356] "Generic (PLEG): container finished" podID="b4a02e22-3cbf-4346-b91b-ed08668fe8c5" containerID="65f90cb4cedd1298574f58704a9189df64f95d6ea30f2a0ed9ff5cc21dac365a" exitCode=0
Jul 30 19:42:59.928205 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:42:59.927864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z" event={"ID":"b4a02e22-3cbf-4346-b91b-ed08668fe8c5","Type":"ContainerDied","Data":"65f90cb4cedd1298574f58704a9189df64f95d6ea30f2a0ed9ff5cc21dac365a"}
Jul 30 19:43:02.941453 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:02.941407    2561 generic.go:356] "Generic (PLEG): container finished" podID="b4a02e22-3cbf-4346-b91b-ed08668fe8c5" containerID="312ff9c660b9ccd6661942581f48e6f2753942a57845c4443a59b34023e8c00f" exitCode=0
Jul 30 19:43:02.941857 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:02.941459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z" event={"ID":"b4a02e22-3cbf-4346-b91b-ed08668fe8c5","Type":"ContainerDied","Data":"312ff9c660b9ccd6661942581f48e6f2753942a57845c4443a59b34023e8c00f"}
Jul 30 19:43:09.426683 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:09.426631    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:09.527986 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:09.527958    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:10.974966 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:10.974928    2561 generic.go:356] "Generic (PLEG): container finished" podID="b4a02e22-3cbf-4346-b91b-ed08668fe8c5" containerID="b637d89676e4031e8089d3b6a1868f55ab29ebd85395462241421539a49d3ae8" exitCode=0
Jul 30 19:43:10.975322 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:10.974980    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z" event={"ID":"b4a02e22-3cbf-4346-b91b-ed08668fe8c5","Type":"ContainerDied","Data":"b637d89676e4031e8089d3b6a1868f55ab29ebd85395462241421539a49d3ae8"}
Jul 30 19:43:12.106713 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.106692    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:43:12.242053 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.242000    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-bundle\") pod \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") "
Jul 30 19:43:12.242053 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.242045    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-util\") pod \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") "
Jul 30 19:43:12.242187 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.242074    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zl2z\" (UniqueName: \"kubernetes.io/projected/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-kube-api-access-9zl2z\") pod \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\" (UID: \"b4a02e22-3cbf-4346-b91b-ed08668fe8c5\") "
Jul 30 19:43:12.242627 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.242596    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-bundle" (OuterVolumeSpecName: "bundle") pod "b4a02e22-3cbf-4346-b91b-ed08668fe8c5" (UID: "b4a02e22-3cbf-4346-b91b-ed08668fe8c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:43:12.244174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.244148    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-kube-api-access-9zl2z" (OuterVolumeSpecName: "kube-api-access-9zl2z") pod "b4a02e22-3cbf-4346-b91b-ed08668fe8c5" (UID: "b4a02e22-3cbf-4346-b91b-ed08668fe8c5"). InnerVolumeSpecName "kube-api-access-9zl2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:43:12.246172 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.246148    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-util" (OuterVolumeSpecName: "util") pod "b4a02e22-3cbf-4346-b91b-ed08668fe8c5" (UID: "b4a02e22-3cbf-4346-b91b-ed08668fe8c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:43:12.342868 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.342842    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-util\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:43:12.342868 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.342863    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zl2z\" (UniqueName: \"kubernetes.io/projected/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-kube-api-access-9zl2z\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:43:12.343051 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.342874    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a02e22-3cbf-4346-b91b-ed08668fe8c5-bundle\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:43:12.991119 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.991092    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z"
Jul 30 19:43:12.991298 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.991083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rjn9z" event={"ID":"b4a02e22-3cbf-4346-b91b-ed08668fe8c5","Type":"ContainerDied","Data":"99a8a582bb952ee8e2fe5831273a736a54774ee0af6773d5c28fb9c926a2d32b"}
Jul 30 19:43:12.991298 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:12.991227    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99a8a582bb952ee8e2fe5831273a736a54774ee0af6773d5c28fb9c926a2d32b"
Jul 30 19:43:17.945115 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:17.945087    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:18.810683 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:18.810646    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:19.898432 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.898404    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"]
Jul 30 19:43:19.898777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.898663    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a02e22-3cbf-4346-b91b-ed08668fe8c5" containerName="extract"
Jul 30 19:43:19.898777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.898674    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a02e22-3cbf-4346-b91b-ed08668fe8c5" containerName="extract"
Jul 30 19:43:19.898777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.898688    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a02e22-3cbf-4346-b91b-ed08668fe8c5" containerName="pull"
Jul 30 19:43:19.898777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.898693    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a02e22-3cbf-4346-b91b-ed08668fe8c5" containerName="pull"
Jul 30 19:43:19.898777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.898705    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a02e22-3cbf-4346-b91b-ed08668fe8c5" containerName="util"
Jul 30 19:43:19.898777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.898714    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a02e22-3cbf-4346-b91b-ed08668fe8c5" containerName="util"
Jul 30 19:43:19.898777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.898772    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4a02e22-3cbf-4346-b91b-ed08668fe8c5" containerName="extract"
Jul 30 19:43:19.933172 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.933142    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"]
Jul 30 19:43:19.933311 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.933246    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"
Jul 30 19:43:19.936269 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.936248    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7zh55\""
Jul 30 19:43:19.936269 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.936257    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:43:19.936496 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.936309    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 30 19:43:19.991652 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.991627    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/298e1759-f5ff-4e3f-b264-9729db411085-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lxbt\" (UID: \"298e1759-f5ff-4e3f-b264-9729db411085\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"
Jul 30 19:43:19.991760 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:19.991663    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8vgc\" (UniqueName: \"kubernetes.io/projected/298e1759-f5ff-4e3f-b264-9729db411085-kube-api-access-s8vgc\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lxbt\" (UID: \"298e1759-f5ff-4e3f-b264-9729db411085\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"
Jul 30 19:43:20.092446 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:20.092421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/298e1759-f5ff-4e3f-b264-9729db411085-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lxbt\" (UID: \"298e1759-f5ff-4e3f-b264-9729db411085\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"
Jul 30 19:43:20.092566 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:20.092463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8vgc\" (UniqueName: \"kubernetes.io/projected/298e1759-f5ff-4e3f-b264-9729db411085-kube-api-access-s8vgc\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lxbt\" (UID: \"298e1759-f5ff-4e3f-b264-9729db411085\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"
Jul 30 19:43:20.092854 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:20.092836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/298e1759-f5ff-4e3f-b264-9729db411085-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lxbt\" (UID: \"298e1759-f5ff-4e3f-b264-9729db411085\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"
Jul 30 19:43:20.105558 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:20.105537    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8vgc\" (UniqueName: \"kubernetes.io/projected/298e1759-f5ff-4e3f-b264-9729db411085-kube-api-access-s8vgc\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lxbt\" (UID: \"298e1759-f5ff-4e3f-b264-9729db411085\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"
Jul 30 19:43:20.242393 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:20.242336    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"
Jul 30 19:43:20.391171 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:20.391138    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt"]
Jul 30 19:43:20.394260 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:43:20.394232    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298e1759_f5ff_4e3f_b264_9729db411085.slice/crio-4e812c2dae51dd221b32a83af9e3f88cf81f53a3637fdaae453cfb8e2be0dca4 WatchSource:0}: Error finding container 4e812c2dae51dd221b32a83af9e3f88cf81f53a3637fdaae453cfb8e2be0dca4: Status 404 returned error can't find the container with id 4e812c2dae51dd221b32a83af9e3f88cf81f53a3637fdaae453cfb8e2be0dca4
Jul 30 19:43:21.022380 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:21.022344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt" event={"ID":"298e1759-f5ff-4e3f-b264-9729db411085","Type":"ContainerStarted","Data":"4e812c2dae51dd221b32a83af9e3f88cf81f53a3637fdaae453cfb8e2be0dca4"}
Jul 30 19:43:21.557296 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:21.557252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:21.656163 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:21.656128    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:23.038119 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.038034    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt" event={"ID":"298e1759-f5ff-4e3f-b264-9729db411085","Type":"ContainerStarted","Data":"40651917e118dd6587fe9b177a2d79a40ac0b92c5eb52605b695ef4feb336299"}
Jul 30 19:43:23.057675 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.057623    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lxbt" podStartSLOduration=1.804071182 podStartE2EDuration="4.057608468s" totalImagesPullingTime="2.253537286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:43:23.055650807 +0000 UTC m=+245.696065911" watchObservedRunningTime="2026-07-30 19:43:23.057608468 +0000 UTC m=+245.698023549"
Jul 30 19:43:23.400026 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.399992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:23.506056 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.506025    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:23.617069 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.617038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:23.725526 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.725460    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:23.862747 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.862714    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"]
Jul 30 19:43:23.886957 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.886930    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"]
Jul 30 19:43:23.887079 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.887039    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:23.890033 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.890014    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 19:43:23.890118 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.890098    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 19:43:23.891252 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:23.891237    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8nb6p\""
Jul 30 19:43:24.021139 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.021078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:24.021139 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.021110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:24.021256 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.021157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4f47\" (UniqueName: \"kubernetes.io/projected/d6bde251-0a09-4701-a38c-9b499f7ff057-kube-api-access-p4f47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:24.122032 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.122010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:24.122461 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.122054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:24.122461 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.122128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4f47\" (UniqueName: \"kubernetes.io/projected/d6bde251-0a09-4701-a38c-9b499f7ff057-kube-api-access-p4f47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:24.122461 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.122432    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:24.122616 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.122528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:24.132520 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.132498    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4f47\" (UniqueName: \"kubernetes.io/projected/d6bde251-0a09-4701-a38c-9b499f7ff057-kube-api-access-p4f47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:24.196442 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.196416    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:24.320635 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:24.320615    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"]
Jul 30 19:43:24.323164 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:43:24.323135    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6bde251_0a09_4701_a38c_9b499f7ff057.slice/crio-4db8590302a4ea3c825780aca38175bd079c4e09326c49ad1e11a6bdb2a6aa64 WatchSource:0}: Error finding container 4db8590302a4ea3c825780aca38175bd079c4e09326c49ad1e11a6bdb2a6aa64: Status 404 returned error can't find the container with id 4db8590302a4ea3c825780aca38175bd079c4e09326c49ad1e11a6bdb2a6aa64
Jul 30 19:43:25.048817 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:25.048789    2561 generic.go:356] "Generic (PLEG): container finished" podID="d6bde251-0a09-4701-a38c-9b499f7ff057" containerID="bcc32ed7d134af7322010aac7536b7be057b5543d00436070dafb2b6cbec9c8f" exitCode=0
Jul 30 19:43:25.048974 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:25.048880    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl" event={"ID":"d6bde251-0a09-4701-a38c-9b499f7ff057","Type":"ContainerDied","Data":"bcc32ed7d134af7322010aac7536b7be057b5543d00436070dafb2b6cbec9c8f"}
Jul 30 19:43:25.048974 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:25.048957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl" event={"ID":"d6bde251-0a09-4701-a38c-9b499f7ff057","Type":"ContainerStarted","Data":"4db8590302a4ea3c825780aca38175bd079c4e09326c49ad1e11a6bdb2a6aa64"}
Jul 30 19:43:26.003174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:26.003143    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:26.201094 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:26.201061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:28.062526 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:28.062491    2561 generic.go:356] "Generic (PLEG): container finished" podID="d6bde251-0a09-4701-a38c-9b499f7ff057" containerID="74e530cec8e942d7df12de0fd2eacbd9717b699864782a7ec7f1f4eccdff39af" exitCode=0
Jul 30 19:43:28.062866 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:28.062566    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl" event={"ID":"d6bde251-0a09-4701-a38c-9b499f7ff057","Type":"ContainerDied","Data":"74e530cec8e942d7df12de0fd2eacbd9717b699864782a7ec7f1f4eccdff39af"}
Jul 30 19:43:28.347471 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:28.347409    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:28.407560 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:28.407532    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:29.068758 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:29.068729    2561 generic.go:356] "Generic (PLEG): container finished" podID="d6bde251-0a09-4701-a38c-9b499f7ff057" containerID="c62f4be64b62b4deca71fc82ffaedac642230c9ab52dcbf5187450486294422a" exitCode=0
Jul 30 19:43:29.069145 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:29.068779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl" event={"ID":"d6bde251-0a09-4701-a38c-9b499f7ff057","Type":"ContainerDied","Data":"c62f4be64b62b4deca71fc82ffaedac642230c9ab52dcbf5187450486294422a"}
Jul 30 19:43:30.194312 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:30.194286    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:30.267286 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:30.267259    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-util\") pod \"d6bde251-0a09-4701-a38c-9b499f7ff057\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") "
Jul 30 19:43:30.267424 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:30.267324    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4f47\" (UniqueName: \"kubernetes.io/projected/d6bde251-0a09-4701-a38c-9b499f7ff057-kube-api-access-p4f47\") pod \"d6bde251-0a09-4701-a38c-9b499f7ff057\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") "
Jul 30 19:43:30.267424 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:30.267391    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-bundle\") pod \"d6bde251-0a09-4701-a38c-9b499f7ff057\" (UID: \"d6bde251-0a09-4701-a38c-9b499f7ff057\") "
Jul 30 19:43:30.267739 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:30.267714    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-bundle" (OuterVolumeSpecName: "bundle") pod "d6bde251-0a09-4701-a38c-9b499f7ff057" (UID: "d6bde251-0a09-4701-a38c-9b499f7ff057"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:43:30.269204 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:30.269179    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6bde251-0a09-4701-a38c-9b499f7ff057-kube-api-access-p4f47" (OuterVolumeSpecName: "kube-api-access-p4f47") pod "d6bde251-0a09-4701-a38c-9b499f7ff057" (UID: "d6bde251-0a09-4701-a38c-9b499f7ff057"). InnerVolumeSpecName "kube-api-access-p4f47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:43:30.271923 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:30.271873    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-util" (OuterVolumeSpecName: "util") pod "d6bde251-0a09-4701-a38c-9b499f7ff057" (UID: "d6bde251-0a09-4701-a38c-9b499f7ff057"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:43:30.368661 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:30.368615    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-bundle\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:43:30.368661 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:30.368633    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6bde251-0a09-4701-a38c-9b499f7ff057-util\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:43:30.368661 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:30.368643    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4f47\" (UniqueName: \"kubernetes.io/projected/d6bde251-0a09-4701-a38c-9b499f7ff057-kube-api-access-p4f47\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:43:31.079074 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.079042    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl"
Jul 30 19:43:31.079074 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.079064    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzkrl" event={"ID":"d6bde251-0a09-4701-a38c-9b499f7ff057","Type":"ContainerDied","Data":"4db8590302a4ea3c825780aca38175bd079c4e09326c49ad1e11a6bdb2a6aa64"}
Jul 30 19:43:31.079280 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.079106    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4db8590302a4ea3c825780aca38175bd079c4e09326c49ad1e11a6bdb2a6aa64"
Jul 30 19:43:31.242941 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.242913    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:31.437472 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.437440    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:31.684224 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.684193    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5skt8"]
Jul 30 19:43:31.684527 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.684512    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6bde251-0a09-4701-a38c-9b499f7ff057" containerName="util"
Jul 30 19:43:31.684571 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.684529    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6bde251-0a09-4701-a38c-9b499f7ff057" containerName="util"
Jul 30 19:43:31.684571 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.684540    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6bde251-0a09-4701-a38c-9b499f7ff057" containerName="extract"
Jul 30 19:43:31.684571 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.684547    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6bde251-0a09-4701-a38c-9b499f7ff057" containerName="extract"
Jul 30 19:43:31.684571 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.684568    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6bde251-0a09-4701-a38c-9b499f7ff057" containerName="pull"
Jul 30 19:43:31.684695 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.684574    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6bde251-0a09-4701-a38c-9b499f7ff057" containerName="pull"
Jul 30 19:43:31.684695 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.684627    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6bde251-0a09-4701-a38c-9b499f7ff057" containerName="extract"
Jul 30 19:43:31.688959 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.688918    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8"
Jul 30 19:43:31.691750 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.691727    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 19:43:31.693166 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.693133    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 19:43:31.693302 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.693153    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rghxk\""
Jul 30 19:43:31.695370 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.695346    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5skt8"]
Jul 30 19:43:31.778966 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.778939    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bb7660c-ea97-4203-a94b-c10a87f4f253-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5skt8\" (UID: \"2bb7660c-ea97-4203-a94b-c10a87f4f253\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8"
Jul 30 19:43:31.779097 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.778995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llbvc\" (UniqueName: \"kubernetes.io/projected/2bb7660c-ea97-4203-a94b-c10a87f4f253-kube-api-access-llbvc\") pod \"cert-manager-webhook-6486ffd997-5skt8\" (UID: \"2bb7660c-ea97-4203-a94b-c10a87f4f253\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8"
Jul 30 19:43:31.879278 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.879249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bb7660c-ea97-4203-a94b-c10a87f4f253-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5skt8\" (UID: \"2bb7660c-ea97-4203-a94b-c10a87f4f253\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8"
Jul 30 19:43:31.879382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.879288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llbvc\" (UniqueName: \"kubernetes.io/projected/2bb7660c-ea97-4203-a94b-c10a87f4f253-kube-api-access-llbvc\") pod \"cert-manager-webhook-6486ffd997-5skt8\" (UID: \"2bb7660c-ea97-4203-a94b-c10a87f4f253\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8"
Jul 30 19:43:31.888240 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.888214    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bb7660c-ea97-4203-a94b-c10a87f4f253-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5skt8\" (UID: \"2bb7660c-ea97-4203-a94b-c10a87f4f253\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8"
Jul 30 19:43:31.888348 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:31.888289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llbvc\" (UniqueName: \"kubernetes.io/projected/2bb7660c-ea97-4203-a94b-c10a87f4f253-kube-api-access-llbvc\") pod \"cert-manager-webhook-6486ffd997-5skt8\" (UID: \"2bb7660c-ea97-4203-a94b-c10a87f4f253\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8"
Jul 30 19:43:32.019365 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:32.019304    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8"
Jul 30 19:43:32.147947 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:32.146193    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5skt8"]
Jul 30 19:43:32.149025 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:43:32.148508    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bb7660c_ea97_4203_a94b_c10a87f4f253.slice/crio-62d5b4d5554d0223bc3ab9e64af93317940ebbde3ef948381a46ef047c98e98b WatchSource:0}: Error finding container 62d5b4d5554d0223bc3ab9e64af93317940ebbde3ef948381a46ef047c98e98b: Status 404 returned error can't find the container with id 62d5b4d5554d0223bc3ab9e64af93317940ebbde3ef948381a46ef047c98e98b
Jul 30 19:43:33.090545 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:33.090507    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8" event={"ID":"2bb7660c-ea97-4203-a94b-c10a87f4f253","Type":"ContainerStarted","Data":"62d5b4d5554d0223bc3ab9e64af93317940ebbde3ef948381a46ef047c98e98b"}
Jul 30 19:43:33.798160 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:33.798129    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:34.757260 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:34.757240    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:34.853611 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:34.853584    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:34.988607 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:34.988551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:35.040348 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:35.040323    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:35.100559 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:35.100534    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8" event={"ID":"2bb7660c-ea97-4203-a94b-c10a87f4f253","Type":"ContainerStarted","Data":"af198acaf0cc723c30b7cc8af3f76c414a780becdcdbb575b28f41fa5c6b17b0"}
Jul 30 19:43:35.100683 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:35.100667    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8"
Jul 30 19:43:35.117024 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:35.116984    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8" podStartSLOduration=1.570243474 podStartE2EDuration="4.116970934s" totalImagesPullingTime="2.54672746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:43:35.115684332 +0000 UTC m=+257.756099413" watchObservedRunningTime="2026-07-30 19:43:35.116970934 +0000 UTC m=+257.757386016"
Jul 30 19:43:36.774930 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:36.774896    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"]
Jul 30 19:43:36.778103 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:36.778086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"
Jul 30 19:43:36.780848 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:36.780823    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:43:36.781133 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:36.781113    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 19:43:36.781197 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:36.781114    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8x5zt\""
Jul 30 19:43:36.787220 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:36.787183    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"]
Jul 30 19:43:36.916382 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:36.916352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmzfp\" (UniqueName: \"kubernetes.io/projected/2f836985-301d-4bcf-9f6d-ea6f35f2d454-kube-api-access-rmzfp\") pod \"openshift-lws-operator-fd8ccff4c-k92kp\" (UID: \"2f836985-301d-4bcf-9f6d-ea6f35f2d454\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"
Jul 30 19:43:36.916480 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:36.916388    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f836985-301d-4bcf-9f6d-ea6f35f2d454-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k92kp\" (UID: \"2f836985-301d-4bcf-9f6d-ea6f35f2d454\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"
Jul 30 19:43:37.016862 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:37.016834    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f836985-301d-4bcf-9f6d-ea6f35f2d454-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k92kp\" (UID: \"2f836985-301d-4bcf-9f6d-ea6f35f2d454\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"
Jul 30 19:43:37.016997 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:37.016916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmzfp\" (UniqueName: \"kubernetes.io/projected/2f836985-301d-4bcf-9f6d-ea6f35f2d454-kube-api-access-rmzfp\") pod \"openshift-lws-operator-fd8ccff4c-k92kp\" (UID: \"2f836985-301d-4bcf-9f6d-ea6f35f2d454\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"
Jul 30 19:43:37.017254 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:37.017231    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f836985-301d-4bcf-9f6d-ea6f35f2d454-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k92kp\" (UID: \"2f836985-301d-4bcf-9f6d-ea6f35f2d454\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"
Jul 30 19:43:37.026876 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:37.026819    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmzfp\" (UniqueName: \"kubernetes.io/projected/2f836985-301d-4bcf-9f6d-ea6f35f2d454-kube-api-access-rmzfp\") pod \"openshift-lws-operator-fd8ccff4c-k92kp\" (UID: \"2f836985-301d-4bcf-9f6d-ea6f35f2d454\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"
Jul 30 19:43:37.087907 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:37.087867    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"
Jul 30 19:43:37.228423 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:37.228394    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp"]
Jul 30 19:43:37.231169 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:43:37.231144    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f836985_301d_4bcf_9f6d_ea6f35f2d454.slice/crio-08ab8af8b391935b674be2dab5f628afc2214e785e61b6f812b24dc4ecccb7c4 WatchSource:0}: Error finding container 08ab8af8b391935b674be2dab5f628afc2214e785e61b6f812b24dc4ecccb7c4: Status 404 returned error can't find the container with id 08ab8af8b391935b674be2dab5f628afc2214e785e61b6f812b24dc4ecccb7c4
Jul 30 19:43:38.117253 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:38.117216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp" event={"ID":"2f836985-301d-4bcf-9f6d-ea6f35f2d454","Type":"ContainerStarted","Data":"08ab8af8b391935b674be2dab5f628afc2214e785e61b6f812b24dc4ecccb7c4"}
Jul 30 19:43:39.122995 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:39.122923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp" event={"ID":"2f836985-301d-4bcf-9f6d-ea6f35f2d454","Type":"ContainerStarted","Data":"6472ad2f4a42c38b1156f138de938bddca579d9b4177beb79de36b19f5408265"}
Jul 30 19:43:39.147878 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:39.147811    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k92kp" podStartSLOduration=1.687643379 podStartE2EDuration="3.147792865s" totalImagesPullingTime="1.460149486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:43:39.146792612 +0000 UTC m=+261.787207693" watchObservedRunningTime="2026-07-30 19:43:39.147792865 +0000 UTC m=+261.788207946"
Jul 30 19:43:39.807932 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:39.807848    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:39.912379 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:39.912346    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:40.297839 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:40.297770    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:41.107234 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.107205    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5skt8"
Jul 30 19:43:41.563413 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.563384    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:41.820841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.820772    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"]
Jul 30 19:43:41.824087 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.824071    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:41.826934 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.826916    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 19:43:41.828296 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.828274    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 19:43:41.828400 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.828329    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8nb6p\""
Jul 30 19:43:41.832777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.832719    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"]
Jul 30 19:43:41.950608 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.950583    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:41.950727 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.950618    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch5wz\" (UniqueName: \"kubernetes.io/projected/16b730dc-4425-45bc-a972-c6430584bda2-kube-api-access-ch5wz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:41.950727 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:41.950710    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:42.051336 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:42.051311    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:42.051425 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:42.051349    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:42.051425 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:42.051375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch5wz\" (UniqueName: \"kubernetes.io/projected/16b730dc-4425-45bc-a972-c6430584bda2-kube-api-access-ch5wz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:42.051650 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:42.051634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:42.051736 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:42.051720    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:42.059617 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:42.059593    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch5wz\" (UniqueName: \"kubernetes.io/projected/16b730dc-4425-45bc-a972-c6430584bda2-kube-api-access-ch5wz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:42.133508 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:42.133482    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:42.260601 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:42.260571    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"]
Jul 30 19:43:42.262918 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:43:42.262879    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b730dc_4425_45bc_a972_c6430584bda2.slice/crio-fec08706998b03af1a7d4ce3a3a7a9db5d67d2d1c1bb44a6dcba69e79765925a WatchSource:0}: Error finding container fec08706998b03af1a7d4ce3a3a7a9db5d67d2d1c1bb44a6dcba69e79765925a: Status 404 returned error can't find the container with id fec08706998b03af1a7d4ce3a3a7a9db5d67d2d1c1bb44a6dcba69e79765925a
Jul 30 19:43:43.144290 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:43.144260    2561 generic.go:356] "Generic (PLEG): container finished" podID="16b730dc-4425-45bc-a972-c6430584bda2" containerID="7de343fa93090f4613a245d8aed7cd777684559816e973a4a63a31da8b97ee56" exitCode=0
Jul 30 19:43:43.144612 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:43.144349    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z" event={"ID":"16b730dc-4425-45bc-a972-c6430584bda2","Type":"ContainerDied","Data":"7de343fa93090f4613a245d8aed7cd777684559816e973a4a63a31da8b97ee56"}
Jul 30 19:43:43.144612 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:43.144394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z" event={"ID":"16b730dc-4425-45bc-a972-c6430584bda2","Type":"ContainerStarted","Data":"fec08706998b03af1a7d4ce3a3a7a9db5d67d2d1c1bb44a6dcba69e79765925a"}
Jul 30 19:43:44.150316 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:44.150288    2561 generic.go:356] "Generic (PLEG): container finished" podID="16b730dc-4425-45bc-a972-c6430584bda2" containerID="cb856f717959435a70afc43c61b4722edb591ac09964b3f9fb224ffc72c175ef" exitCode=0
Jul 30 19:43:44.150632 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:44.150368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z" event={"ID":"16b730dc-4425-45bc-a972-c6430584bda2","Type":"ContainerDied","Data":"cb856f717959435a70afc43c61b4722edb591ac09964b3f9fb224ffc72c175ef"}
Jul 30 19:43:45.157398 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:45.157358    2561 generic.go:356] "Generic (PLEG): container finished" podID="16b730dc-4425-45bc-a972-c6430584bda2" containerID="d08c46eb611badab6853965edd05eb22a9a5e517e714edb16d46719dc0ae9911" exitCode=0
Jul 30 19:43:45.157751 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:45.157411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z" event={"ID":"16b730dc-4425-45bc-a972-c6430584bda2","Type":"ContainerDied","Data":"d08c46eb611badab6853965edd05eb22a9a5e517e714edb16d46719dc0ae9911"}
Jul 30 19:43:46.285646 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:46.285624    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:46.381071 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:46.381046    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-bundle\") pod \"16b730dc-4425-45bc-a972-c6430584bda2\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") "
Jul 30 19:43:46.381224 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:46.381081    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch5wz\" (UniqueName: \"kubernetes.io/projected/16b730dc-4425-45bc-a972-c6430584bda2-kube-api-access-ch5wz\") pod \"16b730dc-4425-45bc-a972-c6430584bda2\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") "
Jul 30 19:43:46.381224 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:46.381105    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-util\") pod \"16b730dc-4425-45bc-a972-c6430584bda2\" (UID: \"16b730dc-4425-45bc-a972-c6430584bda2\") "
Jul 30 19:43:46.381772 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:46.381737    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-bundle" (OuterVolumeSpecName: "bundle") pod "16b730dc-4425-45bc-a972-c6430584bda2" (UID: "16b730dc-4425-45bc-a972-c6430584bda2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:43:46.383127 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:46.383092    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b730dc-4425-45bc-a972-c6430584bda2-kube-api-access-ch5wz" (OuterVolumeSpecName: "kube-api-access-ch5wz") pod "16b730dc-4425-45bc-a972-c6430584bda2" (UID: "16b730dc-4425-45bc-a972-c6430584bda2"). InnerVolumeSpecName "kube-api-access-ch5wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:43:46.387329 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:46.387294    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-util" (OuterVolumeSpecName: "util") pod "16b730dc-4425-45bc-a972-c6430584bda2" (UID: "16b730dc-4425-45bc-a972-c6430584bda2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:43:46.482630 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:46.482572    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-bundle\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:43:46.482630 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:46.482595    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch5wz\" (UniqueName: \"kubernetes.io/projected/16b730dc-4425-45bc-a972-c6430584bda2-kube-api-access-ch5wz\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:43:46.482630 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:46.482605    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16b730dc-4425-45bc-a972-c6430584bda2-util\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:43:47.169662 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:47.169630    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z"
Jul 30 19:43:47.169840 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:47.169617    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb5t7z" event={"ID":"16b730dc-4425-45bc-a972-c6430584bda2","Type":"ContainerDied","Data":"fec08706998b03af1a7d4ce3a3a7a9db5d67d2d1c1bb44a6dcba69e79765925a"}
Jul 30 19:43:47.169840 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:47.169755    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fec08706998b03af1a7d4ce3a3a7a9db5d67d2d1c1bb44a6dcba69e79765925a"
Jul 30 19:43:56.045084 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.045054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:56.144584 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.144558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:56.662874 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.662823    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:56.824425 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.824394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:56.927084 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.927008    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:56.949474 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.949440    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"]
Jul 30 19:43:56.949773 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.949762    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b730dc-4425-45bc-a972-c6430584bda2" containerName="pull"
Jul 30 19:43:56.949811 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.949775    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b730dc-4425-45bc-a972-c6430584bda2" containerName="pull"
Jul 30 19:43:56.949811 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.949783    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b730dc-4425-45bc-a972-c6430584bda2" containerName="extract"
Jul 30 19:43:56.949811 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.949789    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b730dc-4425-45bc-a972-c6430584bda2" containerName="extract"
Jul 30 19:43:56.949811 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.949800    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b730dc-4425-45bc-a972-c6430584bda2" containerName="util"
Jul 30 19:43:56.949811 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.949805    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b730dc-4425-45bc-a972-c6430584bda2" containerName="util"
Jul 30 19:43:56.950012 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.949853    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="16b730dc-4425-45bc-a972-c6430584bda2" containerName="extract"
Jul 30 19:43:56.956174 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.956156    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:56.959260 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.959236    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 19:43:56.959260 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.959258    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 19:43:56.959420 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.959240    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t962t\""
Jul 30 19:43:56.959420 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.959241    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 19:43:56.959420 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.959274    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 19:43:56.968703 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:56.968682    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"]
Jul 30 19:43:57.056222 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.056198    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7cv\" (UniqueName: \"kubernetes.io/projected/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-kube-api-access-mk7cv\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.056494 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.056234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-manifests\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.056494 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.056257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-tmp\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.056494 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.056296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.056494 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.056340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.080539 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.080517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:57.157515 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.157492    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7cv\" (UniqueName: \"kubernetes.io/projected/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-kube-api-access-mk7cv\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.157604 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.157523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-manifests\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.157604 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.157544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-tmp\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.157604 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.157561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.157713 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.157683    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.157943 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.157925    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-manifests\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.159859 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.159832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-tmp\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.159986 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.159969    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.160082 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.160013    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.165120 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.165103    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7cv\" (UniqueName: \"kubernetes.io/projected/09852a2f-9efb-4ae9-b626-6b3b1978ea6b-kube-api-access-mk7cv\") pod \"opendatahub-operator-controller-manager-d686446bf-jtt9w\" (UID: \"09852a2f-9efb-4ae9-b626-6b3b1978ea6b\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.185370 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.185323    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:57.267320 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.267294    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:43:57.278507 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.278484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:57.378779 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.378751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:57.416824 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.416803    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"]
Jul 30 19:43:57.419517 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:43:57.419495    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09852a2f_9efb_4ae9_b626_6b3b1978ea6b.slice/crio-aa072e2e5ab5c8434ca019c17bfccf9bfc019a245d9c11fb61621c77b9a1725b WatchSource:0}: Error finding container aa072e2e5ab5c8434ca019c17bfccf9bfc019a245d9c11fb61621c77b9a1725b: Status 404 returned error can't find the container with id aa072e2e5ab5c8434ca019c17bfccf9bfc019a245d9c11fb61621c77b9a1725b
Jul 30 19:43:57.478568 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:57.478489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:43:58.220981 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:43:58.220941    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w" event={"ID":"09852a2f-9efb-4ae9-b626-6b3b1978ea6b","Type":"ContainerStarted","Data":"aa072e2e5ab5c8434ca019c17bfccf9bfc019a245d9c11fb61621c77b9a1725b"}
Jul 30 19:44:01.240772 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:01.240738    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w" event={"ID":"09852a2f-9efb-4ae9-b626-6b3b1978ea6b","Type":"ContainerStarted","Data":"e95ddf09f22b17b339a2e10032c176e96feda48fbbfc6451213b4bd3e5dc67d0"}
Jul 30 19:44:02.246617 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:02.246583    2561 generic.go:356] "Generic (PLEG): container finished" podID="09852a2f-9efb-4ae9-b626-6b3b1978ea6b" containerID="e95ddf09f22b17b339a2e10032c176e96feda48fbbfc6451213b4bd3e5dc67d0" exitCode=0
Jul 30 19:44:02.246999 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:02.246622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w" event={"ID":"09852a2f-9efb-4ae9-b626-6b3b1978ea6b","Type":"ContainerDied","Data":"e95ddf09f22b17b339a2e10032c176e96feda48fbbfc6451213b4bd3e5dc67d0"}
Jul 30 19:44:03.253272 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:03.253232    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w" event={"ID":"09852a2f-9efb-4ae9-b626-6b3b1978ea6b","Type":"ContainerStarted","Data":"5e96d35cb343748071680a4111729ad782992f265d0b4ce989a136e574782902"}
Jul 30 19:44:03.253669 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:03.253325    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:44:03.277585 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:03.277538    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w" podStartSLOduration=2.752006682 podStartE2EDuration="7.27752439s" totalImagesPullingTime="3.495344296s" totalInitContainerRuntime="1.030173412s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:43:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:03.274334262 +0000 UTC m=+285.914749341" watchObservedRunningTime="2026-07-30 19:44:03.27752439 +0000 UTC m=+285.917939470"
Jul 30 19:44:07.010423 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:07.010386    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:07.137833 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:07.137801    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:14.259842 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:14.259811    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-jtt9w"
Jul 30 19:44:15.977998 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:15.977964    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:16.089748 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.089722    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:16.378621 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.378537    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:16.482679 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.482652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:16.495202 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.495177    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"]
Jul 30 19:44:16.499411 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.499393    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.502812 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.502786    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 19:44:16.504330 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.504309    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tqwgr\""
Jul 30 19:44:16.504434 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.504412    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 19:44:16.516690 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.516669    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"]
Jul 30 19:44:16.583794 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.583774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b043c5-b949-4ed8-aa93-34c8db286d2a-tls-certs\") pod \"kube-auth-proxy-75997846f9-mk9wl\" (UID: \"58b043c5-b949-4ed8-aa93-34c8db286d2a\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.583905 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.583805    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzbng\" (UniqueName: \"kubernetes.io/projected/58b043c5-b949-4ed8-aa93-34c8db286d2a-kube-api-access-zzbng\") pod \"kube-auth-proxy-75997846f9-mk9wl\" (UID: \"58b043c5-b949-4ed8-aa93-34c8db286d2a\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.583905 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.583844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58b043c5-b949-4ed8-aa93-34c8db286d2a-tmp\") pod \"kube-auth-proxy-75997846f9-mk9wl\" (UID: \"58b043c5-b949-4ed8-aa93-34c8db286d2a\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.674882 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.674849    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rvgmt"]
Jul 30 19:44:16.678807 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.678792    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:16.681554 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.681537    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 30 19:44:16.682095 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.682075    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-w72gp\""
Jul 30 19:44:16.684122 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.684103    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9r4s\" (UniqueName: \"kubernetes.io/projected/d3612b28-3e51-4860-b6e8-bb091b22ffce-kube-api-access-s9r4s\") pod \"odh-model-controller-7998c67dc4-rvgmt\" (UID: \"d3612b28-3e51-4860-b6e8-bb091b22ffce\") " pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:16.684233 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.684135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3612b28-3e51-4860-b6e8-bb091b22ffce-cert\") pod \"odh-model-controller-7998c67dc4-rvgmt\" (UID: \"d3612b28-3e51-4860-b6e8-bb091b22ffce\") " pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:16.684233 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.684165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58b043c5-b949-4ed8-aa93-34c8db286d2a-tmp\") pod \"kube-auth-proxy-75997846f9-mk9wl\" (UID: \"58b043c5-b949-4ed8-aa93-34c8db286d2a\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.684233 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.684204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b043c5-b949-4ed8-aa93-34c8db286d2a-tls-certs\") pod \"kube-auth-proxy-75997846f9-mk9wl\" (UID: \"58b043c5-b949-4ed8-aa93-34c8db286d2a\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.684390 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.684229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzbng\" (UniqueName: \"kubernetes.io/projected/58b043c5-b949-4ed8-aa93-34c8db286d2a-kube-api-access-zzbng\") pod \"kube-auth-proxy-75997846f9-mk9wl\" (UID: \"58b043c5-b949-4ed8-aa93-34c8db286d2a\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.686383 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.686365    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58b043c5-b949-4ed8-aa93-34c8db286d2a-tmp\") pod \"kube-auth-proxy-75997846f9-mk9wl\" (UID: \"58b043c5-b949-4ed8-aa93-34c8db286d2a\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.686947 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.686879    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58b043c5-b949-4ed8-aa93-34c8db286d2a-tls-certs\") pod \"kube-auth-proxy-75997846f9-mk9wl\" (UID: \"58b043c5-b949-4ed8-aa93-34c8db286d2a\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.689804 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.689779    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rvgmt"]
Jul 30 19:44:16.693199 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.693177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzbng\" (UniqueName: \"kubernetes.io/projected/58b043c5-b949-4ed8-aa93-34c8db286d2a-kube-api-access-zzbng\") pod \"kube-auth-proxy-75997846f9-mk9wl\" (UID: \"58b043c5-b949-4ed8-aa93-34c8db286d2a\") " pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.722140 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.722116    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:16.785037 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.785015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9r4s\" (UniqueName: \"kubernetes.io/projected/d3612b28-3e51-4860-b6e8-bb091b22ffce-kube-api-access-s9r4s\") pod \"odh-model-controller-7998c67dc4-rvgmt\" (UID: \"d3612b28-3e51-4860-b6e8-bb091b22ffce\") " pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:16.785120 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.785062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3612b28-3e51-4860-b6e8-bb091b22ffce-cert\") pod \"odh-model-controller-7998c67dc4-rvgmt\" (UID: \"d3612b28-3e51-4860-b6e8-bb091b22ffce\") " pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:16.785241 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:44:16.785229    2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 30 19:44:16.785292 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:44:16.785277    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3612b28-3e51-4860-b6e8-bb091b22ffce-cert podName:d3612b28-3e51-4860-b6e8-bb091b22ffce nodeName:}" failed. No retries permitted until 2026-07-30 19:44:17.285263459 +0000 UTC m=+299.925678517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d3612b28-3e51-4860-b6e8-bb091b22ffce-cert") pod "odh-model-controller-7998c67dc4-rvgmt" (UID: "d3612b28-3e51-4860-b6e8-bb091b22ffce") : secret "odh-model-controller-webhook-cert" not found
Jul 30 19:44:16.786818 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.786799    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:16.795880 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.795864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9r4s\" (UniqueName: \"kubernetes.io/projected/d3612b28-3e51-4860-b6e8-bb091b22ffce-kube-api-access-s9r4s\") pod \"odh-model-controller-7998c67dc4-rvgmt\" (UID: \"d3612b28-3e51-4860-b6e8-bb091b22ffce\") " pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:16.808638 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.808621    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"
Jul 30 19:44:16.915250 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.915205    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:16.932670 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:16.932632    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75997846f9-mk9wl"]
Jul 30 19:44:16.934732 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:44:16.934706    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b043c5_b949_4ed8_aa93_34c8db286d2a.slice/crio-eb3329fb59bbdda4863c62b54af2e14ee54d8b9fe80e0147b7a535a70cede5fb WatchSource:0}: Error finding container eb3329fb59bbdda4863c62b54af2e14ee54d8b9fe80e0147b7a535a70cede5fb: Status 404 returned error can't find the container with id eb3329fb59bbdda4863c62b54af2e14ee54d8b9fe80e0147b7a535a70cede5fb
Jul 30 19:44:17.291417 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.291344    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3612b28-3e51-4860-b6e8-bb091b22ffce-cert\") pod \"odh-model-controller-7998c67dc4-rvgmt\" (UID: \"d3612b28-3e51-4860-b6e8-bb091b22ffce\") " pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:17.293678 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.293653    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3612b28-3e51-4860-b6e8-bb091b22ffce-cert\") pod \"odh-model-controller-7998c67dc4-rvgmt\" (UID: \"d3612b28-3e51-4860-b6e8-bb091b22ffce\") " pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:17.324315 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.324287    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl" event={"ID":"58b043c5-b949-4ed8-aa93-34c8db286d2a","Type":"ContainerStarted","Data":"eb3329fb59bbdda4863c62b54af2e14ee54d8b9fe80e0147b7a535a70cede5fb"}
Jul 30 19:44:17.325876 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.325854    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:17.341201 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.341176    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvbls"]
Jul 30 19:44:17.346527 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.346510    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kvbls"
Jul 30 19:44:17.349290 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.349271    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-slv9l\""
Jul 30 19:44:17.349380 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.349353    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 30 19:44:17.364499 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.364479    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvbls"]
Jul 30 19:44:17.392550 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.392525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b536bd68-f527-4104-a93e-475514fdf197-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvbls\" (UID: \"b536bd68-f527-4104-a93e-475514fdf197\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvbls"
Jul 30 19:44:17.392633 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.392577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nktd9\" (UniqueName: \"kubernetes.io/projected/b536bd68-f527-4104-a93e-475514fdf197-kube-api-access-nktd9\") pod \"model-serving-api-54d89bd5fc-kvbls\" (UID: \"b536bd68-f527-4104-a93e-475514fdf197\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvbls"
Jul 30 19:44:17.428847 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.428825    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:17.493119 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.493098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nktd9\" (UniqueName: \"kubernetes.io/projected/b536bd68-f527-4104-a93e-475514fdf197-kube-api-access-nktd9\") pod \"model-serving-api-54d89bd5fc-kvbls\" (UID: \"b536bd68-f527-4104-a93e-475514fdf197\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvbls"
Jul 30 19:44:17.493208 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.493151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b536bd68-f527-4104-a93e-475514fdf197-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvbls\" (UID: \"b536bd68-f527-4104-a93e-475514fdf197\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvbls"
Jul 30 19:44:17.495428 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.495411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b536bd68-f527-4104-a93e-475514fdf197-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvbls\" (UID: \"b536bd68-f527-4104-a93e-475514fdf197\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvbls"
Jul 30 19:44:17.506748 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.506730    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nktd9\" (UniqueName: \"kubernetes.io/projected/b536bd68-f527-4104-a93e-475514fdf197-kube-api-access-nktd9\") pod \"model-serving-api-54d89bd5fc-kvbls\" (UID: \"b536bd68-f527-4104-a93e-475514fdf197\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvbls"
Jul 30 19:44:17.589407 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.589357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:17.656551 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.656467    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kvbls"
Jul 30 19:44:17.664643 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.664616    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"]
Jul 30 19:44:17.667280 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.667253    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:17.672459 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.672422    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.675351 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.675320    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 19:44:17.675351 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.675323    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 30 19:44:17.675510 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.675365    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 30 19:44:17.675860 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.675840    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nxlbx\""
Jul 30 19:44:17.675971 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.675882    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 30 19:44:17.680853 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.680795    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"]
Jul 30 19:44:17.696914 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.694620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.696914 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.694669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqpvf\" (UniqueName: \"kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-kube-api-access-cqpvf\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.696914 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.694717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f42b72-a3be-4d50-844b-dccac9854c49-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.696914 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.694742    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.696914 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.694796    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.696914 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.694834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.696914 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.694914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.732114 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.732020    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:17.751070 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.750975    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rvgmt"]
Jul 30 19:44:17.753382 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:44:17.753356    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3612b28_3e51_4860_b6e8_bb091b22ffce.slice/crio-9a067f137c71ab95f0ccf9d7c2e5e752dd6e2ce2ef206d48689f5d9a3a637eb6 WatchSource:0}: Error finding container 9a067f137c71ab95f0ccf9d7c2e5e752dd6e2ce2ef206d48689f5d9a3a637eb6: Status 404 returned error can't find the container with id 9a067f137c71ab95f0ccf9d7c2e5e752dd6e2ce2ef206d48689f5d9a3a637eb6
Jul 30 19:44:17.793578 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.793545    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:44:17.798100 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.795969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqpvf\" (UniqueName: \"kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-kube-api-access-cqpvf\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.798100 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.796013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f42b72-a3be-4d50-844b-dccac9854c49-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.798100 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.796040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.798100 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.796083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.798100 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.796139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.798100 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.796187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.798100 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.796237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.799031 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.798860    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 30 19:44:17.799231 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.799208    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:44:17.799470 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.799449    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 30 19:44:17.799771 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.799751    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 30 19:44:17.799951 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.799759    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 19:44:17.800920 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.800871    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f42b72-a3be-4d50-844b-dccac9854c49-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.804635 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.804610    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqpvf\" (UniqueName: \"kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-kube-api-access-cqpvf\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.806683 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.806662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.807102 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.807077    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.810272 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.810250    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.810740 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.810702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.811542 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.811519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-z46sx\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:17.812533 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.812515    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:44:17.813957 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.813935    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:44:17.817527 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.817475    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 19:44:17.819462 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.819442    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvbls"]
Jul 30 19:44:17.820450 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:44:17.820336    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb536bd68_f527_4104_a93e_475514fdf197.slice/crio-2e053ae8559f8714958aad314c5f7cbbc92206da62770116650c02b3a16fa8c3 WatchSource:0}: Error finding container 2e053ae8559f8714958aad314c5f7cbbc92206da62770116650c02b3a16fa8c3: Status 404 returned error can't find the container with id 2e053ae8559f8714958aad314c5f7cbbc92206da62770116650c02b3a16fa8c3
Jul 30 19:44:17.987669 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.987645    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nxlbx\""
Jul 30 19:44:17.996138 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:17.996118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:18.141925 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:18.141901    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"]
Jul 30 19:44:18.143874 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:44:18.143852    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f42b72_a3be_4d50_844b_dccac9854c49.slice/crio-ded50e56043262727ed27bb1d00083851040dfa70680dd4ec4911f7ce581b560 WatchSource:0}: Error finding container ded50e56043262727ed27bb1d00083851040dfa70680dd4ec4911f7ce581b560: Status 404 returned error can't find the container with id ded50e56043262727ed27bb1d00083851040dfa70680dd4ec4911f7ce581b560
Jul 30 19:44:18.331966 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:18.331934    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx" event={"ID":"37f42b72-a3be-4d50-844b-dccac9854c49","Type":"ContainerStarted","Data":"ded50e56043262727ed27bb1d00083851040dfa70680dd4ec4911f7ce581b560"}
Jul 30 19:44:18.333190 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:18.333165    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kvbls" event={"ID":"b536bd68-f527-4104-a93e-475514fdf197","Type":"ContainerStarted","Data":"2e053ae8559f8714958aad314c5f7cbbc92206da62770116650c02b3a16fa8c3"}
Jul 30 19:44:18.334466 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:18.334439    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt" event={"ID":"d3612b28-3e51-4860-b6e8-bb091b22ffce","Type":"ContainerStarted","Data":"9a067f137c71ab95f0ccf9d7c2e5e752dd6e2ce2ef206d48689f5d9a3a637eb6"}
Jul 30 19:44:18.573445 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:18.573405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:22.603453 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:22.603422    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 19:44:22.610679 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:22.610650    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Jul 30 19:44:22.610776 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:22.610708    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Jul 30 19:44:23.364566 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.364533    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx" event={"ID":"37f42b72-a3be-4d50-844b-dccac9854c49","Type":"ContainerStarted","Data":"b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1"}
Jul 30 19:44:23.364744 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.364668    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:23.366214 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.366178    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kvbls" event={"ID":"b536bd68-f527-4104-a93e-475514fdf197","Type":"ContainerStarted","Data":"d577dac85e4c0257a871290dc3fc009fbaf8012f57150b1911666fa94f472c40"}
Jul 30 19:44:23.366349 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.366225    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-z46sx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 19:44:23.366349 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.366261    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx" podUID="37f42b72-a3be-4d50-844b-dccac9854c49" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 19:44:23.366349 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.366307    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-kvbls"
Jul 30 19:44:23.367564 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.367544    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt" event={"ID":"d3612b28-3e51-4860-b6e8-bb091b22ffce","Type":"ContainerStarted","Data":"e4eb00f3ae7b0d2f08e9666c2a25096026bf4f26825c6d79112a5fc23d30a8b6"}
Jul 30 19:44:23.367662 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.367648    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:23.369310 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.369290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl" event={"ID":"58b043c5-b949-4ed8-aa93-34c8db286d2a","Type":"ContainerStarted","Data":"bb56848d857e19f2a5b5d7c53569f262d95ecf81657ee0aecae8c1b079a94bb6"}
Jul 30 19:44:23.429563 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.429504    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx" podStartSLOduration=1.964864043 podStartE2EDuration="6.42948311s" totalImagesPullingTime="4.464619067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:23.426569003 +0000 UTC m=+306.066984085" watchObservedRunningTime="2026-07-30 19:44:23.42948311 +0000 UTC m=+306.069898190"
Jul 30 19:44:23.459508 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.459437    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt" podStartSLOduration=2.597494653 podStartE2EDuration="7.459414687s" totalImagesPullingTime="4.861920034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:23.457361363 +0000 UTC m=+306.097776442" watchObservedRunningTime="2026-07-30 19:44:23.459414687 +0000 UTC m=+306.099829772"
Jul 30 19:44:23.492393 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.492331    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-kvbls" podStartSLOduration=1.7144340329999999 podStartE2EDuration="6.492312823s" totalImagesPullingTime="4.77787879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:23.491581933 +0000 UTC m=+306.131997015" watchObservedRunningTime="2026-07-30 19:44:23.492312823 +0000 UTC m=+306.132727905"
Jul 30 19:44:23.506795 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.506766    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:23.514408 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:23.514369    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75997846f9-mk9wl" podStartSLOduration=1.8504838449999998 podStartE2EDuration="7.514355821s" totalImagesPullingTime="5.663871976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:23.513683343 +0000 UTC m=+306.154098422" watchObservedRunningTime="2026-07-30 19:44:23.514355821 +0000 UTC m=+306.154770897"
Jul 30 19:44:24.374686 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:24.374642    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:24.787017 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:24.786983    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:25.562921 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.562873    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"]
Jul 30 19:44:25.566346 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.566329    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.571335 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.571313    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 19:44:25.572656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.572630    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s2cxg\""
Jul 30 19:44:25.572656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.572646    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 19:44:25.572856 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.572745    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 19:44:25.590800 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.590772    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"]
Jul 30 19:44:25.664486 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.664460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/312eb697-5cce-462c-a45a-68e4ea890d44-manager-config\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.664629 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.664504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/312eb697-5cce-462c-a45a-68e4ea890d44-metrics-cert\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.664629 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.664537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/312eb697-5cce-462c-a45a-68e4ea890d44-cert\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.664629 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.664565    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2xxm\" (UniqueName: \"kubernetes.io/projected/312eb697-5cce-462c-a45a-68e4ea890d44-kube-api-access-f2xxm\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.765754 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.765728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/312eb697-5cce-462c-a45a-68e4ea890d44-manager-config\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.765982 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.765764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/312eb697-5cce-462c-a45a-68e4ea890d44-metrics-cert\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.765982 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.765793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/312eb697-5cce-462c-a45a-68e4ea890d44-cert\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.765982 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.765812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2xxm\" (UniqueName: \"kubernetes.io/projected/312eb697-5cce-462c-a45a-68e4ea890d44-kube-api-access-f2xxm\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.766473 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.766455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/312eb697-5cce-462c-a45a-68e4ea890d44-manager-config\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.768201 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.768181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/312eb697-5cce-462c-a45a-68e4ea890d44-cert\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.768257 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.768240    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/312eb697-5cce-462c-a45a-68e4ea890d44-metrics-cert\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.778138 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.778113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2xxm\" (UniqueName: \"kubernetes.io/projected/312eb697-5cce-462c-a45a-68e4ea890d44-kube-api-access-f2xxm\") pod \"lws-controller-manager-996655b6d-jhlqt\" (UID: \"312eb697-5cce-462c-a45a-68e4ea890d44\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:25.876489 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:25.876426    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:26.019100 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:26.019072    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"]
Jul 30 19:44:26.020204 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:44:26.020183    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod312eb697_5cce_462c_a45a_68e4ea890d44.slice/crio-76406fb4074735452ac5bb62dfbf90aab126a3a09dc7de04fca99a3534e57a2c WatchSource:0}: Error finding container 76406fb4074735452ac5bb62dfbf90aab126a3a09dc7de04fca99a3534e57a2c: Status 404 returned error can't find the container with id 76406fb4074735452ac5bb62dfbf90aab126a3a09dc7de04fca99a3534e57a2c
Jul 30 19:44:26.022121 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:26.022104    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 19:44:26.279202 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:26.279152    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:26.357491 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:26.357467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:26.384460 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:26.384426    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt" event={"ID":"312eb697-5cce-462c-a45a-68e4ea890d44","Type":"ContainerStarted","Data":"76406fb4074735452ac5bb62dfbf90aab126a3a09dc7de04fca99a3534e57a2c"}
Jul 30 19:44:26.634827 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:26.634784    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:26.817570 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:26.817530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:27.583653 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:27.583623    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:27.674160 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:27.674073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:44:28.396457 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.396425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt" event={"ID":"312eb697-5cce-462c-a45a-68e4ea890d44","Type":"ContainerStarted","Data":"d202d9231428db41a39265737bed198c144297b604952319c318735f9abd3693"}
Jul 30 19:44:28.396631 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.396547    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:44:28.418875 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.418827    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt" podStartSLOduration=2.031509553 podStartE2EDuration="3.418811326s" totalImagesPullingTime="1.387301773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:28.417585043 +0000 UTC m=+311.058000123" watchObservedRunningTime="2026-07-30 19:44:28.418811326 +0000 UTC m=+311.059226406"
Jul 30 19:44:28.535290 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.535267    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"]
Jul 30 19:44:28.535436 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.535418    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx" podUID="37f42b72-a3be-4d50-844b-dccac9854c49" containerName="discovery" containerID="cri-o://b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1" gracePeriod=30
Jul 30 19:44:28.794853 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.794832    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:28.889941 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.889912    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-ca-configmap\") pod \"37f42b72-a3be-4d50-844b-dccac9854c49\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") "
Jul 30 19:44:28.890102 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.889950    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-istio-token\") pod \"37f42b72-a3be-4d50-844b-dccac9854c49\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") "
Jul 30 19:44:28.890102 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.889976    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqpvf\" (UniqueName: \"kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-kube-api-access-cqpvf\") pod \"37f42b72-a3be-4d50-844b-dccac9854c49\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") "
Jul 30 19:44:28.890102 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.890014    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f42b72-a3be-4d50-844b-dccac9854c49-local-certs\") pod \"37f42b72-a3be-4d50-844b-dccac9854c49\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") "
Jul 30 19:44:28.890102 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.890066    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-cacerts\") pod \"37f42b72-a3be-4d50-844b-dccac9854c49\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") "
Jul 30 19:44:28.890315 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.890106    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-kubeconfig\") pod \"37f42b72-a3be-4d50-844b-dccac9854c49\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") "
Jul 30 19:44:28.890315 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.890153    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-dns-cert\") pod \"37f42b72-a3be-4d50-844b-dccac9854c49\" (UID: \"37f42b72-a3be-4d50-844b-dccac9854c49\") "
Jul 30 19:44:28.890413 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.890301    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "37f42b72-a3be-4d50-844b-dccac9854c49" (UID: "37f42b72-a3be-4d50-844b-dccac9854c49"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:44:28.890582 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.890550    2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-ca-configmap\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:44:28.893400 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.893372    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f42b72-a3be-4d50-844b-dccac9854c49-local-certs" (OuterVolumeSpecName: "local-certs") pod "37f42b72-a3be-4d50-844b-dccac9854c49" (UID: "37f42b72-a3be-4d50-844b-dccac9854c49"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:44:28.893712 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.893681    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-cacerts" (OuterVolumeSpecName: "cacerts") pod "37f42b72-a3be-4d50-844b-dccac9854c49" (UID: "37f42b72-a3be-4d50-844b-dccac9854c49"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:44:28.894334 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.894056    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-kube-api-access-cqpvf" (OuterVolumeSpecName: "kube-api-access-cqpvf") pod "37f42b72-a3be-4d50-844b-dccac9854c49" (UID: "37f42b72-a3be-4d50-844b-dccac9854c49"). InnerVolumeSpecName "kube-api-access-cqpvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:44:28.894334 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.894108    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "37f42b72-a3be-4d50-844b-dccac9854c49" (UID: "37f42b72-a3be-4d50-844b-dccac9854c49"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:44:28.900865 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.900826    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "37f42b72-a3be-4d50-844b-dccac9854c49" (UID: "37f42b72-a3be-4d50-844b-dccac9854c49"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:44:28.901047 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.900911    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-istio-token" (OuterVolumeSpecName: "istio-token") pod "37f42b72-a3be-4d50-844b-dccac9854c49" (UID: "37f42b72-a3be-4d50-844b-dccac9854c49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:44:28.991154 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.991135    2561 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-kubeconfig\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:44:28.991154 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.991153    2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-istio-csr-dns-cert\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:44:28.991287 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.991163    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-istio-token\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:44:28.991287 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.991189    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqpvf\" (UniqueName: \"kubernetes.io/projected/37f42b72-a3be-4d50-844b-dccac9854c49-kube-api-access-cqpvf\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:44:28.991287 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.991198    2561 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f42b72-a3be-4d50-844b-dccac9854c49-local-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:44:28.991287 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:28.991207    2561 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/37f42b72-a3be-4d50-844b-dccac9854c49-cacerts\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:44:29.403093 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:29.403063    2561 generic.go:356] "Generic (PLEG): container finished" podID="37f42b72-a3be-4d50-844b-dccac9854c49" containerID="b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1" exitCode=0
Jul 30 19:44:29.403264 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:29.403124    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"
Jul 30 19:44:29.403264 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:29.403150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx" event={"ID":"37f42b72-a3be-4d50-844b-dccac9854c49","Type":"ContainerDied","Data":"b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1"}
Jul 30 19:44:29.403264 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:29.403230    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx" event={"ID":"37f42b72-a3be-4d50-844b-dccac9854c49","Type":"ContainerDied","Data":"ded50e56043262727ed27bb1d00083851040dfa70680dd4ec4911f7ce581b560"}
Jul 30 19:44:29.403264 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:29.403255    2561 scope.go:117] "RemoveContainer" containerID="b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1"
Jul 30 19:44:29.414987 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:29.414965    2561 scope.go:117] "RemoveContainer" containerID="b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1"
Jul 30 19:44:29.415970 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:44:29.415944    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1\": container with ID starting with b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1 not found: ID does not exist" containerID="b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1"
Jul 30 19:44:29.416095 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:29.415975    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1"} err="failed to get container status \"b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1\": rpc error: code = NotFound desc = could not find container \"b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1\": container with ID starting with b3257024636bbce0d47481e40c51443704903792d473034cb9fb90eb47ace5d1 not found: ID does not exist"
Jul 30 19:44:29.437262 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:29.437232    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"]
Jul 30 19:44:29.449972 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:29.449946    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z46sx"]
Jul 30 19:44:29.840703 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:29.840626    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f42b72-a3be-4d50-844b-dccac9854c49" path="/var/lib/kubelet/pods/37f42b72-a3be-4d50-844b-dccac9854c49/volumes"
Jul 30 19:44:34.379209 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:34.379179    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-kvbls"
Jul 30 19:44:34.423324 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:34.423299    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rvgmt"
Jul 30 19:44:39.406072 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:44:39.406042    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-996655b6d-jhlqt"
Jul 30 19:45:17.450172 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:17.450073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:17.549710 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:17.549678    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:17.633700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:17.633676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:18.386607 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:18.386574    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:18.594775 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:18.594737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:33.201707 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.201669    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"]
Jul 30 19:45:33.202177 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.201989    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f42b72-a3be-4d50-844b-dccac9854c49" containerName="discovery"
Jul 30 19:45:33.202177 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.202000    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f42b72-a3be-4d50-844b-dccac9854c49" containerName="discovery"
Jul 30 19:45:33.202177 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.202058    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f42b72-a3be-4d50-844b-dccac9854c49" containerName="discovery"
Jul 30 19:45:33.206602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.206579    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.209342 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.209318    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 19:45:33.209660 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.209634    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v42rg\""
Jul 30 19:45:33.210766 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.210744    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 19:45:33.213703 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.213682    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"]
Jul 30 19:45:33.271899 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.271855    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.272021 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.271957    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4w8d\" (UniqueName: \"kubernetes.io/projected/63f58856-8b84-4622-bc0f-f0a6e705f098-kube-api-access-n4w8d\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.272075 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.272023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.373001 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.372976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.373129 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.373021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.373129 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.373058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4w8d\" (UniqueName: \"kubernetes.io/projected/63f58856-8b84-4622-bc0f-f0a6e705f098-kube-api-access-n4w8d\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.373397 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.373377    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.373458 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.373418    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.381678 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.381659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4w8d\" (UniqueName: \"kubernetes.io/projected/63f58856-8b84-4622-bc0f-f0a6e705f098-kube-api-access-n4w8d\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.518863 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.518811    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:33.652966 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.652940    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"]
Jul 30 19:45:33.654693 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:45:33.654666    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f58856_8b84_4622_bc0f_f0a6e705f098.slice/crio-f5f34eab159221c64f3d68f11f7368b7c2980f9a82b1f33b2a41cb68320fd27c WatchSource:0}: Error finding container f5f34eab159221c64f3d68f11f7368b7c2980f9a82b1f33b2a41cb68320fd27c: Status 404 returned error can't find the container with id f5f34eab159221c64f3d68f11f7368b7c2980f9a82b1f33b2a41cb68320fd27c
Jul 30 19:45:33.734339 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.734312    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq" event={"ID":"63f58856-8b84-4622-bc0f-f0a6e705f098","Type":"ContainerStarted","Data":"0fc7f9d2478ab288540f469dcbbc0cd4d6f3e2a11c0b6e075f55fc970249b614"}
Jul 30 19:45:33.734443 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.734366    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq" event={"ID":"63f58856-8b84-4622-bc0f-f0a6e705f098","Type":"ContainerStarted","Data":"f5f34eab159221c64f3d68f11f7368b7c2980f9a82b1f33b2a41cb68320fd27c"}
Jul 30 19:45:33.794814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.794763    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"]
Jul 30 19:45:33.798101 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.798087    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:33.806047 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.806019    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"]
Jul 30 19:45:33.877626 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.877601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:33.877721 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.877641    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt76v\" (UniqueName: \"kubernetes.io/projected/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-kube-api-access-bt76v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:33.877762 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.877729    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:33.978461 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.978432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:33.978573 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.978473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:33.978644 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.978588    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt76v\" (UniqueName: \"kubernetes.io/projected/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-kube-api-access-bt76v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:33.978767 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.978748    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:33.978841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.978813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:33.987120 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:33.987101    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt76v\" (UniqueName: \"kubernetes.io/projected/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-kube-api-access-bt76v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:34.130969 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.130949    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:34.256195 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.256173    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"]
Jul 30 19:45:34.258678 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:45:34.258625    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e114f8d_dab3_43b5_bba2_52d1be3a5f98.slice/crio-21624d5342a2766b2ff79d5e34620475b9110655c2134c27fc5294fa05e5af5e WatchSource:0}: Error finding container 21624d5342a2766b2ff79d5e34620475b9110655c2134c27fc5294fa05e5af5e: Status 404 returned error can't find the container with id 21624d5342a2766b2ff79d5e34620475b9110655c2134c27fc5294fa05e5af5e
Jul 30 19:45:34.395441 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.395380    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"]
Jul 30 19:45:34.398878 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.398858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.406630 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.406610    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"]
Jul 30 19:45:34.481842 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.481816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8zrr\" (UniqueName: \"kubernetes.io/projected/c3fefcff-530e-41dc-b377-d1103127b4db-kube-api-access-h8zrr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.481981 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.481858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.482048 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.481993    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.582965 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.582936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.583058 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.583005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8zrr\" (UniqueName: \"kubernetes.io/projected/c3fefcff-530e-41dc-b377-d1103127b4db-kube-api-access-h8zrr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.583058 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.583042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.583289 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.583270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.583417 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.583397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.591876 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.591854    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8zrr\" (UniqueName: \"kubernetes.io/projected/c3fefcff-530e-41dc-b377-d1103127b4db-kube-api-access-h8zrr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.713663 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.713615    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:34.740708 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.740681    2561 generic.go:356] "Generic (PLEG): container finished" podID="63f58856-8b84-4622-bc0f-f0a6e705f098" containerID="0fc7f9d2478ab288540f469dcbbc0cd4d6f3e2a11c0b6e075f55fc970249b614" exitCode=0
Jul 30 19:45:34.741031 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.740786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq" event={"ID":"63f58856-8b84-4622-bc0f-f0a6e705f098","Type":"ContainerDied","Data":"0fc7f9d2478ab288540f469dcbbc0cd4d6f3e2a11c0b6e075f55fc970249b614"}
Jul 30 19:45:34.742587 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.742565    2561 generic.go:356] "Generic (PLEG): container finished" podID="4e114f8d-dab3-43b5-bba2-52d1be3a5f98" containerID="a2a3c8fc5641e35b8a4a1b16d07b376326800a6a494a09a6c5744d498ebd8327" exitCode=0
Jul 30 19:45:34.742676 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.742646    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k" event={"ID":"4e114f8d-dab3-43b5-bba2-52d1be3a5f98","Type":"ContainerDied","Data":"a2a3c8fc5641e35b8a4a1b16d07b376326800a6a494a09a6c5744d498ebd8327"}
Jul 30 19:45:34.742722 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.742695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k" event={"ID":"4e114f8d-dab3-43b5-bba2-52d1be3a5f98","Type":"ContainerStarted","Data":"21624d5342a2766b2ff79d5e34620475b9110655c2134c27fc5294fa05e5af5e"}
Jul 30 19:45:34.804570 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.804544    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"]
Jul 30 19:45:34.809191 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.809170    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:34.820880 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.820275    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"]
Jul 30 19:45:34.846482 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.846461    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"]
Jul 30 19:45:34.848163 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:45:34.848140    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3fefcff_530e_41dc_b377_d1103127b4db.slice/crio-9d448c02cd02a91fe31ac1f582c3ba124640769dbb48734e4535131b63c221b5 WatchSource:0}: Error finding container 9d448c02cd02a91fe31ac1f582c3ba124640769dbb48734e4535131b63c221b5: Status 404 returned error can't find the container with id 9d448c02cd02a91fe31ac1f582c3ba124640769dbb48734e4535131b63c221b5
Jul 30 19:45:34.885857 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.885831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt99j\" (UniqueName: \"kubernetes.io/projected/3375b9b7-0131-475a-822d-ab60df59a324-kube-api-access-lt99j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:34.886001 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.885877    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:34.886054 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.885992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:34.987401 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.987339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt99j\" (UniqueName: \"kubernetes.io/projected/3375b9b7-0131-475a-822d-ab60df59a324-kube-api-access-lt99j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:34.987401 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.987373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:34.987585 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.987551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:34.987698 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.987680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:34.987822 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.987804    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:34.996161 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:34.996140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt99j\" (UniqueName: \"kubernetes.io/projected/3375b9b7-0131-475a-822d-ab60df59a324-kube-api-access-lt99j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:35.122407 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.122386    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:35.248178 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.248155    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"]
Jul 30 19:45:35.249504 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:45:35.249476    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3375b9b7_0131_475a_822d_ab60df59a324.slice/crio-9c2afd06253338ddf8c95ae4a15aa2cb3d695f757350e3d66b3984c5119fa5a6 WatchSource:0}: Error finding container 9c2afd06253338ddf8c95ae4a15aa2cb3d695f757350e3d66b3984c5119fa5a6: Status 404 returned error can't find the container with id 9c2afd06253338ddf8c95ae4a15aa2cb3d695f757350e3d66b3984c5119fa5a6
Jul 30 19:45:35.749162 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.749133    2561 generic.go:356] "Generic (PLEG): container finished" podID="63f58856-8b84-4622-bc0f-f0a6e705f098" containerID="f9b2add849a7f45212696b5d6d1fdedd41078625839d0a3848f6a55d4465ae05" exitCode=0
Jul 30 19:45:35.749484 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.749221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq" event={"ID":"63f58856-8b84-4622-bc0f-f0a6e705f098","Type":"ContainerDied","Data":"f9b2add849a7f45212696b5d6d1fdedd41078625839d0a3848f6a55d4465ae05"}
Jul 30 19:45:35.751211 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.751189    2561 generic.go:356] "Generic (PLEG): container finished" podID="4e114f8d-dab3-43b5-bba2-52d1be3a5f98" containerID="e436fa5133e2bd161755010396325a803b7eac18179384428daae499c1e3a189" exitCode=0
Jul 30 19:45:35.751294 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.751241    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k" event={"ID":"4e114f8d-dab3-43b5-bba2-52d1be3a5f98","Type":"ContainerDied","Data":"e436fa5133e2bd161755010396325a803b7eac18179384428daae499c1e3a189"}
Jul 30 19:45:35.752753 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.752729    2561 generic.go:356] "Generic (PLEG): container finished" podID="3375b9b7-0131-475a-822d-ab60df59a324" containerID="ab4cd73d0ab32c84549c46c6429c5955f028116f517837015686b05ccc1d3350" exitCode=0
Jul 30 19:45:35.752857 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.752815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g" event={"ID":"3375b9b7-0131-475a-822d-ab60df59a324","Type":"ContainerDied","Data":"ab4cd73d0ab32c84549c46c6429c5955f028116f517837015686b05ccc1d3350"}
Jul 30 19:45:35.752934 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.752857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g" event={"ID":"3375b9b7-0131-475a-822d-ab60df59a324","Type":"ContainerStarted","Data":"9c2afd06253338ddf8c95ae4a15aa2cb3d695f757350e3d66b3984c5119fa5a6"}
Jul 30 19:45:35.754852 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.754835    2561 generic.go:356] "Generic (PLEG): container finished" podID="c3fefcff-530e-41dc-b377-d1103127b4db" containerID="35dfd7050678d2bd819c9f6b58a29924a73d9ea796420bc89ac626c2bcf20fa6" exitCode=0
Jul 30 19:45:35.754955 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.754918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95" event={"ID":"c3fefcff-530e-41dc-b377-d1103127b4db","Type":"ContainerDied","Data":"35dfd7050678d2bd819c9f6b58a29924a73d9ea796420bc89ac626c2bcf20fa6"}
Jul 30 19:45:35.755006 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:35.754965    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95" event={"ID":"c3fefcff-530e-41dc-b377-d1103127b4db","Type":"ContainerStarted","Data":"9d448c02cd02a91fe31ac1f582c3ba124640769dbb48734e4535131b63c221b5"}
Jul 30 19:45:36.762025 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:36.761999    2561 generic.go:356] "Generic (PLEG): container finished" podID="63f58856-8b84-4622-bc0f-f0a6e705f098" containerID="71ca439e73763706ff5b1eb75d3c383e390966928f80a15ed1256a19b6eea32c" exitCode=0
Jul 30 19:45:36.762331 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:36.762084    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq" event={"ID":"63f58856-8b84-4622-bc0f-f0a6e705f098","Type":"ContainerDied","Data":"71ca439e73763706ff5b1eb75d3c383e390966928f80a15ed1256a19b6eea32c"}
Jul 30 19:45:36.763874 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:36.763855    2561 generic.go:356] "Generic (PLEG): container finished" podID="4e114f8d-dab3-43b5-bba2-52d1be3a5f98" containerID="3e843d2d08ad34536d95f455e7c918dd93d0f727198dd5f32da4c0ae6330ecd5" exitCode=0
Jul 30 19:45:36.763975 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:36.763914    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k" event={"ID":"4e114f8d-dab3-43b5-bba2-52d1be3a5f98","Type":"ContainerDied","Data":"3e843d2d08ad34536d95f455e7c918dd93d0f727198dd5f32da4c0ae6330ecd5"}
Jul 30 19:45:36.765680 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:36.765654    2561 generic.go:356] "Generic (PLEG): container finished" podID="3375b9b7-0131-475a-822d-ab60df59a324" containerID="ff0a73c34f9ee1486a46a273fba587e1dd7f0ea2305cdb7e050c828a27f1c492" exitCode=0
Jul 30 19:45:36.765781 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:36.765731    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g" event={"ID":"3375b9b7-0131-475a-822d-ab60df59a324","Type":"ContainerDied","Data":"ff0a73c34f9ee1486a46a273fba587e1dd7f0ea2305cdb7e050c828a27f1c492"}
Jul 30 19:45:36.767437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:36.767417    2561 generic.go:356] "Generic (PLEG): container finished" podID="c3fefcff-530e-41dc-b377-d1103127b4db" containerID="10ebe3b3c32e73617a6f02ff560dc2af1acdd169c17dc6be5a50d89088f8c817" exitCode=0
Jul 30 19:45:36.767522 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:36.767474    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95" event={"ID":"c3fefcff-530e-41dc-b377-d1103127b4db","Type":"ContainerDied","Data":"10ebe3b3c32e73617a6f02ff560dc2af1acdd169c17dc6be5a50d89088f8c817"}
Jul 30 19:45:37.774873 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:37.774804    2561 generic.go:356] "Generic (PLEG): container finished" podID="3375b9b7-0131-475a-822d-ab60df59a324" containerID="e322628729c195e117a88360ac6c68257f7bfa431ae2fc36854e27dba0d754cb" exitCode=0
Jul 30 19:45:37.775258 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:37.774917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g" event={"ID":"3375b9b7-0131-475a-822d-ab60df59a324","Type":"ContainerDied","Data":"e322628729c195e117a88360ac6c68257f7bfa431ae2fc36854e27dba0d754cb"}
Jul 30 19:45:37.777173 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:37.777151    2561 generic.go:356] "Generic (PLEG): container finished" podID="c3fefcff-530e-41dc-b377-d1103127b4db" containerID="27e40e7fe2b3d681ad0083c7810eac9bd37a4c7a014d8b08e4e51e6f3efb611c" exitCode=0
Jul 30 19:45:37.777252 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:37.777231    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95" event={"ID":"c3fefcff-530e-41dc-b377-d1103127b4db","Type":"ContainerDied","Data":"27e40e7fe2b3d681ad0083c7810eac9bd37a4c7a014d8b08e4e51e6f3efb611c"}
Jul 30 19:45:37.933336 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:37.933307    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:37.936271 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:37.936250    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:38.012046 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.012008    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-bundle\") pod \"63f58856-8b84-4622-bc0f-f0a6e705f098\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") "
Jul 30 19:45:38.012046 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.012054    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-bundle\") pod \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") "
Jul 30 19:45:38.012198 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.012075    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-util\") pod \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") "
Jul 30 19:45:38.012198 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.012101    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-util\") pod \"63f58856-8b84-4622-bc0f-f0a6e705f098\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") "
Jul 30 19:45:38.012198 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.012136    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4w8d\" (UniqueName: \"kubernetes.io/projected/63f58856-8b84-4622-bc0f-f0a6e705f098-kube-api-access-n4w8d\") pod \"63f58856-8b84-4622-bc0f-f0a6e705f098\" (UID: \"63f58856-8b84-4622-bc0f-f0a6e705f098\") "
Jul 30 19:45:38.012198 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.012172    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt76v\" (UniqueName: \"kubernetes.io/projected/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-kube-api-access-bt76v\") pod \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\" (UID: \"4e114f8d-dab3-43b5-bba2-52d1be3a5f98\") "
Jul 30 19:45:38.012560 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.012530    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-bundle" (OuterVolumeSpecName: "bundle") pod "63f58856-8b84-4622-bc0f-f0a6e705f098" (UID: "63f58856-8b84-4622-bc0f-f0a6e705f098"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:45:38.012647 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.012575    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-bundle" (OuterVolumeSpecName: "bundle") pod "4e114f8d-dab3-43b5-bba2-52d1be3a5f98" (UID: "4e114f8d-dab3-43b5-bba2-52d1be3a5f98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:45:38.014418 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.014388    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-kube-api-access-bt76v" (OuterVolumeSpecName: "kube-api-access-bt76v") pod "4e114f8d-dab3-43b5-bba2-52d1be3a5f98" (UID: "4e114f8d-dab3-43b5-bba2-52d1be3a5f98"). InnerVolumeSpecName "kube-api-access-bt76v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:45:38.014494 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.014445    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63f58856-8b84-4622-bc0f-f0a6e705f098-kube-api-access-n4w8d" (OuterVolumeSpecName: "kube-api-access-n4w8d") pod "63f58856-8b84-4622-bc0f-f0a6e705f098" (UID: "63f58856-8b84-4622-bc0f-f0a6e705f098"). InnerVolumeSpecName "kube-api-access-n4w8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:45:38.018025 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.018005    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-util" (OuterVolumeSpecName: "util") pod "4e114f8d-dab3-43b5-bba2-52d1be3a5f98" (UID: "4e114f8d-dab3-43b5-bba2-52d1be3a5f98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:45:38.018359 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.018343    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-util" (OuterVolumeSpecName: "util") pod "63f58856-8b84-4622-bc0f-f0a6e705f098" (UID: "63f58856-8b84-4622-bc0f-f0a6e705f098"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:45:38.113308 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.113248    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-bundle\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:38.113308 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.113277    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-bundle\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:38.113308 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.113285    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-util\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:38.113308 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.113293    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63f58856-8b84-4622-bc0f-f0a6e705f098-util\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:38.113308 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.113302    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4w8d\" (UniqueName: \"kubernetes.io/projected/63f58856-8b84-4622-bc0f-f0a6e705f098-kube-api-access-n4w8d\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:38.113308 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.113311    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt76v\" (UniqueName: \"kubernetes.io/projected/4e114f8d-dab3-43b5-bba2-52d1be3a5f98-kube-api-access-bt76v\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:38.785181 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.785149    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq"
Jul 30 19:45:38.785607 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.785151    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq" event={"ID":"63f58856-8b84-4622-bc0f-f0a6e705f098","Type":"ContainerDied","Data":"f5f34eab159221c64f3d68f11f7368b7c2980f9a82b1f33b2a41cb68320fd27c"}
Jul 30 19:45:38.785607 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.785294    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5f34eab159221c64f3d68f11f7368b7c2980f9a82b1f33b2a41cb68320fd27c"
Jul 30 19:45:38.787427 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.787405    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k"
Jul 30 19:45:38.787427 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.787411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k" event={"ID":"4e114f8d-dab3-43b5-bba2-52d1be3a5f98","Type":"ContainerDied","Data":"21624d5342a2766b2ff79d5e34620475b9110655c2134c27fc5294fa05e5af5e"}
Jul 30 19:45:38.787653 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.787463    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21624d5342a2766b2ff79d5e34620475b9110655c2134c27fc5294fa05e5af5e"
Jul 30 19:45:38.918927 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.918903    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:38.949970 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:38.949940    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:39.019924 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.019879    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-util\") pod \"c3fefcff-530e-41dc-b377-d1103127b4db\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") "
Jul 30 19:45:39.020040 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.019940    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-util\") pod \"3375b9b7-0131-475a-822d-ab60df59a324\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") "
Jul 30 19:45:39.020040 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.019984    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt99j\" (UniqueName: \"kubernetes.io/projected/3375b9b7-0131-475a-822d-ab60df59a324-kube-api-access-lt99j\") pod \"3375b9b7-0131-475a-822d-ab60df59a324\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") "
Jul 30 19:45:39.020040 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.020036    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-bundle\") pod \"c3fefcff-530e-41dc-b377-d1103127b4db\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") "
Jul 30 19:45:39.020207 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.020076    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8zrr\" (UniqueName: \"kubernetes.io/projected/c3fefcff-530e-41dc-b377-d1103127b4db-kube-api-access-h8zrr\") pod \"c3fefcff-530e-41dc-b377-d1103127b4db\" (UID: \"c3fefcff-530e-41dc-b377-d1103127b4db\") "
Jul 30 19:45:39.020207 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.020109    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-bundle\") pod \"3375b9b7-0131-475a-822d-ab60df59a324\" (UID: \"3375b9b7-0131-475a-822d-ab60df59a324\") "
Jul 30 19:45:39.020715 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.020685    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-bundle" (OuterVolumeSpecName: "bundle") pod "3375b9b7-0131-475a-822d-ab60df59a324" (UID: "3375b9b7-0131-475a-822d-ab60df59a324"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:45:39.020808 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.020695    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-bundle" (OuterVolumeSpecName: "bundle") pod "c3fefcff-530e-41dc-b377-d1103127b4db" (UID: "c3fefcff-530e-41dc-b377-d1103127b4db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:45:39.022682 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.022653    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3fefcff-530e-41dc-b377-d1103127b4db-kube-api-access-h8zrr" (OuterVolumeSpecName: "kube-api-access-h8zrr") pod "c3fefcff-530e-41dc-b377-d1103127b4db" (UID: "c3fefcff-530e-41dc-b377-d1103127b4db"). InnerVolumeSpecName "kube-api-access-h8zrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:45:39.022757 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.022688    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3375b9b7-0131-475a-822d-ab60df59a324-kube-api-access-lt99j" (OuterVolumeSpecName: "kube-api-access-lt99j") pod "3375b9b7-0131-475a-822d-ab60df59a324" (UID: "3375b9b7-0131-475a-822d-ab60df59a324"). InnerVolumeSpecName "kube-api-access-lt99j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:45:39.025538 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.025515    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-util" (OuterVolumeSpecName: "util") pod "3375b9b7-0131-475a-822d-ab60df59a324" (UID: "3375b9b7-0131-475a-822d-ab60df59a324"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:45:39.026096 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.026078    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-util" (OuterVolumeSpecName: "util") pod "c3fefcff-530e-41dc-b377-d1103127b4db" (UID: "c3fefcff-530e-41dc-b377-d1103127b4db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:45:39.120753 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.120700    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-util\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:39.120753 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.120721    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-util\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:39.120753 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.120730    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt99j\" (UniqueName: \"kubernetes.io/projected/3375b9b7-0131-475a-822d-ab60df59a324-kube-api-access-lt99j\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:39.120753 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.120739    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3fefcff-530e-41dc-b377-d1103127b4db-bundle\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:39.120753 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.120748    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8zrr\" (UniqueName: \"kubernetes.io/projected/c3fefcff-530e-41dc-b377-d1103127b4db-kube-api-access-h8zrr\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:39.120753 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.120756    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3375b9b7-0131-475a-822d-ab60df59a324-bundle\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:45:39.795656 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.795631    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g"
Jul 30 19:45:39.796116 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.795647    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g" event={"ID":"3375b9b7-0131-475a-822d-ab60df59a324","Type":"ContainerDied","Data":"9c2afd06253338ddf8c95ae4a15aa2cb3d695f757350e3d66b3984c5119fa5a6"}
Jul 30 19:45:39.796116 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.795702    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c2afd06253338ddf8c95ae4a15aa2cb3d695f757350e3d66b3984c5119fa5a6"
Jul 30 19:45:39.797950 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.797920    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95" event={"ID":"c3fefcff-530e-41dc-b377-d1103127b4db","Type":"ContainerDied","Data":"9d448c02cd02a91fe31ac1f582c3ba124640769dbb48734e4535131b63c221b5"}
Jul 30 19:45:39.797950 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.797951    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95"
Jul 30 19:45:39.798158 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:39.797969    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d448c02cd02a91fe31ac1f582c3ba124640769dbb48734e4535131b63c221b5"
Jul 30 19:45:41.056748 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:41.056718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:44.444330 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:44.444300    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:44.802145 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:44.802054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:49.054947 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:49.054914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:49.386592 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:49.386560    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:49.669589 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:49.669517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:49.770936 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:49.770902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:53.067831 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:53.067797    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:54.934933 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:54.934880    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:56.690453 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690420    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"]
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690751    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f58856-8b84-4622-bc0f-f0a6e705f098" containerName="extract"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690762    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f58856-8b84-4622-bc0f-f0a6e705f098" containerName="extract"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690770    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3375b9b7-0131-475a-822d-ab60df59a324" containerName="pull"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690776    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3375b9b7-0131-475a-822d-ab60df59a324" containerName="pull"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690783    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3fefcff-530e-41dc-b377-d1103127b4db" containerName="extract"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690788    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3fefcff-530e-41dc-b377-d1103127b4db" containerName="extract"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690798    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e114f8d-dab3-43b5-bba2-52d1be3a5f98" containerName="util"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690803    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e114f8d-dab3-43b5-bba2-52d1be3a5f98" containerName="util"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690814    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f58856-8b84-4622-bc0f-f0a6e705f098" containerName="util"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690820    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f58856-8b84-4622-bc0f-f0a6e705f098" containerName="util"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690827    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3fefcff-530e-41dc-b377-d1103127b4db" containerName="pull"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690831    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3fefcff-530e-41dc-b377-d1103127b4db" containerName="pull"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690837    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3375b9b7-0131-475a-822d-ab60df59a324" containerName="util"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690844    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3375b9b7-0131-475a-822d-ab60df59a324" containerName="util"
Jul 30 19:45:56.690841 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690849    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f58856-8b84-4622-bc0f-f0a6e705f098" containerName="pull"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690854    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f58856-8b84-4622-bc0f-f0a6e705f098" containerName="pull"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690863    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3fefcff-530e-41dc-b377-d1103127b4db" containerName="util"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690870    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3fefcff-530e-41dc-b377-d1103127b4db" containerName="util"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690877    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e114f8d-dab3-43b5-bba2-52d1be3a5f98" containerName="extract"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690881    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e114f8d-dab3-43b5-bba2-52d1be3a5f98" containerName="extract"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690904    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3375b9b7-0131-475a-822d-ab60df59a324" containerName="extract"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690909    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3375b9b7-0131-475a-822d-ab60df59a324" containerName="extract"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690917    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e114f8d-dab3-43b5-bba2-52d1be3a5f98" containerName="pull"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690921    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e114f8d-dab3-43b5-bba2-52d1be3a5f98" containerName="pull"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690974    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e114f8d-dab3-43b5-bba2-52d1be3a5f98" containerName="extract"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690982    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3375b9b7-0131-475a-822d-ab60df59a324" containerName="extract"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690989    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="63f58856-8b84-4622-bc0f-f0a6e705f098" containerName="extract"
Jul 30 19:45:56.691356 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.690997    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3fefcff-530e-41dc-b377-d1103127b4db" containerName="extract"
Jul 30 19:45:56.695700 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.695677    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:56.698539 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.698513    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 30 19:45:56.698699 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.698677    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 19:45:56.698787 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.698762    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v42rg\""
Jul 30 19:45:56.699952 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.699932    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 19:45:56.700064 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.699939    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 30 19:45:56.704037 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.704014    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"]
Jul 30 19:45:56.749577 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.749558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drhww\" (UniqueName: \"kubernetes.io/projected/041b2303-a7fd-4251-a644-0728fd5bc491-kube-api-access-drhww\") pod \"kuadrant-console-plugin-66b5774985-dcr9r\" (UID: \"041b2303-a7fd-4251-a644-0728fd5bc491\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:56.749647 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.749605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/041b2303-a7fd-4251-a644-0728fd5bc491-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dcr9r\" (UID: \"041b2303-a7fd-4251-a644-0728fd5bc491\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:56.749684 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.749674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/041b2303-a7fd-4251-a644-0728fd5bc491-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dcr9r\" (UID: \"041b2303-a7fd-4251-a644-0728fd5bc491\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:56.809207 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.809181    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:56.850204 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.850183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drhww\" (UniqueName: \"kubernetes.io/projected/041b2303-a7fd-4251-a644-0728fd5bc491-kube-api-access-drhww\") pod \"kuadrant-console-plugin-66b5774985-dcr9r\" (UID: \"041b2303-a7fd-4251-a644-0728fd5bc491\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:56.850277 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.850227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/041b2303-a7fd-4251-a644-0728fd5bc491-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dcr9r\" (UID: \"041b2303-a7fd-4251-a644-0728fd5bc491\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:56.850322 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:45:56.850305    2561 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 30 19:45:56.850380 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.850331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/041b2303-a7fd-4251-a644-0728fd5bc491-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dcr9r\" (UID: \"041b2303-a7fd-4251-a644-0728fd5bc491\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:56.850440 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:45:56.850396    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041b2303-a7fd-4251-a644-0728fd5bc491-plugin-serving-cert podName:041b2303-a7fd-4251-a644-0728fd5bc491 nodeName:}" failed. No retries permitted until 2026-07-30 19:45:57.350373691 +0000 UTC m=+399.990788764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/041b2303-a7fd-4251-a644-0728fd5bc491-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-dcr9r" (UID: "041b2303-a7fd-4251-a644-0728fd5bc491") : secret "plugin-serving-cert" not found
Jul 30 19:45:56.850829 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.850812    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/041b2303-a7fd-4251-a644-0728fd5bc491-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dcr9r\" (UID: \"041b2303-a7fd-4251-a644-0728fd5bc491\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:56.858352 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:56.858335    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drhww\" (UniqueName: \"kubernetes.io/projected/041b2303-a7fd-4251-a644-0728fd5bc491-kube-api-access-drhww\") pod \"kuadrant-console-plugin-66b5774985-dcr9r\" (UID: \"041b2303-a7fd-4251-a644-0728fd5bc491\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:57.163534 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:57.163490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:57.354731 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:57.354708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/041b2303-a7fd-4251-a644-0728fd5bc491-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dcr9r\" (UID: \"041b2303-a7fd-4251-a644-0728fd5bc491\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:57.357073 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:57.357054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/041b2303-a7fd-4251-a644-0728fd5bc491-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dcr9r\" (UID: \"041b2303-a7fd-4251-a644-0728fd5bc491\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:57.502014 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:57.501959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:57.605772 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:57.605751    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"
Jul 30 19:45:57.742797 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:57.742769    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r"]
Jul 30 19:45:57.744841 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:45:57.744812    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod041b2303_a7fd_4251_a644_0728fd5bc491.slice/crio-f8b114d0cbbba35bc1ad8b2f05c5d79b0aa64727a3b2aeab5859715f236cc47d WatchSource:0}: Error finding container f8b114d0cbbba35bc1ad8b2f05c5d79b0aa64727a3b2aeab5859715f236cc47d: Status 404 returned error can't find the container with id f8b114d0cbbba35bc1ad8b2f05c5d79b0aa64727a3b2aeab5859715f236cc47d
Jul 30 19:45:57.885911 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:57.885874    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r" event={"ID":"041b2303-a7fd-4251-a644-0728fd5bc491","Type":"ContainerStarted","Data":"f8b114d0cbbba35bc1ad8b2f05c5d79b0aa64727a3b2aeab5859715f236cc47d"}
Jul 30 19:45:59.469561 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:59.469524    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:59.522362 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:59.522331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:45:59.695970 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:45:59.695899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:09.699236 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:09.699195    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:09.799061 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:09.799032    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:12.118147 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:12.118112    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:12.218826 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:12.218791    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:15.112681 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.112635    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-778df8d7df-h7cwn"]
Jul 30 19:46:15.160641 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.160606    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:15.212505 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.212471    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:15.715391 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.715348    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-778df8d7df-h7cwn"]
Jul 30 19:46:15.715583 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.715473    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.816220 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.816187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-console-oauth-config\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.816377 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.816226    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-console-config\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.816377 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.816259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xsr5\" (UniqueName: \"kubernetes.io/projected/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-kube-api-access-5xsr5\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.816377 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.816286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-service-ca\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.816377 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.816334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-console-serving-cert\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.816542 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.816402    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-trusted-ca-bundle\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.816542 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.816421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-oauth-serving-cert\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.917042 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.917005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-console-serving-cert\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.917235 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.917079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-trusted-ca-bundle\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.917235 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.917101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-oauth-serving-cert\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.917235 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.917156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-console-oauth-config\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.917235 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.917181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-console-config\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.917235 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.917212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xsr5\" (UniqueName: \"kubernetes.io/projected/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-kube-api-access-5xsr5\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.917562 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.917252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-service-ca\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.917927 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.917882    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-oauth-serving-cert\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.918361 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.918330    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-trusted-ca-bundle\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.918441 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.918380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-service-ca\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.918536 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.918515    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-console-config\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.919831 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.919804    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-console-serving-cert\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.920347 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.920325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-console-oauth-config\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:15.926035 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:15.926012    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xsr5\" (UniqueName: \"kubernetes.io/projected/4e686c57-5a99-495e-a31b-fa0ecfd6dd20-kube-api-access-5xsr5\") pod \"console-778df8d7df-h7cwn\" (UID: \"4e686c57-5a99-495e-a31b-fa0ecfd6dd20\") " pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:16.026607 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:16.026529    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:16.429251 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:16.429204    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:16.530824 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:16.530776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:18.850011 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:18.849980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:18.951260 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:18.951228    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:19.120490 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:19.120468    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-778df8d7df-h7cwn"]
Jul 30 19:46:19.122726 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:46:19.122701    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e686c57_5a99_495e_a31b_fa0ecfd6dd20.slice/crio-4601484c3908a4e33c85928bf9ec109addc824202e55a435df876215fe4140f8 WatchSource:0}: Error finding container 4601484c3908a4e33c85928bf9ec109addc824202e55a435df876215fe4140f8: Status 404 returned error can't find the container with id 4601484c3908a4e33c85928bf9ec109addc824202e55a435df876215fe4140f8
Jul 30 19:46:20.019851 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:20.019812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-778df8d7df-h7cwn" event={"ID":"4e686c57-5a99-495e-a31b-fa0ecfd6dd20","Type":"ContainerStarted","Data":"5148b2302e4976578295b6620bddac2b38522230f41f9d35510af950463f6ff0"}
Jul 30 19:46:20.020267 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:20.019925    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-778df8d7df-h7cwn" event={"ID":"4e686c57-5a99-495e-a31b-fa0ecfd6dd20","Type":"ContainerStarted","Data":"4601484c3908a4e33c85928bf9ec109addc824202e55a435df876215fe4140f8"}
Jul 30 19:46:20.021428 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:20.021405    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r" event={"ID":"041b2303-a7fd-4251-a644-0728fd5bc491","Type":"ContainerStarted","Data":"dc87e4b835b6308578f94a17228fe8433b2beffa2a09162a667d381360f8ad74"}
Jul 30 19:46:20.043189 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:20.043152    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-778df8d7df-h7cwn" podStartSLOduration=5.043140323 podStartE2EDuration="5.043140323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:20.041952685 +0000 UTC m=+422.682367764" watchObservedRunningTime="2026-07-30 19:46:20.043140323 +0000 UTC m=+422.683555438"
Jul 30 19:46:20.062821 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:20.062771    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dcr9r" podStartSLOduration=2.432629988 podStartE2EDuration="24.062754557s" totalImagesPullingTime="21.630124569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:20.062243444 +0000 UTC m=+422.702658526" watchObservedRunningTime="2026-07-30 19:46:20.062754557 +0000 UTC m=+422.703169639"
Jul 30 19:46:26.027287 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:26.027248    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:26.027759 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:26.027301    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:26.032343 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:26.032318    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:26.057610 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:26.057588    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-778df8d7df-h7cwn"
Jul 30 19:46:26.104062 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:26.104028    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ffb7cbcf9-9c9k4"]
Jul 30 19:46:26.198423 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:26.198383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:26.246575 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:26.246526    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:26.300812 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:26.300751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:27.679569 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:27.679529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:27.780200 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:27.780168    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:30.128484 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:30.128458    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:30.184060 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:30.184029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:31.155509 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:31.155477    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:31.205138 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:31.205110    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:34.483012 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:34.482978    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:34.583276 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:34.583244    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:35.774113 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:35.774075    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:36.196132 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:36.196103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:38.086366 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:38.086336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:38.142346 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:38.142318    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:47.295537 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:47.295457    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:47.395674 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:47.395648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:48.278112 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:48.278077    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:48.375903 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:48.375860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:48.434596 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:48.434566    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:49.089682 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.089651    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-gmmrn"]
Jul 30 19:46:49.124748 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.124716    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:49.179628 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.179606    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:49.254640 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.254614    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gmmrn"]
Jul 30 19:46:49.254784 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.254694    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gmmrn"
Jul 30 19:46:49.257542 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.257520    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zcjx7\""
Jul 30 19:46:49.259354 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.259331    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxz48"]
Jul 30 19:46:49.269770 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.269749    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxz48"]
Jul 30 19:46:49.269920 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.269872    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bxz48"
Jul 30 19:46:49.286125 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.286100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdck4\" (UniqueName: \"kubernetes.io/projected/2e34bb17-f23e-48d1-ab3a-603d17a094fa-kube-api-access-mdck4\") pod \"authorino-58cd955675-gmmrn\" (UID: \"2e34bb17-f23e-48d1-ab3a-603d17a094fa\") " pod="kuadrant-system/authorino-58cd955675-gmmrn"
Jul 30 19:46:49.386379 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.386350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pjzb\" (UniqueName: \"kubernetes.io/projected/789c067d-24ee-45b6-a65b-c39e1466076e-kube-api-access-5pjzb\") pod \"authorino-75d556bd77-bxz48\" (UID: \"789c067d-24ee-45b6-a65b-c39e1466076e\") " pod="kuadrant-system/authorino-75d556bd77-bxz48"
Jul 30 19:46:49.386727 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.386432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdck4\" (UniqueName: \"kubernetes.io/projected/2e34bb17-f23e-48d1-ab3a-603d17a094fa-kube-api-access-mdck4\") pod \"authorino-58cd955675-gmmrn\" (UID: \"2e34bb17-f23e-48d1-ab3a-603d17a094fa\") " pod="kuadrant-system/authorino-58cd955675-gmmrn"
Jul 30 19:46:49.395125 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.395100    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdck4\" (UniqueName: \"kubernetes.io/projected/2e34bb17-f23e-48d1-ab3a-603d17a094fa-kube-api-access-mdck4\") pod \"authorino-58cd955675-gmmrn\" (UID: \"2e34bb17-f23e-48d1-ab3a-603d17a094fa\") " pod="kuadrant-system/authorino-58cd955675-gmmrn"
Jul 30 19:46:49.486763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.486736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pjzb\" (UniqueName: \"kubernetes.io/projected/789c067d-24ee-45b6-a65b-c39e1466076e-kube-api-access-5pjzb\") pod \"authorino-75d556bd77-bxz48\" (UID: \"789c067d-24ee-45b6-a65b-c39e1466076e\") " pod="kuadrant-system/authorino-75d556bd77-bxz48"
Jul 30 19:46:49.494294 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.494274    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pjzb\" (UniqueName: \"kubernetes.io/projected/789c067d-24ee-45b6-a65b-c39e1466076e-kube-api-access-5pjzb\") pod \"authorino-75d556bd77-bxz48\" (UID: \"789c067d-24ee-45b6-a65b-c39e1466076e\") " pod="kuadrant-system/authorino-75d556bd77-bxz48"
Jul 30 19:46:49.566142 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.566117    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gmmrn"
Jul 30 19:46:49.582212 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.582190    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bxz48"
Jul 30 19:46:49.724822 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.724794    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gmmrn"]
Jul 30 19:46:49.726427 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:46:49.726393    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e34bb17_f23e_48d1_ab3a_603d17a094fa.slice/crio-f8fdd8c6149351fe5f210e1210ac9ce38409b3c72f5baf50b88bd94ea716b61e WatchSource:0}: Error finding container f8fdd8c6149351fe5f210e1210ac9ce38409b3c72f5baf50b88bd94ea716b61e: Status 404 returned error can't find the container with id f8fdd8c6149351fe5f210e1210ac9ce38409b3c72f5baf50b88bd94ea716b61e
Jul 30 19:46:49.732157 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.732051    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:49.744625 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.744600    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxz48"]
Jul 30 19:46:49.746785 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:46:49.746763    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod789c067d_24ee_45b6_a65b_c39e1466076e.slice/crio-a2acc5873f31263b933c4956b5266d01c0e4bcbe317b2f5dd4fdecd450657c90 WatchSource:0}: Error finding container a2acc5873f31263b933c4956b5266d01c0e4bcbe317b2f5dd4fdecd450657c90: Status 404 returned error can't find the container with id a2acc5873f31263b933c4956b5266d01c0e4bcbe317b2f5dd4fdecd450657c90
Jul 30 19:46:49.784838 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:49.784814    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:46:50.174383 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:50.174352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gmmrn" event={"ID":"2e34bb17-f23e-48d1-ab3a-603d17a094fa","Type":"ContainerStarted","Data":"f8fdd8c6149351fe5f210e1210ac9ce38409b3c72f5baf50b88bd94ea716b61e"}
Jul 30 19:46:50.175502 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:50.175474    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bxz48" event={"ID":"789c067d-24ee-45b6-a65b-c39e1466076e","Type":"ContainerStarted","Data":"a2acc5873f31263b933c4956b5266d01c0e4bcbe317b2f5dd4fdecd450657c90"}
Jul 30 19:46:51.130504 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.130462    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7ffb7cbcf9-9c9k4" podUID="be194680-1d57-4d98-b7aa-6bf22b06ec43" containerName="console" containerID="cri-o://a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9" gracePeriod=15
Jul 30 19:46:51.456301 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.456274    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:46:51.504914 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.504873    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-serving-cert\") pod \"be194680-1d57-4d98-b7aa-6bf22b06ec43\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") "
Jul 30 19:46:51.505068 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.504940    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-config\") pod \"be194680-1d57-4d98-b7aa-6bf22b06ec43\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") "
Jul 30 19:46:51.505068 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.504968    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-oauth-config\") pod \"be194680-1d57-4d98-b7aa-6bf22b06ec43\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") "
Jul 30 19:46:51.505068 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.505033    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-trusted-ca-bundle\") pod \"be194680-1d57-4d98-b7aa-6bf22b06ec43\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") "
Jul 30 19:46:51.505068 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.505062    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzdmg\" (UniqueName: \"kubernetes.io/projected/be194680-1d57-4d98-b7aa-6bf22b06ec43-kube-api-access-mzdmg\") pod \"be194680-1d57-4d98-b7aa-6bf22b06ec43\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") "
Jul 30 19:46:51.505313 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.505107    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-service-ca\") pod \"be194680-1d57-4d98-b7aa-6bf22b06ec43\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") "
Jul 30 19:46:51.505313 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.505183    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-oauth-serving-cert\") pod \"be194680-1d57-4d98-b7aa-6bf22b06ec43\" (UID: \"be194680-1d57-4d98-b7aa-6bf22b06ec43\") "
Jul 30 19:46:51.506527 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.506150    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "be194680-1d57-4d98-b7aa-6bf22b06ec43" (UID: "be194680-1d57-4d98-b7aa-6bf22b06ec43"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:46:51.506527 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.506158    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-config" (OuterVolumeSpecName: "console-config") pod "be194680-1d57-4d98-b7aa-6bf22b06ec43" (UID: "be194680-1d57-4d98-b7aa-6bf22b06ec43"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:46:51.506527 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.506254    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-service-ca" (OuterVolumeSpecName: "service-ca") pod "be194680-1d57-4d98-b7aa-6bf22b06ec43" (UID: "be194680-1d57-4d98-b7aa-6bf22b06ec43"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:46:51.506527 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.506496    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "be194680-1d57-4d98-b7aa-6bf22b06ec43" (UID: "be194680-1d57-4d98-b7aa-6bf22b06ec43"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:46:51.512217 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.512174    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be194680-1d57-4d98-b7aa-6bf22b06ec43-kube-api-access-mzdmg" (OuterVolumeSpecName: "kube-api-access-mzdmg") pod "be194680-1d57-4d98-b7aa-6bf22b06ec43" (UID: "be194680-1d57-4d98-b7aa-6bf22b06ec43"). InnerVolumeSpecName "kube-api-access-mzdmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:46:51.516307 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.516282    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "be194680-1d57-4d98-b7aa-6bf22b06ec43" (UID: "be194680-1d57-4d98-b7aa-6bf22b06ec43"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:46:51.524968 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.524934    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "be194680-1d57-4d98-b7aa-6bf22b06ec43" (UID: "be194680-1d57-4d98-b7aa-6bf22b06ec43"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:46:51.606747 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.606716    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-trusted-ca-bundle\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:46:51.606929 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.606758    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzdmg\" (UniqueName: \"kubernetes.io/projected/be194680-1d57-4d98-b7aa-6bf22b06ec43-kube-api-access-mzdmg\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:46:51.606929 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.606772    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-service-ca\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:46:51.606929 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.606784    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-oauth-serving-cert\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:46:51.606929 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.606796    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-serving-cert\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:46:51.606929 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.606812    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-config\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:46:51.606929 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:51.606825    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be194680-1d57-4d98-b7aa-6bf22b06ec43-console-oauth-config\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:46:52.193551 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:52.193515    2561 generic.go:356] "Generic (PLEG): container finished" podID="be194680-1d57-4d98-b7aa-6bf22b06ec43" containerID="a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9" exitCode=0
Jul 30 19:46:52.193551 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:52.193560    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb7cbcf9-9c9k4"
Jul 30 19:46:52.194051 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:52.193602    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb7cbcf9-9c9k4" event={"ID":"be194680-1d57-4d98-b7aa-6bf22b06ec43","Type":"ContainerDied","Data":"a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9"}
Jul 30 19:46:52.194051 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:52.193667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb7cbcf9-9c9k4" event={"ID":"be194680-1d57-4d98-b7aa-6bf22b06ec43","Type":"ContainerDied","Data":"584fc75762e4bebd955928063c379a8520ce9562e12260bcf6c2bf0f96f867d9"}
Jul 30 19:46:52.194051 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:52.193690    2561 scope.go:117] "RemoveContainer" containerID="a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9"
Jul 30 19:46:52.211943 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:52.211915    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ffb7cbcf9-9c9k4"]
Jul 30 19:46:52.214112 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:52.214090    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ffb7cbcf9-9c9k4"]
Jul 30 19:46:52.581869 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:52.581849    2561 scope.go:117] "RemoveContainer" containerID="a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9"
Jul 30 19:46:52.582206 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:46:52.582184    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9\": container with ID starting with a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9 not found: ID does not exist" containerID="a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9"
Jul 30 19:46:52.582258 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:52.582216    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9"} err="failed to get container status \"a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9\": rpc error: code = NotFound desc = could not find container \"a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9\": container with ID starting with a3b41d5a40abc6628b2d673695be579659cb20e49096ac2b99fc94b175a207c9 not found: ID does not exist"
Jul 30 19:46:53.841240 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:53.841155    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be194680-1d57-4d98-b7aa-6bf22b06ec43" path="/var/lib/kubelet/pods/be194680-1d57-4d98-b7aa-6bf22b06ec43/volumes"
Jul 30 19:46:54.213733 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:54.213696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gmmrn" event={"ID":"2e34bb17-f23e-48d1-ab3a-603d17a094fa","Type":"ContainerStarted","Data":"c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce"}
Jul 30 19:46:54.215223 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:54.215196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bxz48" event={"ID":"789c067d-24ee-45b6-a65b-c39e1466076e","Type":"ContainerStarted","Data":"4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6"}
Jul 30 19:46:54.229464 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:54.229423    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-gmmrn" podStartSLOduration=1.465693025 podStartE2EDuration="5.229408604s" totalImagesPullingTime="3.763715579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:54.228275128 +0000 UTC m=+456.868690212" watchObservedRunningTime="2026-07-30 19:46:54.229408604 +0000 UTC m=+456.869823684"
Jul 30 19:46:54.245013 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:54.244973    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bxz48" podStartSLOduration=1.512216338 podStartE2EDuration="5.244956281s" totalImagesPullingTime="3.732739943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:54.242922094 +0000 UTC m=+456.883337178" watchObservedRunningTime="2026-07-30 19:46:54.244956281 +0000 UTC m=+456.885371360"
Jul 30 19:46:54.266371 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:54.266338    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gmmrn"]
Jul 30 19:46:56.225597 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:56.225560    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-gmmrn" podUID="2e34bb17-f23e-48d1-ab3a-603d17a094fa" containerName="authorino" containerID="cri-o://c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce" gracePeriod=30
Jul 30 19:46:56.463790 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:56.463768    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gmmrn"
Jul 30 19:46:56.546868 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:56.546812    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdck4\" (UniqueName: \"kubernetes.io/projected/2e34bb17-f23e-48d1-ab3a-603d17a094fa-kube-api-access-mdck4\") pod \"2e34bb17-f23e-48d1-ab3a-603d17a094fa\" (UID: \"2e34bb17-f23e-48d1-ab3a-603d17a094fa\") "
Jul 30 19:46:56.548740 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:56.548716    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e34bb17-f23e-48d1-ab3a-603d17a094fa-kube-api-access-mdck4" (OuterVolumeSpecName: "kube-api-access-mdck4") pod "2e34bb17-f23e-48d1-ab3a-603d17a094fa" (UID: "2e34bb17-f23e-48d1-ab3a-603d17a094fa"). InnerVolumeSpecName "kube-api-access-mdck4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:46:56.647348 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:56.647323    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdck4\" (UniqueName: \"kubernetes.io/projected/2e34bb17-f23e-48d1-ab3a-603d17a094fa-kube-api-access-mdck4\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:46:57.232524 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:57.232495    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e34bb17-f23e-48d1-ab3a-603d17a094fa" containerID="c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce" exitCode=0
Jul 30 19:46:57.232880 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:57.232538    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gmmrn"
Jul 30 19:46:57.232880 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:57.232580    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gmmrn" event={"ID":"2e34bb17-f23e-48d1-ab3a-603d17a094fa","Type":"ContainerDied","Data":"c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce"}
Jul 30 19:46:57.232880 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:57.232618    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gmmrn" event={"ID":"2e34bb17-f23e-48d1-ab3a-603d17a094fa","Type":"ContainerDied","Data":"f8fdd8c6149351fe5f210e1210ac9ce38409b3c72f5baf50b88bd94ea716b61e"}
Jul 30 19:46:57.232880 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:57.232635    2561 scope.go:117] "RemoveContainer" containerID="c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce"
Jul 30 19:46:57.241814 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:57.241797    2561 scope.go:117] "RemoveContainer" containerID="c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce"
Jul 30 19:46:57.242104 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:46:57.242085    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce\": container with ID starting with c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce not found: ID does not exist" containerID="c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce"
Jul 30 19:46:57.242184 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:57.242110    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce"} err="failed to get container status \"c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce\": rpc error: code = NotFound desc = could not find container \"c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce\": container with ID starting with c1c524bb84c913cc06d88a2fbba29df931936a27799140301fa8c2470c3a83ce not found: ID does not exist"
Jul 30 19:46:57.257032 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:57.257008    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gmmrn"]
Jul 30 19:46:57.260602 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:57.260579    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-gmmrn"]
Jul 30 19:46:57.847439 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:46:57.847404    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e34bb17-f23e-48d1-ab3a-603d17a094fa" path="/var/lib/kubelet/pods/2e34bb17-f23e-48d1-ab3a-603d17a094fa/volumes"
Jul 30 19:47:08.434838 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:08.434804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:08.536501 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:08.536476    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:08.968726 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:08.968697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:09.134777 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:09.134747    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:09.427654 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:09.427625    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:21.084120 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.084079    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:21.247110 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.247086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:21.304862 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.304829    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nbk68"]
Jul 30 19:47:21.305266 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.305248    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be194680-1d57-4d98-b7aa-6bf22b06ec43" containerName="console"
Jul 30 19:47:21.305359 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.305269    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="be194680-1d57-4d98-b7aa-6bf22b06ec43" containerName="console"
Jul 30 19:47:21.305359 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.305284    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e34bb17-f23e-48d1-ab3a-603d17a094fa" containerName="authorino"
Jul 30 19:47:21.305359 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.305293    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e34bb17-f23e-48d1-ab3a-603d17a094fa" containerName="authorino"
Jul 30 19:47:21.305519 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.305378    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="be194680-1d57-4d98-b7aa-6bf22b06ec43" containerName="console"
Jul 30 19:47:21.305519 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.305392    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e34bb17-f23e-48d1-ab3a-603d17a094fa" containerName="authorino"
Jul 30 19:47:21.309746 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.309728    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nbk68"
Jul 30 19:47:21.315437 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.315413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nbk68"]
Jul 30 19:47:21.417051 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.417030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnpjf\" (UniqueName: \"kubernetes.io/projected/7be3135b-db50-418e-8e18-ab88e08963c4-kube-api-access-hnpjf\") pod \"authorino-5d4b67c446-nbk68\" (UID: \"7be3135b-db50-418e-8e18-ab88e08963c4\") " pod="kuadrant-system/authorino-5d4b67c446-nbk68"
Jul 30 19:47:21.518300 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.518274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnpjf\" (UniqueName: \"kubernetes.io/projected/7be3135b-db50-418e-8e18-ab88e08963c4-kube-api-access-hnpjf\") pod \"authorino-5d4b67c446-nbk68\" (UID: \"7be3135b-db50-418e-8e18-ab88e08963c4\") " pod="kuadrant-system/authorino-5d4b67c446-nbk68"
Jul 30 19:47:21.527451 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.527423    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nbk68"]
Jul 30 19:47:21.527619 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:47:21.527601    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hnpjf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-nbk68" podUID="7be3135b-db50-418e-8e18-ab88e08963c4"
Jul 30 19:47:21.529759 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.529742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnpjf\" (UniqueName: \"kubernetes.io/projected/7be3135b-db50-418e-8e18-ab88e08963c4-kube-api-access-hnpjf\") pod \"authorino-5d4b67c446-nbk68\" (UID: \"7be3135b-db50-418e-8e18-ab88e08963c4\") " pod="kuadrant-system/authorino-5d4b67c446-nbk68"
Jul 30 19:47:21.551475 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.551452    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b7c4fbbdf-hgqvq"]
Jul 30 19:47:21.554761 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.554747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7c4fbbdf-hgqvq"
Jul 30 19:47:21.561800 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.561778    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b7c4fbbdf-hgqvq"]
Jul 30 19:47:21.600906 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.600874    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b7c4fbbdf-hgqvq"]
Jul 30 19:47:21.601058 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:47:21.601041    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-86kw5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5b7c4fbbdf-hgqvq" podUID="44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a"
Jul 30 19:47:21.619172 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.619137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86kw5\" (UniqueName: \"kubernetes.io/projected/44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a-kube-api-access-86kw5\") pod \"authorino-5b7c4fbbdf-hgqvq\" (UID: \"44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a\") " pod="kuadrant-system/authorino-5b7c4fbbdf-hgqvq"
Jul 30 19:47:21.628371 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.628351    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59ff4ccd5-tcsht"]
Jul 30 19:47:21.631454 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.631439    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59ff4ccd5-tcsht"
Jul 30 19:47:21.634034 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.634016    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 19:47:21.640426 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.640408    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59ff4ccd5-tcsht"]
Jul 30 19:47:21.720140 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.720083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tshsl\" (UniqueName: \"kubernetes.io/projected/6eb081a4-ea48-406c-b918-d53d5d37acaa-kube-api-access-tshsl\") pod \"authorino-59ff4ccd5-tcsht\" (UID: \"6eb081a4-ea48-406c-b918-d53d5d37acaa\") " pod="kuadrant-system/authorino-59ff4ccd5-tcsht"
Jul 30 19:47:21.720238 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.720146    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86kw5\" (UniqueName: \"kubernetes.io/projected/44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a-kube-api-access-86kw5\") pod \"authorino-5b7c4fbbdf-hgqvq\" (UID: \"44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a\") " pod="kuadrant-system/authorino-5b7c4fbbdf-hgqvq"
Jul 30 19:47:21.720238 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.720186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6eb081a4-ea48-406c-b918-d53d5d37acaa-tls-cert\") pod \"authorino-59ff4ccd5-tcsht\" (UID: \"6eb081a4-ea48-406c-b918-d53d5d37acaa\") " pod="kuadrant-system/authorino-59ff4ccd5-tcsht"
Jul 30 19:47:21.728744 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.728726    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86kw5\" (UniqueName: \"kubernetes.io/projected/44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a-kube-api-access-86kw5\") pod \"authorino-5b7c4fbbdf-hgqvq\" (UID: \"44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a\") " pod="kuadrant-system/authorino-5b7c4fbbdf-hgqvq"
Jul 30 19:47:21.821501 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.821477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6eb081a4-ea48-406c-b918-d53d5d37acaa-tls-cert\") pod \"authorino-59ff4ccd5-tcsht\" (UID: \"6eb081a4-ea48-406c-b918-d53d5d37acaa\") " pod="kuadrant-system/authorino-59ff4ccd5-tcsht"
Jul 30 19:47:21.821585 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.821533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tshsl\" (UniqueName: \"kubernetes.io/projected/6eb081a4-ea48-406c-b918-d53d5d37acaa-kube-api-access-tshsl\") pod \"authorino-59ff4ccd5-tcsht\" (UID: \"6eb081a4-ea48-406c-b918-d53d5d37acaa\") " pod="kuadrant-system/authorino-59ff4ccd5-tcsht"
Jul 30 19:47:21.823805 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.823783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6eb081a4-ea48-406c-b918-d53d5d37acaa-tls-cert\") pod \"authorino-59ff4ccd5-tcsht\" (UID: \"6eb081a4-ea48-406c-b918-d53d5d37acaa\") " pod="kuadrant-system/authorino-59ff4ccd5-tcsht"
Jul 30 19:47:21.835226 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.835203    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tshsl\" (UniqueName: \"kubernetes.io/projected/6eb081a4-ea48-406c-b918-d53d5d37acaa-kube-api-access-tshsl\") pod \"authorino-59ff4ccd5-tcsht\" (UID: \"6eb081a4-ea48-406c-b918-d53d5d37acaa\") " pod="kuadrant-system/authorino-59ff4ccd5-tcsht"
Jul 30 19:47:21.940432 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:21.940413    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59ff4ccd5-tcsht"
Jul 30 19:47:22.066781 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.066754    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59ff4ccd5-tcsht"]
Jul 30 19:47:22.068375 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:47:22.068346    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6eb081a4_ea48_406c_b918_d53d5d37acaa.slice/crio-ff6ab4f810695e694fbc9d477102bf11aa692d9bad63a126bac5823001c6199f WatchSource:0}: Error finding container ff6ab4f810695e694fbc9d477102bf11aa692d9bad63a126bac5823001c6199f: Status 404 returned error can't find the container with id ff6ab4f810695e694fbc9d477102bf11aa692d9bad63a126bac5823001c6199f
Jul 30 19:47:22.376524 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.376453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59ff4ccd5-tcsht" event={"ID":"6eb081a4-ea48-406c-b918-d53d5d37acaa","Type":"ContainerStarted","Data":"ff6ab4f810695e694fbc9d477102bf11aa692d9bad63a126bac5823001c6199f"}
Jul 30 19:47:22.376524 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.376476    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7c4fbbdf-hgqvq"
Jul 30 19:47:22.376524 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.376491    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nbk68"
Jul 30 19:47:22.384945 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.384927    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7c4fbbdf-hgqvq"
Jul 30 19:47:22.387110 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.387090    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nbk68"
Jul 30 19:47:22.527493 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.527468    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnpjf\" (UniqueName: \"kubernetes.io/projected/7be3135b-db50-418e-8e18-ab88e08963c4-kube-api-access-hnpjf\") pod \"7be3135b-db50-418e-8e18-ab88e08963c4\" (UID: \"7be3135b-db50-418e-8e18-ab88e08963c4\") "
Jul 30 19:47:22.527617 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.527556    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86kw5\" (UniqueName: \"kubernetes.io/projected/44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a-kube-api-access-86kw5\") pod \"44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a\" (UID: \"44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a\") "
Jul 30 19:47:22.529734 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.529707    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a-kube-api-access-86kw5" (OuterVolumeSpecName: "kube-api-access-86kw5") pod "44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a" (UID: "44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a"). InnerVolumeSpecName "kube-api-access-86kw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:47:22.529854 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.529837    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7be3135b-db50-418e-8e18-ab88e08963c4-kube-api-access-hnpjf" (OuterVolumeSpecName: "kube-api-access-hnpjf") pod "7be3135b-db50-418e-8e18-ab88e08963c4" (UID: "7be3135b-db50-418e-8e18-ab88e08963c4"). InnerVolumeSpecName "kube-api-access-hnpjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:47:22.628660 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.628610    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86kw5\" (UniqueName: \"kubernetes.io/projected/44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a-kube-api-access-86kw5\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:47:22.628660 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:22.628631    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnpjf\" (UniqueName: \"kubernetes.io/projected/7be3135b-db50-418e-8e18-ab88e08963c4-kube-api-access-hnpjf\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:47:23.383955 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.383920    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59ff4ccd5-tcsht" event={"ID":"6eb081a4-ea48-406c-b918-d53d5d37acaa","Type":"ContainerStarted","Data":"9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5"}
Jul 30 19:47:23.384407 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.383982    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7c4fbbdf-hgqvq"
Jul 30 19:47:23.384407 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.383990    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nbk68"
Jul 30 19:47:23.399070 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.399001    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59ff4ccd5-tcsht" podStartSLOduration=1.8734706110000001 podStartE2EDuration="2.398985587s" totalImagesPullingTime="525.514976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:47:23.398860617 +0000 UTC m=+486.039275697" watchObservedRunningTime="2026-07-30 19:47:23.398985587 +0000 UTC m=+486.039400666"
Jul 30 19:47:23.421619 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.421597    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b7c4fbbdf-hgqvq"]
Jul 30 19:47:23.427350 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.427295    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxz48"]
Jul 30 19:47:23.427561 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.427529    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bxz48" podUID="789c067d-24ee-45b6-a65b-c39e1466076e" containerName="authorino" containerID="cri-o://4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6" gracePeriod=30
Jul 30 19:47:23.429760 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.429735    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b7c4fbbdf-hgqvq"]
Jul 30 19:47:23.454021 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.453993    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nbk68"]
Jul 30 19:47:23.457958 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.457937    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nbk68"]
Jul 30 19:47:23.671581 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.671554    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bxz48"
Jul 30 19:47:23.737020 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.736992    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pjzb\" (UniqueName: \"kubernetes.io/projected/789c067d-24ee-45b6-a65b-c39e1466076e-kube-api-access-5pjzb\") pod \"789c067d-24ee-45b6-a65b-c39e1466076e\" (UID: \"789c067d-24ee-45b6-a65b-c39e1466076e\") "
Jul 30 19:47:23.738925 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.738902    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/789c067d-24ee-45b6-a65b-c39e1466076e-kube-api-access-5pjzb" (OuterVolumeSpecName: "kube-api-access-5pjzb") pod "789c067d-24ee-45b6-a65b-c39e1466076e" (UID: "789c067d-24ee-45b6-a65b-c39e1466076e"). InnerVolumeSpecName "kube-api-access-5pjzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:47:23.837585 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.837557    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pjzb\" (UniqueName: \"kubernetes.io/projected/789c067d-24ee-45b6-a65b-c39e1466076e-kube-api-access-5pjzb\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:47:23.840744 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.840715    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a" path="/var/lib/kubelet/pods/44915ba6-3e0c-4cbf-a6c5-210d80fc5d6a/volumes"
Jul 30 19:47:23.841024 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:23.841005    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7be3135b-db50-418e-8e18-ab88e08963c4" path="/var/lib/kubelet/pods/7be3135b-db50-418e-8e18-ab88e08963c4/volumes"
Jul 30 19:47:24.390381 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:24.390350    2561 generic.go:356] "Generic (PLEG): container finished" podID="789c067d-24ee-45b6-a65b-c39e1466076e" containerID="4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6" exitCode=0
Jul 30 19:47:24.390810 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:24.390392    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bxz48"
Jul 30 19:47:24.390810 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:24.390395    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bxz48" event={"ID":"789c067d-24ee-45b6-a65b-c39e1466076e","Type":"ContainerDied","Data":"4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6"}
Jul 30 19:47:24.390810 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:24.390439    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bxz48" event={"ID":"789c067d-24ee-45b6-a65b-c39e1466076e","Type":"ContainerDied","Data":"a2acc5873f31263b933c4956b5266d01c0e4bcbe317b2f5dd4fdecd450657c90"}
Jul 30 19:47:24.390810 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:24.390457    2561 scope.go:117] "RemoveContainer" containerID="4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6"
Jul 30 19:47:24.399219 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:24.399201    2561 scope.go:117] "RemoveContainer" containerID="4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6"
Jul 30 19:47:24.399463 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:47:24.399441    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6\": container with ID starting with 4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6 not found: ID does not exist" containerID="4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6"
Jul 30 19:47:24.399562 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:24.399469    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6"} err="failed to get container status \"4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6\": rpc error: code = NotFound desc = could not find container \"4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6\": container with ID starting with 4e111fca1612b986d044c7b178770ed843b9b256733ecfc542ca198043ea23b6 not found: ID does not exist"
Jul 30 19:47:24.407067 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:24.407036    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxz48"]
Jul 30 19:47:24.409053 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:24.409032    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxz48"]
Jul 30 19:47:25.840218 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:25.840181    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="789c067d-24ee-45b6-a65b-c39e1466076e" path="/var/lib/kubelet/pods/789c067d-24ee-45b6-a65b-c39e1466076e/volumes"
Jul 30 19:47:28.053839 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:28.053808    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:28.152074 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:28.152047    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:28.220310 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:28.220287    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:28.278076 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:28.278056    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:31.155911 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:31.155860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:47:31.255451 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:47:31.255424    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:02.732817 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:02.732778    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:02.830618 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:02.830589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:04.226762 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.226726    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:04.403737 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.403705    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:04.807262 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.807232    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:04.904459 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.904433    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:04.986879 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.986849    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"]
Jul 30 19:48:04.987229 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.987215    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789c067d-24ee-45b6-a65b-c39e1466076e" containerName="authorino"
Jul 30 19:48:04.987308 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.987231    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="789c067d-24ee-45b6-a65b-c39e1466076e" containerName="authorino"
Jul 30 19:48:04.987308 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.987289    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="789c067d-24ee-45b6-a65b-c39e1466076e" containerName="authorino"
Jul 30 19:48:04.990481 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.990462    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"
Jul 30 19:48:04.993287 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.993268    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-m6h8r\""
Jul 30 19:48:04.993287 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:04.993274    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 30 19:48:05.000159 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:05.000137    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"]
Jul 30 19:48:05.023553 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:05.023519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65eb85d6-5e35-4450-ac1f-9f1dd71fa99e-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-j8z4b\" (UID: \"65eb85d6-5e35-4450-ac1f-9f1dd71fa99e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"
Jul 30 19:48:05.023667 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:05.023559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj794\" (UniqueName: \"kubernetes.io/projected/65eb85d6-5e35-4450-ac1f-9f1dd71fa99e-kube-api-access-fj794\") pod \"payload-pre-processing-687dbb6cf6-j8z4b\" (UID: \"65eb85d6-5e35-4450-ac1f-9f1dd71fa99e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"
Jul 30 19:48:05.124828 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:05.124770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65eb85d6-5e35-4450-ac1f-9f1dd71fa99e-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-j8z4b\" (UID: \"65eb85d6-5e35-4450-ac1f-9f1dd71fa99e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"
Jul 30 19:48:05.124828 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:05.124806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj794\" (UniqueName: \"kubernetes.io/projected/65eb85d6-5e35-4450-ac1f-9f1dd71fa99e-kube-api-access-fj794\") pod \"payload-pre-processing-687dbb6cf6-j8z4b\" (UID: \"65eb85d6-5e35-4450-ac1f-9f1dd71fa99e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"
Jul 30 19:48:05.125482 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:05.125465    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65eb85d6-5e35-4450-ac1f-9f1dd71fa99e-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-j8z4b\" (UID: \"65eb85d6-5e35-4450-ac1f-9f1dd71fa99e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"
Jul 30 19:48:05.132943 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:05.132921    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj794\" (UniqueName: \"kubernetes.io/projected/65eb85d6-5e35-4450-ac1f-9f1dd71fa99e-kube-api-access-fj794\") pod \"payload-pre-processing-687dbb6cf6-j8z4b\" (UID: \"65eb85d6-5e35-4450-ac1f-9f1dd71fa99e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"
Jul 30 19:48:05.301434 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:05.301407    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"
Jul 30 19:48:05.428254 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:05.428225    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"]
Jul 30 19:48:05.430088 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:48:05.430062    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65eb85d6_5e35_4450_ac1f_9f1dd71fa99e.slice/crio-f9bbffe24968d5c38ec4a3f273a55796f37f1d31a6d6f3f3ba7054566cda2243 WatchSource:0}: Error finding container f9bbffe24968d5c38ec4a3f273a55796f37f1d31a6d6f3f3ba7054566cda2243: Status 404 returned error can't find the container with id f9bbffe24968d5c38ec4a3f273a55796f37f1d31a6d6f3f3ba7054566cda2243
Jul 30 19:48:05.608479 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:05.608453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b" event={"ID":"65eb85d6-5e35-4450-ac1f-9f1dd71fa99e","Type":"ContainerStarted","Data":"f9bbffe24968d5c38ec4a3f273a55796f37f1d31a6d6f3f3ba7054566cda2243"}
Jul 30 19:48:07.622412 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:07.622339    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b" event={"ID":"65eb85d6-5e35-4450-ac1f-9f1dd71fa99e","Type":"ContainerStarted","Data":"c09f3688c7438ec41c5d2caa27bc3f1dedd53ab3b81f613b678c5cb037b34a50"}
Jul 30 19:48:07.622816 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:07.622480    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"
Jul 30 19:48:07.641088 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:07.641036    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b" podStartSLOduration=1.916396983 podStartE2EDuration="3.641018854s" totalImagesPullingTime="1.724621871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:48:07.636933325 +0000 UTC m=+530.277348407" watchObservedRunningTime="2026-07-30 19:48:07.641018854 +0000 UTC m=+530.281433936"
Jul 30 19:48:15.008423 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:15.008323    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:15.108912 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:15.108865    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:18.630352 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:18.630321    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-j8z4b"
Jul 30 19:48:25.530092 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:25.530042    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:34.091870 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.091832    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"]
Jul 30 19:48:34.096567 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.096546    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.101267 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.100802    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 19:48:34.101267 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.100841    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 30 19:48:34.101267 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.101061    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 19:48:34.105404 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.104572    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"]
Jul 30 19:48:34.105404 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.104655    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-866sb\""
Jul 30 19:48:34.122362 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.122327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9vcp\" (UniqueName: \"kubernetes.io/projected/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-kube-api-access-r9vcp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.122604 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.122563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.122772 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.122747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.122919 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.122788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.123006 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.122921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.123006 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.122955    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.123096 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.123034    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:34.224170 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.224144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9vcp\" (UniqueName: \"kubernetes.io/projected/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-kube-api-access-r9vcp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.224304 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.224179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.224304 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.224209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.224304 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.224232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.224304 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.224291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.224524 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.224320    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.224584 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.224556    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.224643 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.224608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.224643 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.224632    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.226624 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.226595    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.226726 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.226710    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.231969 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.231946    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9vcp\" (UniqueName: \"kubernetes.io/projected/cc79b080-c0e0-4e8a-9ab9-c425110dd5fa-kube-api-access-r9vcp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xb67r\" (UID: \"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.411228 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.411204    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:34.540430 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.540401    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"]
Jul 30 19:48:34.542223 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:48:34.542198    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc79b080_c0e0_4e8a_9ab9_c425110dd5fa.slice/crio-4930960f4a0c5d08bba4f5ccde46d9b253acf8fa4b02a5e0264e4e2d2d1ab091 WatchSource:0}: Error finding container 4930960f4a0c5d08bba4f5ccde46d9b253acf8fa4b02a5e0264e4e2d2d1ab091: Status 404 returned error can't find the container with id 4930960f4a0c5d08bba4f5ccde46d9b253acf8fa4b02a5e0264e4e2d2d1ab091
Jul 30 19:48:34.769996 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:34.769924    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r" event={"ID":"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa","Type":"ContainerStarted","Data":"4930960f4a0c5d08bba4f5ccde46d9b253acf8fa4b02a5e0264e4e2d2d1ab091"}
Jul 30 19:48:35.399256 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:35.399218    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:35.776234 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:35.776163    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r" event={"ID":"cc79b080-c0e0-4e8a-9ab9-c425110dd5fa","Type":"ContainerStarted","Data":"b60249e4bd4763d490f8cdb80849e03c04028da54edb5ba95538082d5e4c59d7"}
Jul 30 19:48:35.809394 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:35.809351    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r" podStartSLOduration=0.774474768 podStartE2EDuration="1.809336444s" totalImagesPullingTime="1.034861676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:48:35.807996129 +0000 UTC m=+558.448411212" watchObservedRunningTime="2026-07-30 19:48:35.809336444 +0000 UTC m=+558.449751524"
Jul 30 19:48:38.378983 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:38.378947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:38.702400 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:38.702316    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:48:44.412040 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:44.412008    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:44.412438 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:44.412062    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:44.424470 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:44.424443    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:44.836647 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:44.836569    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xb67r"
Jul 30 19:48:53.933066 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:48:53.933036    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:49:05.595900 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.595843    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"]
Jul 30 19:49:05.599323 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.599304    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.602128 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.602105    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 30 19:49:05.609620 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.609591    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"]
Jul 30 19:49:05.622370 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.622345    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:49:05.653288 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.653263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.653393 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.653302    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.653393 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.653329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqqq9\" (UniqueName: \"kubernetes.io/projected/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-kube-api-access-zqqq9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.653393 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.653347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.653393 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.653371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.653564 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.653401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.754249 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.754220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.754369 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.754269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqqq9\" (UniqueName: \"kubernetes.io/projected/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-kube-api-access-zqqq9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.754369 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.754295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.754369 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.754337    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.754529 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.754487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.754580 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.754533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.754806 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.754787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.754923 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.754870    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.754923 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.754910    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.756462 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.756441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.756790 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.756773    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.762593 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.762568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqqq9\" (UniqueName: \"kubernetes.io/projected/e12d1b00-1bb3-4e0f-9366-cb2b64f7c045-kube-api-access-zqqq9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk\" (UID: \"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:05.910843 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:05.910819    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:06.042112 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:06.042083    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"]
Jul 30 19:49:06.043119 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:49:06.043096    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12d1b00_1bb3_4e0f_9366_cb2b64f7c045.slice/crio-956552554a82473cf357fe5cea1194a6b8046a21fb35aca1b4445e5e4af4982d WatchSource:0}: Error finding container 956552554a82473cf357fe5cea1194a6b8046a21fb35aca1b4445e5e4af4982d: Status 404 returned error can't find the container with id 956552554a82473cf357fe5cea1194a6b8046a21fb35aca1b4445e5e4af4982d
Jul 30 19:49:06.951355 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:06.951290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk" event={"ID":"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045","Type":"ContainerStarted","Data":"cb18922f897893e80889f935e27495fa6bdb4fc617324228abaf4bfc1db43d5b"}
Jul 30 19:49:06.951355 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:06.951352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk" event={"ID":"e12d1b00-1bb3-4e0f-9366-cb2b64f7c045","Type":"ContainerStarted","Data":"956552554a82473cf357fe5cea1194a6b8046a21fb35aca1b4445e5e4af4982d"}
Jul 30 19:49:06.968236 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:06.968194    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk" podStartSLOduration=1.773169279 podStartE2EDuration="1.968178291s" totalImagesPullingTime="195.009012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:49:06.96730866 +0000 UTC m=+589.607723740" watchObservedRunningTime="2026-07-30 19:49:06.968178291 +0000 UTC m=+589.608593371"
Jul 30 19:49:11.598776 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:11.598727    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:49:11.648494 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:11.648465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:49:15.911307 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:15.911265    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:15.911810 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:15.911334    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:15.923954 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:15.923922    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:16.010315 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:16.010287    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk"
Jul 30 19:49:17.844012 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:17.843916    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:49:17.845151 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:17.844321    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:49:17.851218 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:17.851201    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:49:17.851679 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:17.851659    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:49:20.689137 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:20.689092    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:49:26.931779 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:49:26.931747    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:50:19.884555 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:19.884511    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-559c9c7696-rcxdr"]
Jul 30 19:50:19.887824 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:19.887798    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559c9c7696-rcxdr"
Jul 30 19:50:19.899600 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:19.899575    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-559c9c7696-rcxdr"]
Jul 30 19:50:20.003655 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:20.003628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3feeb4e7-6265-42c0-a39f-50c9ebb82e71-tls-cert\") pod \"authorino-559c9c7696-rcxdr\" (UID: \"3feeb4e7-6265-42c0-a39f-50c9ebb82e71\") " pod="kuadrant-system/authorino-559c9c7696-rcxdr"
Jul 30 19:50:20.003776 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:20.003675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mkgg\" (UniqueName: \"kubernetes.io/projected/3feeb4e7-6265-42c0-a39f-50c9ebb82e71-kube-api-access-2mkgg\") pod \"authorino-559c9c7696-rcxdr\" (UID: \"3feeb4e7-6265-42c0-a39f-50c9ebb82e71\") " pod="kuadrant-system/authorino-559c9c7696-rcxdr"
Jul 30 19:50:20.104623 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:20.104596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3feeb4e7-6265-42c0-a39f-50c9ebb82e71-tls-cert\") pod \"authorino-559c9c7696-rcxdr\" (UID: \"3feeb4e7-6265-42c0-a39f-50c9ebb82e71\") " pod="kuadrant-system/authorino-559c9c7696-rcxdr"
Jul 30 19:50:20.104744 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:20.104644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mkgg\" (UniqueName: \"kubernetes.io/projected/3feeb4e7-6265-42c0-a39f-50c9ebb82e71-kube-api-access-2mkgg\") pod \"authorino-559c9c7696-rcxdr\" (UID: \"3feeb4e7-6265-42c0-a39f-50c9ebb82e71\") " pod="kuadrant-system/authorino-559c9c7696-rcxdr"
Jul 30 19:50:20.106952 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:20.106934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3feeb4e7-6265-42c0-a39f-50c9ebb82e71-tls-cert\") pod \"authorino-559c9c7696-rcxdr\" (UID: \"3feeb4e7-6265-42c0-a39f-50c9ebb82e71\") " pod="kuadrant-system/authorino-559c9c7696-rcxdr"
Jul 30 19:50:20.111964 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:20.111934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mkgg\" (UniqueName: \"kubernetes.io/projected/3feeb4e7-6265-42c0-a39f-50c9ebb82e71-kube-api-access-2mkgg\") pod \"authorino-559c9c7696-rcxdr\" (UID: \"3feeb4e7-6265-42c0-a39f-50c9ebb82e71\") " pod="kuadrant-system/authorino-559c9c7696-rcxdr"
Jul 30 19:50:20.199907 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:20.199833    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559c9c7696-rcxdr"
Jul 30 19:50:20.329737 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:20.329701    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-559c9c7696-rcxdr"]
Jul 30 19:50:20.331202 ip-10-0-135-254 kubenswrapper[2561]: W0730 19:50:20.331169    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3feeb4e7_6265_42c0_a39f_50c9ebb82e71.slice/crio-e38898fcdf53aded09aa49c8868a788bd6962b6c2df9468dca64490c14b68651 WatchSource:0}: Error finding container e38898fcdf53aded09aa49c8868a788bd6962b6c2df9468dca64490c14b68651: Status 404 returned error can't find the container with id e38898fcdf53aded09aa49c8868a788bd6962b6c2df9468dca64490c14b68651
Jul 30 19:50:20.332439 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:20.332416    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 19:50:20.343127 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:20.343101    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-559c9c7696-rcxdr" event={"ID":"3feeb4e7-6265-42c0-a39f-50c9ebb82e71","Type":"ContainerStarted","Data":"e38898fcdf53aded09aa49c8868a788bd6962b6c2df9468dca64490c14b68651"}
Jul 30 19:50:21.352713 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.352665    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-559c9c7696-rcxdr" event={"ID":"3feeb4e7-6265-42c0-a39f-50c9ebb82e71","Type":"ContainerStarted","Data":"68e415bcf9cbe40d170524a27f1103f3e717114635c903d3febe03b6caccbeb3"}
Jul 30 19:50:21.369649 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.369598    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-559c9c7696-rcxdr" podStartSLOduration=1.847459094 podStartE2EDuration="2.369582584s" totalImagesPullingTime="522.12349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:50:21.368908373 +0000 UTC m=+664.009323449" watchObservedRunningTime="2026-07-30 19:50:21.369582584 +0000 UTC m=+664.009997664"
Jul 30 19:50:21.402776 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.402739    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59ff4ccd5-tcsht"]
Jul 30 19:50:21.403007 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.402978    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59ff4ccd5-tcsht" podUID="6eb081a4-ea48-406c-b918-d53d5d37acaa" containerName="authorino" containerID="cri-o://9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5" gracePeriod=30
Jul 30 19:50:21.666038 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.666009    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59ff4ccd5-tcsht"
Jul 30 19:50:21.723012 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.722986    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6eb081a4-ea48-406c-b918-d53d5d37acaa-tls-cert\") pod \"6eb081a4-ea48-406c-b918-d53d5d37acaa\" (UID: \"6eb081a4-ea48-406c-b918-d53d5d37acaa\") "
Jul 30 19:50:21.723219 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.723054    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tshsl\" (UniqueName: \"kubernetes.io/projected/6eb081a4-ea48-406c-b918-d53d5d37acaa-kube-api-access-tshsl\") pod \"6eb081a4-ea48-406c-b918-d53d5d37acaa\" (UID: \"6eb081a4-ea48-406c-b918-d53d5d37acaa\") "
Jul 30 19:50:21.725584 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.725539    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eb081a4-ea48-406c-b918-d53d5d37acaa-kube-api-access-tshsl" (OuterVolumeSpecName: "kube-api-access-tshsl") pod "6eb081a4-ea48-406c-b918-d53d5d37acaa" (UID: "6eb081a4-ea48-406c-b918-d53d5d37acaa"). InnerVolumeSpecName "kube-api-access-tshsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:50:21.734297 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.734273    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eb081a4-ea48-406c-b918-d53d5d37acaa-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6eb081a4-ea48-406c-b918-d53d5d37acaa" (UID: "6eb081a4-ea48-406c-b918-d53d5d37acaa"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:50:21.823826 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.823785    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tshsl\" (UniqueName: \"kubernetes.io/projected/6eb081a4-ea48-406c-b918-d53d5d37acaa-kube-api-access-tshsl\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:50:21.823826 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.823817    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6eb081a4-ea48-406c-b918-d53d5d37acaa-tls-cert\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 19:50:21.895101 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.895023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:50:21.985785 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:21.985747    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:50:22.358982 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:22.358880    2561 generic.go:356] "Generic (PLEG): container finished" podID="6eb081a4-ea48-406c-b918-d53d5d37acaa" containerID="9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5" exitCode=0
Jul 30 19:50:22.358982 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:22.358930    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59ff4ccd5-tcsht"
Jul 30 19:50:22.358982 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:22.358958    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59ff4ccd5-tcsht" event={"ID":"6eb081a4-ea48-406c-b918-d53d5d37acaa","Type":"ContainerDied","Data":"9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5"}
Jul 30 19:50:22.359522 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:22.358997    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59ff4ccd5-tcsht" event={"ID":"6eb081a4-ea48-406c-b918-d53d5d37acaa","Type":"ContainerDied","Data":"ff6ab4f810695e694fbc9d477102bf11aa692d9bad63a126bac5823001c6199f"}
Jul 30 19:50:22.359522 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:22.359015    2561 scope.go:117] "RemoveContainer" containerID="9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5"
Jul 30 19:50:22.368022 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:22.368002    2561 scope.go:117] "RemoveContainer" containerID="9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5"
Jul 30 19:50:22.368295 ip-10-0-135-254 kubenswrapper[2561]: E0730 19:50:22.368277    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5\": container with ID starting with 9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5 not found: ID does not exist" containerID="9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5"
Jul 30 19:50:22.368350 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:22.368304    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5"} err="failed to get container status \"9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5\": rpc error: code = NotFound desc = could not find container \"9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5\": container with ID starting with 9d0d72651150b258bfc88b113816fda7c687c769ebf1ac1e7236a86e973824c5 not found: ID does not exist"
Jul 30 19:50:22.392592 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:22.392568    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59ff4ccd5-tcsht"]
Jul 30 19:50:22.406013 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:22.405989    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59ff4ccd5-tcsht"]
Jul 30 19:50:23.001977 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:23.001941    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:50:23.126228 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:23.126195    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:50:23.840409 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:23.840368    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eb081a4-ea48-406c-b918-d53d5d37acaa" path="/var/lib/kubelet/pods/6eb081a4-ea48-406c-b918-d53d5d37acaa/volumes"
Jul 30 19:50:23.982763 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:23.982732    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:50:36.093399 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:36.093362    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:50:36.142794 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:50:36.142765    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:51:45.651795 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:51:45.651755    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:51:45.752911 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:51:45.752857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:52:06.790316 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:52:06.790267    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:52:26.791107 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:52:26.791073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:52:28.041925 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:52:28.041870    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:53:30.213414 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:53:30.213370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:53:30.316386 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:53:30.316359    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:53:30.439429 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:53:30.439403    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:53:35.928869 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:53:35.928837    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:53:35.986837 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:53:35.986768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:53:36.084494 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:53:36.084465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:53:36.184631 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:53:36.184568    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:53:36.284488 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:53:36.284467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:53:42.007680 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:53:42.007642    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:53:42.063673 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:53:42.063646    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:54:17.876169 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:54:17.876061    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:54:17.881225 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:54:17.877870    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:54:17.882867 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:54:17.882848    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:54:17.884965 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:54:17.884948    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:57:52.429935 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:57:52.429865    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:57:53.734752 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:57:53.734713    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 19:59:17.908773 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:59:17.908749    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:59:17.912709 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:59:17.912690    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 19:59:17.916075 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:59:17.916054    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 19:59:17.920214 ip-10-0-135-254 kubenswrapper[2561]: I0730 19:59:17.920196    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:00:20.825504 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:00:20.825407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:00:27.146233 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:00:27.146193    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:02:30.239616 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:30.239583    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:02:58.398905 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.398855    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"]
Jul 30 20:02:58.399408 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.399236    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb081a4-ea48-406c-b918-d53d5d37acaa" containerName="authorino"
Jul 30 20:02:58.399408 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.399249    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb081a4-ea48-406c-b918-d53d5d37acaa" containerName="authorino"
Jul 30 20:02:58.399408 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.399317    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eb081a4-ea48-406c-b918-d53d5d37acaa" containerName="authorino"
Jul 30 20:02:58.402381 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.402363    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.405158 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.405129    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-6eab07dd-kserve-self-signed-certs\""
Jul 30 20:02:58.418398 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.418365    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"]
Jul 30 20:02:58.425587 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.425567    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:02:58.492147 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.492120    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwx2k\" (UniqueName: \"kubernetes.io/projected/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-kube-api-access-mwx2k\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.492253 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.492155    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tls-certs\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.492253 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.492180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-home\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.492253 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.492223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-model-cache\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.492253 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.492246    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tmp-dir\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.492406 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.492287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-dshm\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.592623 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.592599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwx2k\" (UniqueName: \"kubernetes.io/projected/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-kube-api-access-mwx2k\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.592720 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.592636    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tls-certs\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.592720 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.592663    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-home\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.592832 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.592780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-model-cache\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.592910 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.592829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tmp-dir\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.592983 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.592913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-dshm\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.593045 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.593017    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-home\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.593174 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.593142    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-model-cache\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.593222 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.593172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tmp-dir\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.594983 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.594962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-dshm\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.595172 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.595155    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tls-certs\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.600182 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.600166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwx2k\" (UniqueName: \"kubernetes.io/projected/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-kube-api-access-mwx2k\") pod \"e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") " pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.712336 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.712289    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:02:58.839681 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:58.839651    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"]
Jul 30 20:02:58.841216 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:02:58.841182    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67e0e2f9_c14f_4837_a4eb_2d10aa2df56d.slice/crio-43202260dc232eef4b3855e1c721219b0cf96d03f198c18c840f624f769f2329 WatchSource:0}: Error finding container 43202260dc232eef4b3855e1c721219b0cf96d03f198c18c840f624f769f2329: Status 404 returned error can't find the container with id 43202260dc232eef4b3855e1c721219b0cf96d03f198c18c840f624f769f2329
Jul 30 20:02:59.498356 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:59.498313    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8" event={"ID":"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d","Type":"ContainerStarted","Data":"1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0"}
Jul 30 20:02:59.498776 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:59.498369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8" event={"ID":"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d","Type":"ContainerStarted","Data":"43202260dc232eef4b3855e1c721219b0cf96d03f198c18c840f624f769f2329"}
Jul 30 20:02:59.515344 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:02:59.515293    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8" podStartSLOduration=1.515276664 podStartE2EDuration="1.515276664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:02:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:02:59.514392068 +0000 UTC m=+1422.154807148" watchObservedRunningTime="2026-07-30 20:02:59.515276664 +0000 UTC m=+1422.155691765"
Jul 30 20:03:07.179793 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.179758    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"]
Jul 30 20:03:07.183915 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.183880    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.186695 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.186677    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-6eab07dd-kserve-self-signed-certs\""
Jul 30 20:03:07.192667 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.192644    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"]
Jul 30 20:03:07.204451 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.204427    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:03:07.262378 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.262359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-model-cache\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.262484 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.262394    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-dshm\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.262484 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.262419    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7471da9d-3c41-4072-8079-bac44a7c517f-tls-certs\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.262604 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.262500    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-tmp-dir\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.262644 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.262604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xddxk\" (UniqueName: \"kubernetes.io/projected/7471da9d-3c41-4072-8079-bac44a7c517f-kube-api-access-xddxk\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.262644 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.262636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-home\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.363323 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.363299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-home\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.363435 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.363336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-model-cache\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.363435 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.363362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-dshm\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.363435 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.363379    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7471da9d-3c41-4072-8079-bac44a7c517f-tls-certs\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.363610 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.363507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-tmp-dir\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.363610 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.363587    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xddxk\" (UniqueName: \"kubernetes.io/projected/7471da9d-3c41-4072-8079-bac44a7c517f-kube-api-access-xddxk\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.363751 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.363715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-home\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.363915 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.363757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-model-cache\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.363915 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.363850    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-tmp-dir\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.365762 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.365733    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-dshm\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.366034 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.366013    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7471da9d-3c41-4072-8079-bac44a7c517f-tls-certs\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.371164 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.371140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xddxk\" (UniqueName: \"kubernetes.io/projected/7471da9d-3c41-4072-8079-bac44a7c517f-kube-api-access-xddxk\") pod \"e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") " pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.494034 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.493984    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:07.627740 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:07.627714    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"]
Jul 30 20:03:07.630124 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:03:07.630097    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7471da9d_3c41_4072_8079_bac44a7c517f.slice/crio-6fbd6d31b2bb821af0f46fc960f00183b9600eb094d1dd17fe8b957ff552624f WatchSource:0}: Error finding container 6fbd6d31b2bb821af0f46fc960f00183b9600eb094d1dd17fe8b957ff552624f: Status 404 returned error can't find the container with id 6fbd6d31b2bb821af0f46fc960f00183b9600eb094d1dd17fe8b957ff552624f
Jul 30 20:03:08.553298 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:08.553265    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp" event={"ID":"7471da9d-3c41-4072-8079-bac44a7c517f","Type":"ContainerStarted","Data":"d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e"}
Jul 30 20:03:08.553747 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:08.553305    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp" event={"ID":"7471da9d-3c41-4072-8079-bac44a7c517f","Type":"ContainerStarted","Data":"6fbd6d31b2bb821af0f46fc960f00183b9600eb094d1dd17fe8b957ff552624f"}
Jul 30 20:03:08.569742 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:08.569690    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp" podStartSLOduration=1.569674842 podStartE2EDuration="1.569674842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:03:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:03:08.567708372 +0000 UTC m=+1431.208123453" watchObservedRunningTime="2026-07-30 20:03:08.569674842 +0000 UTC m=+1431.210089922"
Jul 30 20:03:08.713179 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:08.713153    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:03:08.713313 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:08.713223    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:03:08.725522 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:08.725502    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:03:09.570493 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:09.570463    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:03:17.494608 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:17.494531    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:17.494608 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:17.494578    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:17.506845 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:17.506824    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:17.613020 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:17.612999    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:23.722292 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:23.722253    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"]
Jul 30 20:03:23.767717 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:23.767685    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:03:24.783809 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:24.783780    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"]
Jul 30 20:03:24.803489 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:24.803462    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:03:38.742754 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:38.742691    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8" podUID="67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" containerName="main" containerID="cri-o://1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0" gracePeriod=45
Jul 30 20:03:38.988440 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:38.988410    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:03:39.117496 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.117428    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwx2k\" (UniqueName: \"kubernetes.io/projected/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-kube-api-access-mwx2k\") pod \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") "
Jul 30 20:03:39.117496 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.117484    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tls-certs\") pod \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") "
Jul 30 20:03:39.117694 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.117512    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tmp-dir\") pod \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") "
Jul 30 20:03:39.117694 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.117533    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-dshm\") pod \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") "
Jul 30 20:03:39.117694 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.117573    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-home\") pod \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") "
Jul 30 20:03:39.117694 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.117633    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-model-cache\") pod \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\" (UID: \"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d\") "
Jul 30 20:03:39.117905 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.117797    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" (UID: "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:03:39.117905 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.117850    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-home" (OuterVolumeSpecName: "home") pod "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" (UID: "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:03:39.118014 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.117970    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-model-cache" (OuterVolumeSpecName: "model-cache") pod "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" (UID: "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:03:39.118074 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.118024    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:39.118074 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.118045    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:39.119713 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.119680    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-dshm" (OuterVolumeSpecName: "dshm") pod "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" (UID: "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:03:39.119833 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.119784    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" (UID: "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:03:39.119833 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.119796    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-kube-api-access-mwx2k" (OuterVolumeSpecName: "kube-api-access-mwx2k") pod "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" (UID: "67e0e2f9-c14f-4837-a4eb-2d10aa2df56d"). InnerVolumeSpecName "kube-api-access-mwx2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:03:39.219412 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.219383    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwx2k\" (UniqueName: \"kubernetes.io/projected/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-kube-api-access-mwx2k\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:39.219412 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.219403    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:39.219412 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.219416    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:39.219586 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.219428    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:39.726096 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.726058    2561 generic.go:356] "Generic (PLEG): container finished" podID="67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" containerID="1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0" exitCode=0
Jul 30 20:03:39.726308 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.726110    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"
Jul 30 20:03:39.726308 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.726132    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8" event={"ID":"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d","Type":"ContainerDied","Data":"1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0"}
Jul 30 20:03:39.726308 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.726175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8" event={"ID":"67e0e2f9-c14f-4837-a4eb-2d10aa2df56d","Type":"ContainerDied","Data":"43202260dc232eef4b3855e1c721219b0cf96d03f198c18c840f624f769f2329"}
Jul 30 20:03:39.726308 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.726211    2561 scope.go:117] "RemoveContainer" containerID="1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0"
Jul 30 20:03:39.735829 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.735809    2561 scope.go:117] "RemoveContainer" containerID="1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0"
Jul 30 20:03:39.736091 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:03:39.736072    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0\": container with ID starting with 1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0 not found: ID does not exist" containerID="1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0"
Jul 30 20:03:39.736155 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.736102    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0"} err="failed to get container status \"1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0\": rpc error: code = NotFound desc = could not find container \"1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0\": container with ID starting with 1309bfa46666f0f900db6c69a9e2015791b030142f7dffa7895587c2b6bea1a0 not found: ID does not exist"
Jul 30 20:03:39.747486 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.747460    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"]
Jul 30 20:03:39.751341 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.751318    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-6eab07dd-kserve-79d6fdff9-tz5v8"]
Jul 30 20:03:39.802700 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.802652    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp" podUID="7471da9d-3c41-4072-8079-bac44a7c517f" containerName="main" containerID="cri-o://d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e" gracePeriod=45
Jul 30 20:03:39.846455 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:39.846428    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" path="/var/lib/kubelet/pods/67e0e2f9-c14f-4837-a4eb-2d10aa2df56d/volumes"
Jul 30 20:03:40.055898 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.055859    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:40.126584 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.126558    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-tmp-dir\") pod \"7471da9d-3c41-4072-8079-bac44a7c517f\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") "
Jul 30 20:03:40.126717 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.126587    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-model-cache\") pod \"7471da9d-3c41-4072-8079-bac44a7c517f\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") "
Jul 30 20:03:40.126717 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.126657    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xddxk\" (UniqueName: \"kubernetes.io/projected/7471da9d-3c41-4072-8079-bac44a7c517f-kube-api-access-xddxk\") pod \"7471da9d-3c41-4072-8079-bac44a7c517f\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") "
Jul 30 20:03:40.126717 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.126676    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-dshm\") pod \"7471da9d-3c41-4072-8079-bac44a7c517f\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") "
Jul 30 20:03:40.126922 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.126740    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7471da9d-3c41-4072-8079-bac44a7c517f-tls-certs\") pod \"7471da9d-3c41-4072-8079-bac44a7c517f\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") "
Jul 30 20:03:40.126922 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.126762    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-home\") pod \"7471da9d-3c41-4072-8079-bac44a7c517f\" (UID: \"7471da9d-3c41-4072-8079-bac44a7c517f\") "
Jul 30 20:03:40.126922 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.126815    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7471da9d-3c41-4072-8079-bac44a7c517f" (UID: "7471da9d-3c41-4072-8079-bac44a7c517f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:03:40.127094 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.126937    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-model-cache" (OuterVolumeSpecName: "model-cache") pod "7471da9d-3c41-4072-8079-bac44a7c517f" (UID: "7471da9d-3c41-4072-8079-bac44a7c517f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:03:40.127094 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.127061    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-home" (OuterVolumeSpecName: "home") pod "7471da9d-3c41-4072-8079-bac44a7c517f" (UID: "7471da9d-3c41-4072-8079-bac44a7c517f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:03:40.127191 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.127094    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:40.127191 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.127118    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:40.128834 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.128807    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7471da9d-3c41-4072-8079-bac44a7c517f-kube-api-access-xddxk" (OuterVolumeSpecName: "kube-api-access-xddxk") pod "7471da9d-3c41-4072-8079-bac44a7c517f" (UID: "7471da9d-3c41-4072-8079-bac44a7c517f"). InnerVolumeSpecName "kube-api-access-xddxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:03:40.128953 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.128829    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7471da9d-3c41-4072-8079-bac44a7c517f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7471da9d-3c41-4072-8079-bac44a7c517f" (UID: "7471da9d-3c41-4072-8079-bac44a7c517f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:03:40.128953 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.128829    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-dshm" (OuterVolumeSpecName: "dshm") pod "7471da9d-3c41-4072-8079-bac44a7c517f" (UID: "7471da9d-3c41-4072-8079-bac44a7c517f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:03:40.228347 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.228322    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7471da9d-3c41-4072-8079-bac44a7c517f-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:40.228347 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.228343    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:40.228467 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.228352    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xddxk\" (UniqueName: \"kubernetes.io/projected/7471da9d-3c41-4072-8079-bac44a7c517f-kube-api-access-xddxk\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:40.228467 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.228361    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7471da9d-3c41-4072-8079-bac44a7c517f-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:03:40.733667 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.733625    2561 generic.go:356] "Generic (PLEG): container finished" podID="7471da9d-3c41-4072-8079-bac44a7c517f" containerID="d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e" exitCode=0
Jul 30 20:03:40.733851 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.733672    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"
Jul 30 20:03:40.733851 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.733714    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp" event={"ID":"7471da9d-3c41-4072-8079-bac44a7c517f","Type":"ContainerDied","Data":"d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e"}
Jul 30 20:03:40.733851 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.733761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp" event={"ID":"7471da9d-3c41-4072-8079-bac44a7c517f","Type":"ContainerDied","Data":"6fbd6d31b2bb821af0f46fc960f00183b9600eb094d1dd17fe8b957ff552624f"}
Jul 30 20:03:40.733851 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.733785    2561 scope.go:117] "RemoveContainer" containerID="d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e"
Jul 30 20:03:40.743996 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.743979    2561 scope.go:117] "RemoveContainer" containerID="d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e"
Jul 30 20:03:40.744256 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:03:40.744237    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e\": container with ID starting with d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e not found: ID does not exist" containerID="d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e"
Jul 30 20:03:40.744307 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.744263    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e"} err="failed to get container status \"d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e\": rpc error: code = NotFound desc = could not find container \"d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e\": container with ID starting with d8bd7c10071268c718fa1d9553efe2b6ab4289b88050752b597d0c0100ee453e not found: ID does not exist"
Jul 30 20:03:40.755988 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.755964    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"]
Jul 30 20:03:40.758104 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:40.758079    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-6eab07dd-kserve-7bb795bb47-wkqtp"]
Jul 30 20:03:41.840898 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:03:41.840853    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7471da9d-3c41-4072-8079-bac44a7c517f" path="/var/lib/kubelet/pods/7471da9d-3c41-4072-8079-bac44a7c517f/volumes"
Jul 30 20:04:17.943099 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:04:17.942973    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:04:17.950188 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:04:17.950164    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:04:17.950609 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:04:17.950586    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:04:17.957085 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:04:17.957067    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:05:28.387284 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:05:28.387241    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:06:59.463068 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:06:59.463035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:35.970587 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:35.970539    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:39.190124 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:39.190093    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:39.288876 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:39.288846    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:39.623861 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:39.623773    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:45.209500 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:45.209420    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:45.307367 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:45.307336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:45.433498 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:45.433469    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:45.797354 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:45.797325    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:45.921668 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:45.921639    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:48.421518 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:48.421490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:48.521573 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:48.521548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:49.640592 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:49.640548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:49.972455 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:49.972362    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:50.100175 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:50.100127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:50.202745 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:50.202714    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:52.789204 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:52.789174    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:07:52.888863 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:07:52.888829    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:09.491962 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:09.491921    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:11.212255 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:11.212188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:11.312539 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:11.312497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:13.714523 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:13.714486    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:13.822492 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:13.822449    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:13.968500 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:13.968431    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:14.577012 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:14.576978    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:14.676741 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:14.676709    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:45.216688 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:45.216656    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:45.316776 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:45.316744    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:45.844226 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:45.844196    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:45.945769 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:45.945742    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:46.045798 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:46.045768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:46.816577 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:46.816547    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:46.917200 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:46.917172    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:48.845286 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:48.845243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:48.944430 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:48.944397    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:50.133118 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:50.133075    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:50.327869 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:50.327835    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:50.678422 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:50.678393    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:08:50.781071 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:08:50.781037    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:14.772925 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.772839    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"]
Jul 30 20:09:14.773389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.773241    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" containerName="main"
Jul 30 20:09:14.773389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.773255    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" containerName="main"
Jul 30 20:09:14.773389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.773272    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7471da9d-3c41-4072-8079-bac44a7c517f" containerName="main"
Jul 30 20:09:14.773389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.773277    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7471da9d-3c41-4072-8079-bac44a7c517f" containerName="main"
Jul 30 20:09:14.773389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.773346    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e0e2f9-c14f-4837-a4eb-2d10aa2df56d" containerName="main"
Jul 30 20:09:14.773389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.773354    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7471da9d-3c41-4072-8079-bac44a7c517f" containerName="main"
Jul 30 20:09:14.776236 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.776219    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"
Jul 30 20:09:14.779086 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.779063    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\""
Jul 30 20:09:14.779086 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.779081    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 20:09:14.783704 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.783677    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"]
Jul 30 20:09:14.811500 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.811469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2525c8-9daa-47a7-bb7d-0488b967a6a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv\" (UID: \"5f2525c8-9daa-47a7-bb7d-0488b967a6a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"
Jul 30 20:09:14.912319 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.912295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2525c8-9daa-47a7-bb7d-0488b967a6a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv\" (UID: \"5f2525c8-9daa-47a7-bb7d-0488b967a6a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"
Jul 30 20:09:14.912823 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:14.912805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2525c8-9daa-47a7-bb7d-0488b967a6a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv\" (UID: \"5f2525c8-9daa-47a7-bb7d-0488b967a6a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"
Jul 30 20:09:15.088590 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:15.088526    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"
Jul 30 20:09:15.430697 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:15.430670    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"]
Jul 30 20:09:15.432126 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:09:15.432097    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2525c8_9daa_47a7_bb7d_0488b967a6a8.slice/crio-32e23b1ccb48d2fe8d13f182959c057d0abd57415fd2357c210f26bac5586f60 WatchSource:0}: Error finding container 32e23b1ccb48d2fe8d13f182959c057d0abd57415fd2357c210f26bac5586f60: Status 404 returned error can't find the container with id 32e23b1ccb48d2fe8d13f182959c057d0abd57415fd2357c210f26bac5586f60
Jul 30 20:09:15.434112 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:15.434092    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:09:15.547928 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:15.547902    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv" event={"ID":"5f2525c8-9daa-47a7-bb7d-0488b967a6a8","Type":"ContainerStarted","Data":"32e23b1ccb48d2fe8d13f182959c057d0abd57415fd2357c210f26bac5586f60"}
Jul 30 20:09:17.982562 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:17.982483    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:09:17.993203 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:17.983462    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:09:17.993203 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:17.989966    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:09:17.993203 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:17.990579    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:09:18.563861 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:18.563831    2561 generic.go:356] "Generic (PLEG): container finished" podID="5f2525c8-9daa-47a7-bb7d-0488b967a6a8" containerID="539bc212f48f82b484a313f9eb545fe063cd6304045345a338d9a17b2bffe2e3" exitCode=0
Jul 30 20:09:18.564032 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:18.563882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv" event={"ID":"5f2525c8-9daa-47a7-bb7d-0488b967a6a8","Type":"ContainerDied","Data":"539bc212f48f82b484a313f9eb545fe063cd6304045345a338d9a17b2bffe2e3"}
Jul 30 20:09:19.702343 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:19.702320    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"
Jul 30 20:09:19.749543 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:19.749516    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2525c8-9daa-47a7-bb7d-0488b967a6a8-maas-api-service-ca\") pod \"5f2525c8-9daa-47a7-bb7d-0488b967a6a8\" (UID: \"5f2525c8-9daa-47a7-bb7d-0488b967a6a8\") "
Jul 30 20:09:19.749863 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:19.749845    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f2525c8-9daa-47a7-bb7d-0488b967a6a8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5f2525c8-9daa-47a7-bb7d-0488b967a6a8" (UID: "5f2525c8-9daa-47a7-bb7d-0488b967a6a8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:09:19.850822 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:19.850799    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f2525c8-9daa-47a7-bb7d-0488b967a6a8-maas-api-service-ca\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:09:20.577044 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:20.576998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv" event={"ID":"5f2525c8-9daa-47a7-bb7d-0488b967a6a8","Type":"ContainerDied","Data":"32e23b1ccb48d2fe8d13f182959c057d0abd57415fd2357c210f26bac5586f60"}
Jul 30 20:09:20.577044 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:20.577025    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"
Jul 30 20:09:20.577265 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:20.577069    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32e23b1ccb48d2fe8d13f182959c057d0abd57415fd2357c210f26bac5586f60"
Jul 30 20:09:30.641978 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:30.641944    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:30.711673 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:30.711645    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:30.812096 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:30.812059    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:30.820159 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:30.820133    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"]
Jul 30 20:09:30.822300 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:30.822278    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be206e5c-cc7tv"]
Jul 30 20:09:30.870802 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:30.870774    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:31.841315 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:31.841281    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f2525c8-9daa-47a7-bb7d-0488b967a6a8" path="/var/lib/kubelet/pods/5f2525c8-9daa-47a7-bb7d-0488b967a6a8/volumes"
Jul 30 20:09:32.050397 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:32.050349    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:32.273629 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:32.273602    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:32.531608 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:32.531531    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:32.812036 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:32.811949    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:33.112718 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:33.112628    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:35.153246 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:35.153212    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:35.251689 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:35.251664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:36.316956 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:36.316927    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:36.526586 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:36.526552    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:36.825094 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:36.825052    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:09:36.924650 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:09:36.924602    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:06.854033 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:06.853995    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:06.952997 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:06.952963    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:07.011702 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:07.011671    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:07.164848 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:07.164822    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:07.400175 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:07.400148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:07.871790 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:07.871766    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:07.973673 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:07.973643    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:08.065852 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:08.065824    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:30.054978 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:30.054933    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:35.662667 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:35.662635    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:35.766593 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:35.766536    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:35.859648 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:35.859602    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:35.963031 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:35.962919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:10:36.383999 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:10:36.383950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:02.398811 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:02.398780    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:08.409189 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:08.409148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:08.513704 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:08.513672    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:08.609190 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:08.609149    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:14.253606 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:14.253567    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:24.517122 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:24.517084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:30.070716 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:30.070659    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:30.174068 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:30.174038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:30.271307 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:30.271270    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:40.786141 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:40.786102    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:51.888879 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:51.888838    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:57.154454 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:57.154405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:57.254905 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:57.254856    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:57.967904 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:57.967851    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:58.086717 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:58.086687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:58.214419 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:58.214363    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:58.304217 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:58.304105    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:58.959114 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:58.959055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:59.058965 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:59.058925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:11:59.159060 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:11:59.159032    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:00.711581 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:00.711525    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:06.572559 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:06.572516    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:06.673500 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:06.673459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:07.268448 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:07.268415    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:11.379535 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:11.379432    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:13.023978 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:13.023940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:13.108043 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:13.108008    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:13.298325 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:13.298235    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:13.681748 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:13.681710    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:13.787185 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:13.787145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:16.753418 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:16.753368    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:16.851961 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:16.851934    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:18.023060 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:18.023023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:18.123209 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:18.123183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:18.480350 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:18.480303    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:18.580872 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:18.580841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:46.797388 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:46.797345    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:47.503390 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:47.503350    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:47.601355 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:47.601320    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:47.970518 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:47.970494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:53.864623 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:53.864584    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:12:53.939047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:12:53.939015    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:04.649704 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:04.649669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:04.724878 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:04.724844    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:04.779692 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:04.779662    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:04.866042 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:04.866016    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:05.213522 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:05.213493    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:11.107939 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:11.107903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:12.846163 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:12.846128    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:17.524690 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:17.524653    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:17.630168 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:17.630131    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:17.777409 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:17.777340    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:17.916782 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:17.916755    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:23.570973 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:23.570935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:13:23.633899 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:13:23.633862    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:14:18.023782 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:14:18.023697    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:14:18.027751 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:14:18.026591    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:14:18.031597 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:14:18.031577    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:14:18.034350 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:14:18.034333    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:15:18.073918 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:18.073825    2561 scope.go:117] "RemoveContainer" containerID="539bc212f48f82b484a313f9eb545fe063cd6304045345a338d9a17b2bffe2e3"
Jul 30 20:15:31.332189 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:31.332149    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:15:31.644272 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:31.644238    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:15:31.794172 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:31.794140    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:15:34.853588 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:34.853558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:15:34.952656 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:34.952623    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:15:35.977645 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:35.977613    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:15:36.176559 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:36.176523    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:15:36.480172 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:36.480141    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:15:36.563791 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:36.563763    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:15:59.895903 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:15:59.895851    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:16:00.322269 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:00.322184    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:16:04.288359 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.288324    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"]
Jul 30 20:16:04.288859 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.288670    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2525c8-9daa-47a7-bb7d-0488b967a6a8" containerName="revoke-keys"
Jul 30 20:16:04.288859 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.288681    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2525c8-9daa-47a7-bb7d-0488b967a6a8" containerName="revoke-keys"
Jul 30 20:16:04.288859 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.288746    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2525c8-9daa-47a7-bb7d-0488b967a6a8" containerName="revoke-keys"
Jul 30 20:16:04.296120 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.296099    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.301711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.300868    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-098f06cb\"/\"default-dockercfg-m4z55\""
Jul 30 20:16:04.301711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.301000    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-098f06cb\"/\"kube-root-ca.crt\""
Jul 30 20:16:04.301711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.300865    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-098f06cb\"/\"openshift-service-ca.crt\""
Jul 30 20:16:04.301711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.301219    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-098f06cb\"/\"e2e-lifecycle-model-098f06cb-kserve-self-signed-certs\""
Jul 30 20:16:04.302573 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.302548    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"]
Jul 30 20:16:04.324186 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.324155    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:16:04.430771 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.430750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-model-cache\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.430862 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.430785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-dshm\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.430862 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.430809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bg96\" (UniqueName: \"kubernetes.io/projected/f69b7669-dba5-49b8-8810-38198c660704-kube-api-access-9bg96\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.430961 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.430924    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69b7669-dba5-49b8-8810-38198c660704-tls-certs\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.431001 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.430964    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-home\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.431035 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.431021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-tmp-dir\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.532178 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.532157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69b7669-dba5-49b8-8810-38198c660704-tls-certs\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.532286 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.532191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-home\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.532286 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.532220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-tmp-dir\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.532286 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.532245    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-model-cache\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.532286 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.532282    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-dshm\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.532480 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.532317    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bg96\" (UniqueName: \"kubernetes.io/projected/f69b7669-dba5-49b8-8810-38198c660704-kube-api-access-9bg96\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.532622 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.532598    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-home\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.532719 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.532663    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-tmp-dir\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.532719 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.532676    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-model-cache\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.534675 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.534644    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-dshm\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.534789 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.534767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69b7669-dba5-49b8-8810-38198c660704-tls-certs\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.540115 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.540056    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bg96\" (UniqueName: \"kubernetes.io/projected/f69b7669-dba5-49b8-8810-38198c660704-kube-api-access-9bg96\") pod \"e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") " pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.609688 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.609665    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:04.741014 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.740983    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"]
Jul 30 20:16:04.742403 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:16:04.742377    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf69b7669_dba5_49b8_8810_38198c660704.slice/crio-4883c90ea81151df91f9e20497d02513344f2f0c00d57ae0fb5ee34070a11c1c WatchSource:0}: Error finding container 4883c90ea81151df91f9e20497d02513344f2f0c00d57ae0fb5ee34070a11c1c: Status 404 returned error can't find the container with id 4883c90ea81151df91f9e20497d02513344f2f0c00d57ae0fb5ee34070a11c1c
Jul 30 20:16:04.802239 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:04.802213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t" event={"ID":"f69b7669-dba5-49b8-8810-38198c660704","Type":"ContainerStarted","Data":"4883c90ea81151df91f9e20497d02513344f2f0c00d57ae0fb5ee34070a11c1c"}
Jul 30 20:16:05.808682 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:05.808643    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t" event={"ID":"f69b7669-dba5-49b8-8810-38198c660704","Type":"ContainerStarted","Data":"2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b"}
Jul 30 20:16:05.824711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:05.824668    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t" podStartSLOduration=1.824652987 podStartE2EDuration="1.824652987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:16:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:16:05.824188695 +0000 UTC m=+2208.464603775" watchObservedRunningTime="2026-07-30 20:16:05.824652987 +0000 UTC m=+2208.465068067"
Jul 30 20:16:14.610113 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:14.610073    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:14.610113 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:14.610115    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:14.622852 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:14.622823    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:14.869408 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:14.869343    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:16:55.179370 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:55.179332    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:16:55.256050 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:55.255994    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:16:55.344643 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:55.344611    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:16:58.813278 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:16:58.813244    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:03.805050 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:03.805009    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"]
Jul 30 20:17:03.845804 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:03.845769    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:08.106853 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:08.106805    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:18.825353 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:18.825297    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t" podUID="f69b7669-dba5-49b8-8810-38198c660704" containerName="main" containerID="cri-o://2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b" gracePeriod=45
Jul 30 20:17:19.068200 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.068176    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:17:19.120256 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120196    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-tmp-dir\") pod \"f69b7669-dba5-49b8-8810-38198c660704\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") "
Jul 30 20:17:19.120256 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120229    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-home\") pod \"f69b7669-dba5-49b8-8810-38198c660704\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") "
Jul 30 20:17:19.120444 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120258    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69b7669-dba5-49b8-8810-38198c660704-tls-certs\") pod \"f69b7669-dba5-49b8-8810-38198c660704\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") "
Jul 30 20:17:19.120444 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120296    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-model-cache\") pod \"f69b7669-dba5-49b8-8810-38198c660704\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") "
Jul 30 20:17:19.120444 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120323    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bg96\" (UniqueName: \"kubernetes.io/projected/f69b7669-dba5-49b8-8810-38198c660704-kube-api-access-9bg96\") pod \"f69b7669-dba5-49b8-8810-38198c660704\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") "
Jul 30 20:17:19.120444 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120350    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-dshm\") pod \"f69b7669-dba5-49b8-8810-38198c660704\" (UID: \"f69b7669-dba5-49b8-8810-38198c660704\") "
Jul 30 20:17:19.120663 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120482    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f69b7669-dba5-49b8-8810-38198c660704" (UID: "f69b7669-dba5-49b8-8810-38198c660704"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:17:19.120663 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120497    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-home" (OuterVolumeSpecName: "home") pod "f69b7669-dba5-49b8-8810-38198c660704" (UID: "f69b7669-dba5-49b8-8810-38198c660704"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:17:19.120663 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120600    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-model-cache" (OuterVolumeSpecName: "model-cache") pod "f69b7669-dba5-49b8-8810-38198c660704" (UID: "f69b7669-dba5-49b8-8810-38198c660704"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:17:19.120663 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120655    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:17:19.120833 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120669    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:17:19.120833 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.120684    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:17:19.122548 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.122524    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69b7669-dba5-49b8-8810-38198c660704-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f69b7669-dba5-49b8-8810-38198c660704" (UID: "f69b7669-dba5-49b8-8810-38198c660704"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:17:19.122646 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.122546    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69b7669-dba5-49b8-8810-38198c660704-kube-api-access-9bg96" (OuterVolumeSpecName: "kube-api-access-9bg96") pod "f69b7669-dba5-49b8-8810-38198c660704" (UID: "f69b7669-dba5-49b8-8810-38198c660704"). InnerVolumeSpecName "kube-api-access-9bg96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:17:19.122707 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.122672    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-dshm" (OuterVolumeSpecName: "dshm") pod "f69b7669-dba5-49b8-8810-38198c660704" (UID: "f69b7669-dba5-49b8-8810-38198c660704"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:17:19.207721 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.207699    2561 generic.go:356] "Generic (PLEG): container finished" podID="f69b7669-dba5-49b8-8810-38198c660704" containerID="2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b" exitCode=0
Jul 30 20:17:19.207825 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.207736    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"
Jul 30 20:17:19.207825 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.207774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t" event={"ID":"f69b7669-dba5-49b8-8810-38198c660704","Type":"ContainerDied","Data":"2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b"}
Jul 30 20:17:19.207825 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.207817    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t" event={"ID":"f69b7669-dba5-49b8-8810-38198c660704","Type":"ContainerDied","Data":"4883c90ea81151df91f9e20497d02513344f2f0c00d57ae0fb5ee34070a11c1c"}
Jul 30 20:17:19.207974 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.207834    2561 scope.go:117] "RemoveContainer" containerID="2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b"
Jul 30 20:17:19.217314 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.217299    2561 scope.go:117] "RemoveContainer" containerID="2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b"
Jul 30 20:17:19.217559 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:17:19.217539    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b\": container with ID starting with 2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b not found: ID does not exist" containerID="2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b"
Jul 30 20:17:19.217638 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.217568    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b"} err="failed to get container status \"2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b\": rpc error: code = NotFound desc = could not find container \"2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b\": container with ID starting with 2d817dd1b1abba7ee49bdef04182e19aa2075c231182f4151a5648baf8d1e18b not found: ID does not exist"
Jul 30 20:17:19.221309 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.221292    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69b7669-dba5-49b8-8810-38198c660704-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:17:19.221380 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.221311    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bg96\" (UniqueName: \"kubernetes.io/projected/f69b7669-dba5-49b8-8810-38198c660704-kube-api-access-9bg96\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:17:19.221380 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.221320    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69b7669-dba5-49b8-8810-38198c660704-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:17:19.230430 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.230411    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"]
Jul 30 20:17:19.233406 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.233375    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-098f06cb/e2e-lifecycle-model-098f06cb-kserve-9748755b7-qds9t"]
Jul 30 20:17:19.841391 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:19.841354    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f69b7669-dba5-49b8-8810-38198c660704" path="/var/lib/kubelet/pods/f69b7669-dba5-49b8-8810-38198c660704/volumes"
Jul 30 20:17:40.214168 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:40.214127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:40.865934 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:40.865868    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:43.192122 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:43.192084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:46.253440 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:46.253406    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:46.313031 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:46.313002    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:46.545765 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:46.545684    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:46.813244 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:46.813152    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:58.276636 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:58.276595    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:58.377150 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:58.377115    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:58.479928 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:58.479903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:59.177725 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:59.177683    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:59.285003 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:59.284962    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:17:59.376472 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:17:59.376435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:00.709961 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:00.709919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:06.384253 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:06.384209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:07.278328 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:07.278289    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:07.376024 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:07.375988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:14.153253 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:14.153155    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:15.424524 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:15.424483    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:24.931309 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:24.931271    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:25.196628 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:25.196549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:33.229145 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:33.229106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:46.244168 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:46.244131    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:52.672102 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:52.672063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:52.774450 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:52.774412    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:53.069977 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:53.069857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:53.424090 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:53.424054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:54.624313 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:54.624277    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:56.038954 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:56.038914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:56.149013 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:56.148980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:57.174059 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:57.174027    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:57.336939 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:57.336880    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:57.686030 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:57.686000    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:18:57.775793 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:18:57.775764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:18.065563 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:18.065462    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:19:18.070514 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:18.070489    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:19:18.073830 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:18.073807    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:19:18.078232 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:18.078212    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:19:21.100782 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:21.100743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:21.501500 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:21.501456    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:21.832526 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:21.832451    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:22.088565 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:22.088485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:25.191068 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:25.191032    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:25.292673 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:25.292641    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:26.394370 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:26.394332    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:26.626143 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:26.626108    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:26.946658 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:26.946627    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:27.049716 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.049673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:27.051083 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.051063    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"]
Jul 30 20:19:27.051404 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.051392    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69b7669-dba5-49b8-8810-38198c660704" containerName="main"
Jul 30 20:19:27.051451 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.051405    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69b7669-dba5-49b8-8810-38198c660704" containerName="main"
Jul 30 20:19:27.051487 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.051467    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69b7669-dba5-49b8-8810-38198c660704" containerName="main"
Jul 30 20:19:27.054689 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.054670    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:19:27.057627 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.057606    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-7edd0a\""
Jul 30 20:19:27.057720 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.057661    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-7edd0a-dockercfg-b47gw\""
Jul 30 20:19:27.064834 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.064810    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"]
Jul 30 20:19:27.088480 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.088451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8rgw\" (UniqueName: \"kubernetes.io/projected/f7f021bf-265e-407b-ab76-11fc8afa0d20-kube-api-access-n8rgw\") pod \"payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h\" (UID: \"f7f021bf-265e-407b-ab76-11fc8afa0d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:19:27.088582 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.088514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7f021bf-265e-407b-ab76-11fc8afa0d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h\" (UID: \"f7f021bf-265e-407b-ab76-11fc8afa0d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:19:27.189898 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.189855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8rgw\" (UniqueName: \"kubernetes.io/projected/f7f021bf-265e-407b-ab76-11fc8afa0d20-kube-api-access-n8rgw\") pod \"payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h\" (UID: \"f7f021bf-265e-407b-ab76-11fc8afa0d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:19:27.190012 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.189932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7f021bf-265e-407b-ab76-11fc8afa0d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h\" (UID: \"f7f021bf-265e-407b-ab76-11fc8afa0d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:19:27.190515 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.190495    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7f021bf-265e-407b-ab76-11fc8afa0d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h\" (UID: \"f7f021bf-265e-407b-ab76-11fc8afa0d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:19:27.198092 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.198047    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8rgw\" (UniqueName: \"kubernetes.io/projected/f7f021bf-265e-407b-ab76-11fc8afa0d20-kube-api-access-n8rgw\") pod \"payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h\" (UID: \"f7f021bf-265e-407b-ab76-11fc8afa0d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:19:27.366463 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.366431    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:19:27.494738 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.494709    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"]
Jul 30 20:19:27.496571 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:19:27.496547    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f021bf_265e_407b_ab76_11fc8afa0d20.slice/crio-be1f25c3b47e1b1908a217927615a00fc6a2a190e94fc7a75d0df44393003b09 WatchSource:0}: Error finding container be1f25c3b47e1b1908a217927615a00fc6a2a190e94fc7a75d0df44393003b09: Status 404 returned error can't find the container with id be1f25c3b47e1b1908a217927615a00fc6a2a190e94fc7a75d0df44393003b09
Jul 30 20:19:27.922256 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.922227    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h" event={"ID":"f7f021bf-265e-407b-ab76-11fc8afa0d20","Type":"ContainerStarted","Data":"17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7"}
Jul 30 20:19:27.922447 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.922270    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h" event={"ID":"f7f021bf-265e-407b-ab76-11fc8afa0d20","Type":"ContainerStarted","Data":"be1f25c3b47e1b1908a217927615a00fc6a2a190e94fc7a75d0df44393003b09"}
Jul 30 20:19:27.922447 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.922302    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:19:27.942103 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:27.942062    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h" podStartSLOduration=0.942048604 podStartE2EDuration="942.048604ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:19:27.939334817 +0000 UTC m=+2410.579749899" watchObservedRunningTime="2026-07-30 20:19:27.942048604 +0000 UTC m=+2410.582463720"
Jul 30 20:19:38.930076 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:38.930040    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:19:50.209254 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:50.209214    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:52.399970 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.399934    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"]
Jul 30 20:19:52.404573 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.404554    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.408828 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.408804    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-478a06\"/\"default-dockercfg-8hjt7\""
Jul 30 20:19:52.409043 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.409014    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-478a06\"/\"kube-root-ca.crt\""
Jul 30 20:19:52.409185 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.408874    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-478a06\"/\"openshift-service-ca.crt\""
Jul 30 20:19:52.409185 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.408874    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-478a06\"/\"test-model-478a06-kserve-self-signed-certs\""
Jul 30 20:19:52.412405 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.412384    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"]
Jul 30 20:19:52.423266 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.423237    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:52.473074 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.473053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72mwp\" (UniqueName: \"kubernetes.io/projected/1f580583-abda-4d0f-877e-3b4212f9a62b-kube-api-access-72mwp\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.473176 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.473079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-dshm\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.473176 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.473107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-tmp-dir\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.473260 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.473201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-home\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.473260 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.473240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f580583-abda-4d0f-877e-3b4212f9a62b-tls-certs\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.473328 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.473279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-model-cache\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.574093 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.574068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-model-cache\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.574186 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.574105    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72mwp\" (UniqueName: \"kubernetes.io/projected/1f580583-abda-4d0f-877e-3b4212f9a62b-kube-api-access-72mwp\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.574186 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.574125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-dshm\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.574186 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.574161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-tmp-dir\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.574357 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.574208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-home\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.574357 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.574249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f580583-abda-4d0f-877e-3b4212f9a62b-tls-certs\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.574526 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.574506    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-model-cache\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.574580 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.574555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-tmp-dir\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.574622 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.574607    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-home\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.576400 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.576381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-dshm\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.576703 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.576684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f580583-abda-4d0f-877e-3b4212f9a62b-tls-certs\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.582381 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.582358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72mwp\" (UniqueName: \"kubernetes.io/projected/1f580583-abda-4d0f-877e-3b4212f9a62b-kube-api-access-72mwp\") pod \"test-model-478a06-kserve-5f76c8d8b9-twht8\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") " pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.714468 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.714414    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:19:52.846943 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:52.846917    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"]
Jul 30 20:19:52.848280 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:19:52.848256    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f580583_abda_4d0f_877e_3b4212f9a62b.slice/crio-531ce55a1f058e91275bfb70b6139d746e32b244672d5d77e082eb343101730f WatchSource:0}: Error finding container 531ce55a1f058e91275bfb70b6139d746e32b244672d5d77e082eb343101730f: Status 404 returned error can't find the container with id 531ce55a1f058e91275bfb70b6139d746e32b244672d5d77e082eb343101730f
Jul 30 20:19:53.056739 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:53.056664    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8" event={"ID":"1f580583-abda-4d0f-877e-3b4212f9a62b","Type":"ContainerStarted","Data":"8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578"}
Jul 30 20:19:53.056739 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:53.056705    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8" event={"ID":"1f580583-abda-4d0f-877e-3b4212f9a62b","Type":"ContainerStarted","Data":"531ce55a1f058e91275bfb70b6139d746e32b244672d5d77e082eb343101730f"}
Jul 30 20:19:53.075541 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:53.075495    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8" podStartSLOduration=1.075482771 podStartE2EDuration="1.075482771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:19:53.074829522 +0000 UTC m=+2435.715244604" watchObservedRunningTime="2026-07-30 20:19:53.075482771 +0000 UTC m=+2435.715897851"
Jul 30 20:19:53.204314 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:53.204285    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:19:53.258312 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:19:53.258290    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:20:02.714942 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:02.714883    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:20:02.714942 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:02.714947    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:20:02.727588 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:02.727557    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:20:03.125128 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:03.125044    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:20:25.206207 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.206169    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"]
Jul 30 20:20:25.209648 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.209623    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.212874 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.212855    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7edd0a\"/\"default-dockercfg-x5clm\""
Jul 30 20:20:25.214331 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.214309    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7edd0a\"/\"test-model-7edd0a-kserve-self-signed-certs\""
Jul 30 20:20:25.214432 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.214352    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7edd0a\"/\"kube-root-ca.crt\""
Jul 30 20:20:25.214432 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.214358    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7edd0a\"/\"openshift-service-ca.crt\""
Jul 30 20:20:25.221834 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.221814    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"]
Jul 30 20:20:25.244943 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.244919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:20:25.334205 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.334180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tmp-dir\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.334303 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.334207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tls-certs\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.334303 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.334239    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-home\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.334393 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.334318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rkfk\" (UniqueName: \"kubernetes.io/projected/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-kube-api-access-9rkfk\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.334393 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.334359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-dshm\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.334466 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.334432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-model-cache\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.434983 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.434958    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-model-cache\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.435078 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.434993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tmp-dir\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.435078 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.435009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tls-certs\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.435078 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.435024    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-home\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.435241 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.435156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rkfk\" (UniqueName: \"kubernetes.io/projected/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-kube-api-access-9rkfk\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.435241 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.435219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-dshm\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.435376 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.435356    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-home\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.435435 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.435411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-model-cache\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.435477 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.435446    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tmp-dir\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.437455 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.437432    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-dshm\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.437584 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.437569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tls-certs\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.444634 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.444614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rkfk\" (UniqueName: \"kubernetes.io/projected/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-kube-api-access-9rkfk\") pod \"test-model-7edd0a-kserve-8656bd67c9-xkdfh\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") " pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.519619 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.519564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:25.648967 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:25.648941    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"]
Jul 30 20:20:25.650090 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:20:25.650064    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d9efbf6_71f3_40c8_a77f_11ff3b27e410.slice/crio-493c6c228e0f60fc269d06e838bbb6173512de0574b3997680f99549d01ca393 WatchSource:0}: Error finding container 493c6c228e0f60fc269d06e838bbb6173512de0574b3997680f99549d01ca393: Status 404 returned error can't find the container with id 493c6c228e0f60fc269d06e838bbb6173512de0574b3997680f99549d01ca393
Jul 30 20:20:26.236296 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:26.236262    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh" event={"ID":"6d9efbf6-71f3-40c8-a77f-11ff3b27e410","Type":"ContainerStarted","Data":"c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a"}
Jul 30 20:20:26.236673 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:26.236308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh" event={"ID":"6d9efbf6-71f3-40c8-a77f-11ff3b27e410","Type":"ContainerStarted","Data":"493c6c228e0f60fc269d06e838bbb6173512de0574b3997680f99549d01ca393"}
Jul 30 20:20:26.255135 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:26.255092    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh" podStartSLOduration=1.255077408 podStartE2EDuration="1.255077408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:20:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:20:26.252737357 +0000 UTC m=+2468.893152436" watchObservedRunningTime="2026-07-30 20:20:26.255077408 +0000 UTC m=+2468.895492487"
Jul 30 20:20:35.519785 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:35.519744    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:35.520352 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:35.519835    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:35.532232 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:35.532207    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:36.306630 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:36.306589    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:20:40.536960 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:40.536924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:20:40.636924 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:20:40.636882    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:04.829276 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:04.829240    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"]
Jul 30 20:21:04.849299 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:04.849273    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:05.701364 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:05.701333    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"]
Jul 30 20:21:05.718327 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:05.718299    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:16.274041 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:16.273944    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:16.349971 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:16.349929    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:16.418843 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:16.418802    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:16.492103 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:16.492066    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:16.959922 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:16.959875    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:19.848728 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:19.848688    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8" podUID="1f580583-abda-4d0f-877e-3b4212f9a62b" containerName="main" containerID="cri-o://8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578" gracePeriod=45
Jul 30 20:21:20.089411 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.089387    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:21:20.141981 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.141954    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-dshm\") pod \"1f580583-abda-4d0f-877e-3b4212f9a62b\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") "
Jul 30 20:21:20.142116 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.141996    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-home\") pod \"1f580583-abda-4d0f-877e-3b4212f9a62b\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") "
Jul 30 20:21:20.142116 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.142028    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-model-cache\") pod \"1f580583-abda-4d0f-877e-3b4212f9a62b\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") "
Jul 30 20:21:20.142116 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.142068    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f580583-abda-4d0f-877e-3b4212f9a62b-tls-certs\") pod \"1f580583-abda-4d0f-877e-3b4212f9a62b\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") "
Jul 30 20:21:20.142290 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.142114    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72mwp\" (UniqueName: \"kubernetes.io/projected/1f580583-abda-4d0f-877e-3b4212f9a62b-kube-api-access-72mwp\") pod \"1f580583-abda-4d0f-877e-3b4212f9a62b\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") "
Jul 30 20:21:20.142290 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.142250    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-tmp-dir\") pod \"1f580583-abda-4d0f-877e-3b4212f9a62b\" (UID: \"1f580583-abda-4d0f-877e-3b4212f9a62b\") "
Jul 30 20:21:20.142409 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.142311    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-home" (OuterVolumeSpecName: "home") pod "1f580583-abda-4d0f-877e-3b4212f9a62b" (UID: "1f580583-abda-4d0f-877e-3b4212f9a62b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:20.142409 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.142325    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-model-cache" (OuterVolumeSpecName: "model-cache") pod "1f580583-abda-4d0f-877e-3b4212f9a62b" (UID: "1f580583-abda-4d0f-877e-3b4212f9a62b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:20.142522 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.142495    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1f580583-abda-4d0f-877e-3b4212f9a62b" (UID: "1f580583-abda-4d0f-877e-3b4212f9a62b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:20.142618 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.142602    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:20.142698 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.142623    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:20.142698 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.142638    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:20.144127 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.144103    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-dshm" (OuterVolumeSpecName: "dshm") pod "1f580583-abda-4d0f-877e-3b4212f9a62b" (UID: "1f580583-abda-4d0f-877e-3b4212f9a62b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:20.144241 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.144148    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f580583-abda-4d0f-877e-3b4212f9a62b-kube-api-access-72mwp" (OuterVolumeSpecName: "kube-api-access-72mwp") pod "1f580583-abda-4d0f-877e-3b4212f9a62b" (UID: "1f580583-abda-4d0f-877e-3b4212f9a62b"). InnerVolumeSpecName "kube-api-access-72mwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:20.144241 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.144221    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f580583-abda-4d0f-877e-3b4212f9a62b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f580583-abda-4d0f-877e-3b4212f9a62b" (UID: "1f580583-abda-4d0f-877e-3b4212f9a62b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:21:20.243014 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.242991    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f580583-abda-4d0f-877e-3b4212f9a62b-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:20.243014 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.243011    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72mwp\" (UniqueName: \"kubernetes.io/projected/1f580583-abda-4d0f-877e-3b4212f9a62b-kube-api-access-72mwp\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:20.243140 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.243022    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f580583-abda-4d0f-877e-3b4212f9a62b-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:20.539266 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.539204    2561 generic.go:356] "Generic (PLEG): container finished" podID="1f580583-abda-4d0f-877e-3b4212f9a62b" containerID="8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578" exitCode=0
Jul 30 20:21:20.539266 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.539246    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"
Jul 30 20:21:20.539445 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.539297    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8" event={"ID":"1f580583-abda-4d0f-877e-3b4212f9a62b","Type":"ContainerDied","Data":"8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578"}
Jul 30 20:21:20.539445 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.539347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8" event={"ID":"1f580583-abda-4d0f-877e-3b4212f9a62b","Type":"ContainerDied","Data":"531ce55a1f058e91275bfb70b6139d746e32b244672d5d77e082eb343101730f"}
Jul 30 20:21:20.539445 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.539371    2561 scope.go:117] "RemoveContainer" containerID="8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578"
Jul 30 20:21:20.549047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.549029    2561 scope.go:117] "RemoveContainer" containerID="8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578"
Jul 30 20:21:20.549316 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:21:20.549299    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578\": container with ID starting with 8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578 not found: ID does not exist" containerID="8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578"
Jul 30 20:21:20.549362 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.549324    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578"} err="failed to get container status \"8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578\": rpc error: code = NotFound desc = could not find container \"8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578\": container with ID starting with 8f2d98a93c5fb205b211b1ef1fcdf8125761dbca7d74c649848ba3e690ce5578 not found: ID does not exist"
Jul 30 20:21:20.568347 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.568317    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"]
Jul 30 20:21:20.571542 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.571519    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-478a06/test-model-478a06-kserve-5f76c8d8b9-twht8"]
Jul 30 20:21:20.720606 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.720569    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh" podUID="6d9efbf6-71f3-40c8-a77f-11ff3b27e410" containerName="main" containerID="cri-o://c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a" gracePeriod=45
Jul 30 20:21:20.958069 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:20.958044    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:21:21.050788 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.050755    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-dshm\") pod \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") "
Jul 30 20:21:21.050788 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.050792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-home\") pod \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") "
Jul 30 20:21:21.051037 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.050841    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tmp-dir\") pod \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") "
Jul 30 20:21:21.051037 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.050864    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-model-cache\") pod \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") "
Jul 30 20:21:21.051037 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.050900    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rkfk\" (UniqueName: \"kubernetes.io/projected/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-kube-api-access-9rkfk\") pod \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") "
Jul 30 20:21:21.051037 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.050945    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tls-certs\") pod \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\" (UID: \"6d9efbf6-71f3-40c8-a77f-11ff3b27e410\") "
Jul 30 20:21:21.051240 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.051120    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6d9efbf6-71f3-40c8-a77f-11ff3b27e410" (UID: "6d9efbf6-71f3-40c8-a77f-11ff3b27e410"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:21.051240 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.051138    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-home" (OuterVolumeSpecName: "home") pod "6d9efbf6-71f3-40c8-a77f-11ff3b27e410" (UID: "6d9efbf6-71f3-40c8-a77f-11ff3b27e410"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:21.051240 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.051168    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-model-cache" (OuterVolumeSpecName: "model-cache") pod "6d9efbf6-71f3-40c8-a77f-11ff3b27e410" (UID: "6d9efbf6-71f3-40c8-a77f-11ff3b27e410"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:21.051393 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.051262    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:21.051393 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.051281    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:21.051393 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.051293    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:21.053089 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.053067    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-dshm" (OuterVolumeSpecName: "dshm") pod "6d9efbf6-71f3-40c8-a77f-11ff3b27e410" (UID: "6d9efbf6-71f3-40c8-a77f-11ff3b27e410"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:21.053163 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.053109    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-kube-api-access-9rkfk" (OuterVolumeSpecName: "kube-api-access-9rkfk") pod "6d9efbf6-71f3-40c8-a77f-11ff3b27e410" (UID: "6d9efbf6-71f3-40c8-a77f-11ff3b27e410"). InnerVolumeSpecName "kube-api-access-9rkfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:21.053163 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.053150    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6d9efbf6-71f3-40c8-a77f-11ff3b27e410" (UID: "6d9efbf6-71f3-40c8-a77f-11ff3b27e410"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:21:21.152047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.152023    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:21.152047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.152045    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:21.152184 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.152053    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rkfk\" (UniqueName: \"kubernetes.io/projected/6d9efbf6-71f3-40c8-a77f-11ff3b27e410-kube-api-access-9rkfk\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:21.546524 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.546448    2561 generic.go:356] "Generic (PLEG): container finished" podID="6d9efbf6-71f3-40c8-a77f-11ff3b27e410" containerID="c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a" exitCode=0
Jul 30 20:21:21.546524 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.546507    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"
Jul 30 20:21:21.546715 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.546545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh" event={"ID":"6d9efbf6-71f3-40c8-a77f-11ff3b27e410","Type":"ContainerDied","Data":"c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a"}
Jul 30 20:21:21.546715 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.546597    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh" event={"ID":"6d9efbf6-71f3-40c8-a77f-11ff3b27e410","Type":"ContainerDied","Data":"493c6c228e0f60fc269d06e838bbb6173512de0574b3997680f99549d01ca393"}
Jul 30 20:21:21.546715 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.546623    2561 scope.go:117] "RemoveContainer" containerID="c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a"
Jul 30 20:21:21.557230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.557214    2561 scope.go:117] "RemoveContainer" containerID="c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a"
Jul 30 20:21:21.557507 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:21:21.557486    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a\": container with ID starting with c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a not found: ID does not exist" containerID="c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a"
Jul 30 20:21:21.557561 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.557517    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a"} err="failed to get container status \"c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a\": rpc error: code = NotFound desc = could not find container \"c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a\": container with ID starting with c60ebdcf6836598de574685b72ee4713f3f68f0e98cf108b771c13c0058fce3a not found: ID does not exist"
Jul 30 20:21:21.568595 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.568569    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"]
Jul 30 20:21:21.573945 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.573919    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-7edd0a/test-model-7edd0a-kserve-8656bd67c9-xkdfh"]
Jul 30 20:21:21.840856 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.840790    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f580583-abda-4d0f-877e-3b4212f9a62b" path="/var/lib/kubelet/pods/1f580583-abda-4d0f-877e-3b4212f9a62b/volumes"
Jul 30 20:21:21.841274 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:21.841255    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d9efbf6-71f3-40c8-a77f-11ff3b27e410" path="/var/lib/kubelet/pods/6d9efbf6-71f3-40c8-a77f-11ff3b27e410/volumes"
Jul 30 20:21:22.705256 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:22.705224    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:22.772053 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:22.772025    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:22.952075 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:22.952038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:23.186408 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.186375    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:23.294162 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.294137    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"]
Jul 30 20:21:23.294491 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.294478    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f580583-abda-4d0f-877e-3b4212f9a62b" containerName="main"
Jul 30 20:21:23.294533 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.294492    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f580583-abda-4d0f-877e-3b4212f9a62b" containerName="main"
Jul 30 20:21:23.294533 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.294506    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d9efbf6-71f3-40c8-a77f-11ff3b27e410" containerName="main"
Jul 30 20:21:23.294533 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.294512    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d9efbf6-71f3-40c8-a77f-11ff3b27e410" containerName="main"
Jul 30 20:21:23.294635 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.294574    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f580583-abda-4d0f-877e-3b4212f9a62b" containerName="main"
Jul 30 20:21:23.294635 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.294586    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d9efbf6-71f3-40c8-a77f-11ff3b27e410" containerName="main"
Jul 30 20:21:23.299069 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.299046    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"
Jul 30 20:21:23.302797 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.302712    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 20:21:23.303018 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.302997    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\""
Jul 30 20:21:23.304487 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.304465    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"]
Jul 30 20:21:23.368037 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.368009    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/528d53ac-40af-4d61-b8fa-ff04c2905b28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv\" (UID: \"528d53ac-40af-4d61-b8fa-ff04c2905b28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"
Jul 30 20:21:23.468745 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.468685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/528d53ac-40af-4d61-b8fa-ff04c2905b28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv\" (UID: \"528d53ac-40af-4d61-b8fa-ff04c2905b28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"
Jul 30 20:21:23.469291 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.469273    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/528d53ac-40af-4d61-b8fa-ff04c2905b28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv\" (UID: \"528d53ac-40af-4d61-b8fa-ff04c2905b28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"
Jul 30 20:21:23.611346 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.611324    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"
Jul 30 20:21:23.741454 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:23.741429    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"]
Jul 30 20:21:23.742854 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:21:23.742818    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528d53ac_40af_4d61_b8fa_ff04c2905b28.slice/crio-8ea3aae97ebf0302f4cad1e9dae2883130c0f3015f1df28577874075ff9d7343 WatchSource:0}: Error finding container 8ea3aae97ebf0302f4cad1e9dae2883130c0f3015f1df28577874075ff9d7343: Status 404 returned error can't find the container with id 8ea3aae97ebf0302f4cad1e9dae2883130c0f3015f1df28577874075ff9d7343
Jul 30 20:21:24.567739 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:24.567704    2561 generic.go:356] "Generic (PLEG): container finished" podID="528d53ac-40af-4d61-b8fa-ff04c2905b28" containerID="8d48476961293e33204a37304ae63b0f5700d50554a76c7912bf927ff0a615b2" exitCode=0
Jul 30 20:21:24.567854 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:24.567765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv" event={"ID":"528d53ac-40af-4d61-b8fa-ff04c2905b28","Type":"ContainerDied","Data":"8d48476961293e33204a37304ae63b0f5700d50554a76c7912bf927ff0a615b2"}
Jul 30 20:21:24.567854 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:24.567805    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv" event={"ID":"528d53ac-40af-4d61-b8fa-ff04c2905b28","Type":"ContainerStarted","Data":"8ea3aae97ebf0302f4cad1e9dae2883130c0f3015f1df28577874075ff9d7343"}
Jul 30 20:21:25.236936 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:25.236882    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:25.701037 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:25.701012    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"
Jul 30 20:21:25.787044 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:25.787023    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/528d53ac-40af-4d61-b8fa-ff04c2905b28-maas-api-service-ca\") pod \"528d53ac-40af-4d61-b8fa-ff04c2905b28\" (UID: \"528d53ac-40af-4d61-b8fa-ff04c2905b28\") "
Jul 30 20:21:25.787386 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:25.787366    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528d53ac-40af-4d61-b8fa-ff04c2905b28-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "528d53ac-40af-4d61-b8fa-ff04c2905b28" (UID: "528d53ac-40af-4d61-b8fa-ff04c2905b28"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:21:25.888343 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:25.888324    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/528d53ac-40af-4d61-b8fa-ff04c2905b28-maas-api-service-ca\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:26.580152 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:26.580120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv" event={"ID":"528d53ac-40af-4d61-b8fa-ff04c2905b28","Type":"ContainerDied","Data":"8ea3aae97ebf0302f4cad1e9dae2883130c0f3015f1df28577874075ff9d7343"}
Jul 30 20:21:26.580152 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:26.580148    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"
Jul 30 20:21:26.580567 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:26.580171    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ea3aae97ebf0302f4cad1e9dae2883130c0f3015f1df28577874075ff9d7343"
Jul 30 20:21:33.835412 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:33.835370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:33.866815 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:33.866784    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"]
Jul 30 20:21:33.867267 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:33.867234    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h" podUID="f7f021bf-265e-407b-ab76-11fc8afa0d20" containerName="payload-pre-processing" containerID="cri-o://17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7" gracePeriod=30
Jul 30 20:21:33.932671 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:33.932643    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:33.995433 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:33.995379    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"]
Jul 30 20:21:33.996128 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:33.996097    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:33.997967 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:33.997944    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7edd0a-2w2gv"]
Jul 30 20:21:34.060735 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.060706    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:34.121900 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.121857    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:21:34.255641 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.255599    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8rgw\" (UniqueName: \"kubernetes.io/projected/f7f021bf-265e-407b-ab76-11fc8afa0d20-kube-api-access-n8rgw\") pod \"f7f021bf-265e-407b-ab76-11fc8afa0d20\" (UID: \"f7f021bf-265e-407b-ab76-11fc8afa0d20\") "
Jul 30 20:21:34.255808 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.255683    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7f021bf-265e-407b-ab76-11fc8afa0d20-plugins-config-volume\") pod \"f7f021bf-265e-407b-ab76-11fc8afa0d20\" (UID: \"f7f021bf-265e-407b-ab76-11fc8afa0d20\") "
Jul 30 20:21:34.256060 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.256033    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7f021bf-265e-407b-ab76-11fc8afa0d20-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f7f021bf-265e-407b-ab76-11fc8afa0d20" (UID: "f7f021bf-265e-407b-ab76-11fc8afa0d20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:21:34.257816 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.257789    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7f021bf-265e-407b-ab76-11fc8afa0d20-kube-api-access-n8rgw" (OuterVolumeSpecName: "kube-api-access-n8rgw") pod "f7f021bf-265e-407b-ab76-11fc8afa0d20" (UID: "f7f021bf-265e-407b-ab76-11fc8afa0d20"). InnerVolumeSpecName "kube-api-access-n8rgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:34.356560 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.356508    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7f021bf-265e-407b-ab76-11fc8afa0d20-plugins-config-volume\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:34.356560 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.356529    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8rgw\" (UniqueName: \"kubernetes.io/projected/f7f021bf-265e-407b-ab76-11fc8afa0d20-kube-api-access-n8rgw\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:21:34.392787 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.392764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:34.627800 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.627731    2561 generic.go:356] "Generic (PLEG): container finished" podID="f7f021bf-265e-407b-ab76-11fc8afa0d20" containerID="17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7" exitCode=0
Jul 30 20:21:34.627800 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.627785    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"
Jul 30 20:21:34.627986 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.627823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h" event={"ID":"f7f021bf-265e-407b-ab76-11fc8afa0d20","Type":"ContainerDied","Data":"17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7"}
Jul 30 20:21:34.627986 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.627904    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h" event={"ID":"f7f021bf-265e-407b-ab76-11fc8afa0d20","Type":"ContainerDied","Data":"be1f25c3b47e1b1908a217927615a00fc6a2a190e94fc7a75d0df44393003b09"}
Jul 30 20:21:34.627986 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.627939    2561 scope.go:117] "RemoveContainer" containerID="17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7"
Jul 30 20:21:34.637576 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.637558    2561 scope.go:117] "RemoveContainer" containerID="17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7"
Jul 30 20:21:34.637937 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:21:34.637916    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7\": container with ID starting with 17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7 not found: ID does not exist" containerID="17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7"
Jul 30 20:21:34.637991 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.637947    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7"} err="failed to get container status \"17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7\": rpc error: code = NotFound desc = could not find container \"17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7\": container with ID starting with 17addc5afa78f5f8784042549b4fe81ee2b9bb6eb00358d39baccef05e6a2bc7 not found: ID does not exist"
Jul 30 20:21:34.665215 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.665191    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"]
Jul 30 20:21:34.668578 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:34.668554    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7edd0a-5d6c767bbd-8jn8h"]
Jul 30 20:21:35.840335 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:35.840293    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528d53ac-40af-4d61-b8fa-ff04c2905b28" path="/var/lib/kubelet/pods/528d53ac-40af-4d61-b8fa-ff04c2905b28/volumes"
Jul 30 20:21:35.840972 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:35.840949    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7f021bf-265e-407b-ab76-11fc8afa0d20" path="/var/lib/kubelet/pods/f7f021bf-265e-407b-ab76-11fc8afa0d20/volumes"
Jul 30 20:21:36.083822 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:36.083797    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:40.285685 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:40.285651    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:40.388834 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:40.388806    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:40.547144 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:40.547061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:40.768756 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:40.768729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:41.111791 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:41.111759    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:41.403318 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:41.403274    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:41.611737 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:41.611707    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:43.893666 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:43.893635    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:43.995501 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:43.995470    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:45.026452 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:45.026422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:45.127526 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:45.127493    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:45.623186 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:45.623150    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:45.725358 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:21:45.725328    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:08.893263 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:08.893225    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:09.356652 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:09.356554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:09.697842 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:09.697816    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:09.830509 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:09.830478    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:12.162637 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:12.162599    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:12.262256 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:12.262224    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:13.252571 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.252533    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"]
Jul 30 20:22:13.253084 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.253001    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528d53ac-40af-4d61-b8fa-ff04c2905b28" containerName="revoke-keys"
Jul 30 20:22:13.253084 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.253018    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="528d53ac-40af-4d61-b8fa-ff04c2905b28" containerName="revoke-keys"
Jul 30 20:22:13.253084 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.253028    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7f021bf-265e-407b-ab76-11fc8afa0d20" containerName="payload-pre-processing"
Jul 30 20:22:13.253084 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.253034    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7f021bf-265e-407b-ab76-11fc8afa0d20" containerName="payload-pre-processing"
Jul 30 20:22:13.253336 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.253108    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7f021bf-265e-407b-ab76-11fc8afa0d20" containerName="payload-pre-processing"
Jul 30 20:22:13.253336 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.253118    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="528d53ac-40af-4d61-b8fa-ff04c2905b28" containerName="revoke-keys"
Jul 30 20:22:13.256469 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.256445    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.259483 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.259460    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 20:22:13.259724 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.259538    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 20:22:13.260605 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.260582    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fl9xt\""
Jul 30 20:22:13.260762 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.260593    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-671642-serving-cert\""
Jul 30 20:22:13.266218 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.266195    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"]
Jul 30 20:22:13.296336 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.296310    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:13.362848 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.362821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-openshift-service-ca\") pod \"maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.362994 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.362862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-maas-api-tls\") pod \"maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.362994 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.362947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckckk\" (UniqueName: \"kubernetes.io/projected/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-kube-api-access-ckckk\") pod \"maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.463748 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.463719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckckk\" (UniqueName: \"kubernetes.io/projected/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-kube-api-access-ckckk\") pod \"maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.463935 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.463781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-openshift-service-ca\") pod \"maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.463935 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.463830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-maas-api-tls\") pod \"maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.464663 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.464634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-openshift-service-ca\") pod \"maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.466609 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.466581    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-maas-api-tls\") pod \"maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.472270 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.472247    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckckk\" (UniqueName: \"kubernetes.io/projected/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-kube-api-access-ckckk\") pod \"maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.491457 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.491432    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:13.570832 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.570766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:13.709342 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.709314    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"]
Jul 30 20:22:13.711171 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:22:13.711142    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6f73a2_0dc0_4f4c_bbda_31e17d198ec8.slice/crio-ceec833155c755cae4085e7aef57fd1d97900712a77afacec814861b80eb5930 WatchSource:0}: Error finding container ceec833155c755cae4085e7aef57fd1d97900712a77afacec814861b80eb5930: Status 404 returned error can't find the container with id ceec833155c755cae4085e7aef57fd1d97900712a77afacec814861b80eb5930
Jul 30 20:22:13.712402 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.712381    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:22:13.848322 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.848251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9" event={"ID":"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8","Type":"ContainerStarted","Data":"ceec833155c755cae4085e7aef57fd1d97900712a77afacec814861b80eb5930"}
Jul 30 20:22:13.901589 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.901561    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:13.995323 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.995298    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"]
Jul 30 20:22:13.996386 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:13.996356    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:14.000262 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.000243    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:22:14.003090 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.003071    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-671642-dockercfg-snmx7\""
Jul 30 20:22:14.003090 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.003090    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-671642\""
Jul 30 20:22:14.008213 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.008193    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"]
Jul 30 20:22:14.068453 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.068425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61cd8e53-7477-4e5f-8f62-63ff934b94d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp\" (UID: \"61cd8e53-7477-4e5f-8f62-63ff934b94d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:22:14.068564 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.068467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqbqm\" (UniqueName: \"kubernetes.io/projected/61cd8e53-7477-4e5f-8f62-63ff934b94d8-kube-api-access-sqbqm\") pod \"payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp\" (UID: \"61cd8e53-7477-4e5f-8f62-63ff934b94d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:22:14.169722 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.169673    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61cd8e53-7477-4e5f-8f62-63ff934b94d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp\" (UID: \"61cd8e53-7477-4e5f-8f62-63ff934b94d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:22:14.169878 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.169758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqbqm\" (UniqueName: \"kubernetes.io/projected/61cd8e53-7477-4e5f-8f62-63ff934b94d8-kube-api-access-sqbqm\") pod \"payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp\" (UID: \"61cd8e53-7477-4e5f-8f62-63ff934b94d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:22:14.170573 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.170550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61cd8e53-7477-4e5f-8f62-63ff934b94d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp\" (UID: \"61cd8e53-7477-4e5f-8f62-63ff934b94d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:22:14.181617 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.181596    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqbqm\" (UniqueName: \"kubernetes.io/projected/61cd8e53-7477-4e5f-8f62-63ff934b94d8-kube-api-access-sqbqm\") pod \"payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp\" (UID: \"61cd8e53-7477-4e5f-8f62-63ff934b94d8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:22:14.313395 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.313357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:22:14.482358 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.482257    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"]
Jul 30 20:22:14.497014 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:22:14.496983    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61cd8e53_7477_4e5f_8f62_63ff934b94d8.slice/crio-8ad6f1ebf2b7c7285d115c1fd84fb4679aecc62c8f587c575e3489e9fb58e3d3 WatchSource:0}: Error finding container 8ad6f1ebf2b7c7285d115c1fd84fb4679aecc62c8f587c575e3489e9fb58e3d3: Status 404 returned error can't find the container with id 8ad6f1ebf2b7c7285d115c1fd84fb4679aecc62c8f587c575e3489e9fb58e3d3
Jul 30 20:22:14.856748 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.856666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp" event={"ID":"61cd8e53-7477-4e5f-8f62-63ff934b94d8","Type":"ContainerStarted","Data":"4ddcf056a88048796a3593011f1248769c3c7146d8970cdedc2a6ed934f73e94"}
Jul 30 20:22:14.856748 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.856748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp" event={"ID":"61cd8e53-7477-4e5f-8f62-63ff934b94d8","Type":"ContainerStarted","Data":"8ad6f1ebf2b7c7285d115c1fd84fb4679aecc62c8f587c575e3489e9fb58e3d3"}
Jul 30 20:22:14.857039 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.856769    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:22:14.872690 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:14.872642    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp" podStartSLOduration=1.872626263 podStartE2EDuration="1.872626263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:14.871491407 +0000 UTC m=+2577.511906487" watchObservedRunningTime="2026-07-30 20:22:14.872626263 +0000 UTC m=+2577.513041342"
Jul 30 20:22:16.870328 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:16.870289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9" event={"ID":"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8","Type":"ContainerStarted","Data":"6175065c669756eb4f84788c252bb51007f39baba05c3fbb8b4400f3b64b23e7"}
Jul 30 20:22:16.870692 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:16.870351    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:16.889693 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:16.889643    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9" podStartSLOduration=1.6814394940000001 podStartE2EDuration="3.889629908s" totalImagesPullingTime="2.208190414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:16.887523804 +0000 UTC m=+2579.527938886" watchObservedRunningTime="2026-07-30 20:22:16.889629908 +0000 UTC m=+2579.530044989"
Jul 30 20:22:22.881345 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:22.881316    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:22:25.865522 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:25.865492    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:22:37.176059 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:37.176023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:56.379030 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:56.378988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:56.479563 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:56.479528    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:56.547364 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:56.547334    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:56.600030 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:56.599995    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:22:56.964590 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:22:56.964558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:02.796638 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:02.796592    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:02.897425 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:02.897384    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:03.063836 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:03.063739    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:03.302737 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:03.302710    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:19.013260 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.013227    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"]
Jul 30 20:23:19.013852 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.013466    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9" podUID="6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8" containerName="maas-api" containerID="cri-o://6175065c669756eb4f84788c252bb51007f39baba05c3fbb8b4400f3b64b23e7" gracePeriod=30
Jul 30 20:23:19.037378 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.037351    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:19.071608 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.071584    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"]
Jul 30 20:23:19.071993 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.071956    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp" podUID="61cd8e53-7477-4e5f-8f62-63ff934b94d8" containerName="payload-pre-processing" containerID="cri-o://4ddcf056a88048796a3593011f1248769c3c7146d8970cdedc2a6ed934f73e94" gracePeriod=30
Jul 30 20:23:19.209047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.209022    2561 generic.go:356] "Generic (PLEG): container finished" podID="6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8" containerID="6175065c669756eb4f84788c252bb51007f39baba05c3fbb8b4400f3b64b23e7" exitCode=0
Jul 30 20:23:19.209187 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.209096    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9" event={"ID":"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8","Type":"ContainerDied","Data":"6175065c669756eb4f84788c252bb51007f39baba05c3fbb8b4400f3b64b23e7"}
Jul 30 20:23:19.210882 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.210858    2561 generic.go:356] "Generic (PLEG): container finished" podID="61cd8e53-7477-4e5f-8f62-63ff934b94d8" containerID="4ddcf056a88048796a3593011f1248769c3c7146d8970cdedc2a6ed934f73e94" exitCode=0
Jul 30 20:23:19.211001 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.210918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp" event={"ID":"61cd8e53-7477-4e5f-8f62-63ff934b94d8","Type":"ContainerDied","Data":"4ddcf056a88048796a3593011f1248769c3c7146d8970cdedc2a6ed934f73e94"}
Jul 30 20:23:19.309158 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.309121    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:23:19.344221 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.344201    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:23:19.470059 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.470036    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-openshift-service-ca\") pod \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") "
Jul 30 20:23:19.470191 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.470082    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61cd8e53-7477-4e5f-8f62-63ff934b94d8-plugins-config-volume\") pod \"61cd8e53-7477-4e5f-8f62-63ff934b94d8\" (UID: \"61cd8e53-7477-4e5f-8f62-63ff934b94d8\") "
Jul 30 20:23:19.470191 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.470101    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqbqm\" (UniqueName: \"kubernetes.io/projected/61cd8e53-7477-4e5f-8f62-63ff934b94d8-kube-api-access-sqbqm\") pod \"61cd8e53-7477-4e5f-8f62-63ff934b94d8\" (UID: \"61cd8e53-7477-4e5f-8f62-63ff934b94d8\") "
Jul 30 20:23:19.470329 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.470213    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-maas-api-tls\") pod \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") "
Jul 30 20:23:19.470329 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.470280    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckckk\" (UniqueName: \"kubernetes.io/projected/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-kube-api-access-ckckk\") pod \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\" (UID: \"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8\") "
Jul 30 20:23:19.470447 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.470388    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8" (UID: "6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:19.470503 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.470444    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61cd8e53-7477-4e5f-8f62-63ff934b94d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "61cd8e53-7477-4e5f-8f62-63ff934b94d8" (UID: "61cd8e53-7477-4e5f-8f62-63ff934b94d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:19.470596 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.470577    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-openshift-service-ca\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:23:19.470648 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.470603    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61cd8e53-7477-4e5f-8f62-63ff934b94d8-plugins-config-volume\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:23:19.472280 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.472258    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61cd8e53-7477-4e5f-8f62-63ff934b94d8-kube-api-access-sqbqm" (OuterVolumeSpecName: "kube-api-access-sqbqm") pod "61cd8e53-7477-4e5f-8f62-63ff934b94d8" (UID: "61cd8e53-7477-4e5f-8f62-63ff934b94d8"). InnerVolumeSpecName "kube-api-access-sqbqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:19.472375 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.472355    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-kube-api-access-ckckk" (OuterVolumeSpecName: "kube-api-access-ckckk") pod "6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8" (UID: "6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8"). InnerVolumeSpecName "kube-api-access-ckckk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:19.472427 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.472408    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8" (UID: "6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:19.571555 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.571495    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-maas-api-tls\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:23:19.571555 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.571519    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckckk\" (UniqueName: \"kubernetes.io/projected/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8-kube-api-access-ckckk\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:23:19.571555 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:19.571534    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqbqm\" (UniqueName: \"kubernetes.io/projected/61cd8e53-7477-4e5f-8f62-63ff934b94d8-kube-api-access-sqbqm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:23:20.217688 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.217663    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"
Jul 30 20:23:20.217688 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.217669    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9" event={"ID":"6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8","Type":"ContainerDied","Data":"ceec833155c755cae4085e7aef57fd1d97900712a77afacec814861b80eb5930"}
Jul 30 20:23:20.218156 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.217735    2561 scope.go:117] "RemoveContainer" containerID="6175065c669756eb4f84788c252bb51007f39baba05c3fbb8b4400f3b64b23e7"
Jul 30 20:23:20.219520 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.219492    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp" event={"ID":"61cd8e53-7477-4e5f-8f62-63ff934b94d8","Type":"ContainerDied","Data":"8ad6f1ebf2b7c7285d115c1fd84fb4679aecc62c8f587c575e3489e9fb58e3d3"}
Jul 30 20:23:20.219639 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.219524    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"
Jul 30 20:23:20.227033 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.227012    2561 scope.go:117] "RemoveContainer" containerID="4ddcf056a88048796a3593011f1248769c3c7146d8970cdedc2a6ed934f73e94"
Jul 30 20:23:20.237750 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.237637    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"]
Jul 30 20:23:20.240989 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.240965    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-671642-84c799c87b-xpjtp"]
Jul 30 20:23:20.250080 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.250061    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"]
Jul 30 20:23:20.253705 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.253685    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-671642-7fc8b59f78-5bpm9"]
Jul 30 20:23:20.492397 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:20.492337    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:21.841512 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:21.841473    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61cd8e53-7477-4e5f-8f62-63ff934b94d8" path="/var/lib/kubelet/pods/61cd8e53-7477-4e5f-8f62-63ff934b94d8/volumes"
Jul 30 20:23:21.841980 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:21.841876    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8" path="/var/lib/kubelet/pods/6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8/volumes"
Jul 30 20:23:25.257303 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:25.257264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:25.356856 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:25.356824    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:25.506249 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:25.506219    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:25.743185 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:25.743151    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:26.079146 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:26.079066    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:26.376641 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:26.376554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:26.534660 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:26.534631    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:29.572445 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:29.572399    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:29.676966 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:29.676930    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:30.702296 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:30.702255    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:31.195277 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:31.195239    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:31.288926 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:31.288875    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:31.362371 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:31.362342    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:54.549268 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:54.549228    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:54.865540 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:54.865454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:55.176190 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:55.176156    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:55.278355 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:55.278326    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:57.741552 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:57.741512    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:57.844906 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:57.844859    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:58.826262 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.826227    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"]
Jul 30 20:23:58.826798 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.826781    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cd8e53-7477-4e5f-8f62-63ff934b94d8" containerName="payload-pre-processing"
Jul 30 20:23:58.826857 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.826802    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cd8e53-7477-4e5f-8f62-63ff934b94d8" containerName="payload-pre-processing"
Jul 30 20:23:58.826857 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.826816    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8" containerName="maas-api"
Jul 30 20:23:58.826857 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.826826    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8" containerName="maas-api"
Jul 30 20:23:58.826978 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.826942    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cd8e53-7477-4e5f-8f62-63ff934b94d8" containerName="payload-pre-processing"
Jul 30 20:23:58.826978 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.826954    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a6f73a2-0dc0-4f4c-bbda-31e17d198ec8" containerName="maas-api"
Jul 30 20:23:58.830499 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.830479    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:58.833684 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.833661    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 20:23:58.833805 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.833717    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-808798-serving-cert\""
Jul 30 20:23:58.833805 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.833731    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 20:23:58.834004 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.833988    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fl9xt\""
Jul 30 20:23:58.841481 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.841458    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"]
Jul 30 20:23:58.856830 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.856795    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:58.961120 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.961097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01816833-60b1-4083-94c5-a35e6a784d3c-maas-api-tls\") pod \"maas-api-e2e-shared-b-808798-78454c477f-wn8g5\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:58.961238 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.961160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km2xj\" (UniqueName: \"kubernetes.io/projected/01816833-60b1-4083-94c5-a35e6a784d3c-kube-api-access-km2xj\") pod \"maas-api-e2e-shared-b-808798-78454c477f-wn8g5\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:58.961238 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:58.961196    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01816833-60b1-4083-94c5-a35e6a784d3c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-808798-78454c477f-wn8g5\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:59.062322 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.062296    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01816833-60b1-4083-94c5-a35e6a784d3c-maas-api-tls\") pod \"maas-api-e2e-shared-b-808798-78454c477f-wn8g5\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:59.062431 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.062343    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km2xj\" (UniqueName: \"kubernetes.io/projected/01816833-60b1-4083-94c5-a35e6a784d3c-kube-api-access-km2xj\") pod \"maas-api-e2e-shared-b-808798-78454c477f-wn8g5\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:59.062482 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:23:59.062431    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-serving-cert: secret "maas-api-e2e-shared-b-808798-serving-cert" not found
Jul 30 20:23:59.062482 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.062458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01816833-60b1-4083-94c5-a35e6a784d3c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-808798-78454c477f-wn8g5\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:59.062582 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:23:59.062494    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01816833-60b1-4083-94c5-a35e6a784d3c-maas-api-tls podName:01816833-60b1-4083-94c5-a35e6a784d3c nodeName:}" failed. No retries permitted until 2026-07-30 20:23:59.562479006 +0000 UTC m=+2682.202894063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/01816833-60b1-4083-94c5-a35e6a784d3c-maas-api-tls") pod "maas-api-e2e-shared-b-808798-78454c477f-wn8g5" (UID: "01816833-60b1-4083-94c5-a35e6a784d3c") : secret "maas-api-e2e-shared-b-808798-serving-cert" not found
Jul 30 20:23:59.063036 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.063018    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01816833-60b1-4083-94c5-a35e6a784d3c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-808798-78454c477f-wn8g5\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:59.070916 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.070881    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km2xj\" (UniqueName: \"kubernetes.io/projected/01816833-60b1-4083-94c5-a35e6a784d3c-kube-api-access-km2xj\") pod \"maas-api-e2e-shared-b-808798-78454c477f-wn8g5\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:59.303429 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.303400    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:59.399692 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.399660    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:59.435566 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.435540    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"]
Jul 30 20:23:59.438961 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.438946    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:23:59.441948 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.441928    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-808798\""
Jul 30 20:23:59.447842 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.447822    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"]
Jul 30 20:23:59.488167 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.488133    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:23:59.566467 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.566402    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz\" (UID: \"c3badce3-e488-4f8e-860d-7c8d0c8d51d4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:23:59.566467 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.566444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxlhp\" (UniqueName: \"kubernetes.io/projected/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-kube-api-access-vxlhp\") pod \"payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz\" (UID: \"c3badce3-e488-4f8e-860d-7c8d0c8d51d4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:23:59.566636 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.566551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01816833-60b1-4083-94c5-a35e6a784d3c-maas-api-tls\") pod \"maas-api-e2e-shared-b-808798-78454c477f-wn8g5\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:59.569106 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.569082    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01816833-60b1-4083-94c5-a35e6a784d3c-maas-api-tls\") pod \"maas-api-e2e-shared-b-808798-78454c477f-wn8g5\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:59.668153 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.668125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz\" (UID: \"c3badce3-e488-4f8e-860d-7c8d0c8d51d4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:23:59.668357 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.668329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxlhp\" (UniqueName: \"kubernetes.io/projected/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-kube-api-access-vxlhp\") pod \"payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz\" (UID: \"c3badce3-e488-4f8e-860d-7c8d0c8d51d4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:23:59.668821 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.668801    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz\" (UID: \"c3badce3-e488-4f8e-860d-7c8d0c8d51d4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:23:59.678937 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.678912    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxlhp\" (UniqueName: \"kubernetes.io/projected/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-kube-api-access-vxlhp\") pod \"payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz\" (UID: \"c3badce3-e488-4f8e-860d-7c8d0c8d51d4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:23:59.743541 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.743508    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:23:59.750539 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.750522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:23:59.894464 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:23:59.894194    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01816833_60b1_4083_94c5_a35e6a784d3c.slice/crio-0808da8930b49a16dd680de361454d2b419868709f65730a1dd79ef110c2223c WatchSource:0}: Error finding container 0808da8930b49a16dd680de361454d2b419868709f65730a1dd79ef110c2223c: Status 404 returned error can't find the container with id 0808da8930b49a16dd680de361454d2b419868709f65730a1dd79ef110c2223c
Jul 30 20:23:59.894868 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.894557    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"]
Jul 30 20:23:59.917022 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:23:59.917000    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"]
Jul 30 20:23:59.917812 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:23:59.917788    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3badce3_e488_4f8e_860d_7c8d0c8d51d4.slice/crio-2be71abf1d58c8f3ac615519d67a0dea3a94b23a4dadb34514ef54696d70f298 WatchSource:0}: Error finding container 2be71abf1d58c8f3ac615519d67a0dea3a94b23a4dadb34514ef54696d70f298: Status 404 returned error can't find the container with id 2be71abf1d58c8f3ac615519d67a0dea3a94b23a4dadb34514ef54696d70f298
Jul 30 20:24:00.434616 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:00.434584    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz" event={"ID":"c3badce3-e488-4f8e-860d-7c8d0c8d51d4","Type":"ContainerStarted","Data":"4f6c42ea40680534962af6fd0ce64f5918cd784da08addada65e0eebeb95cc15"}
Jul 30 20:24:00.434788 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:00.434640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz" event={"ID":"c3badce3-e488-4f8e-860d-7c8d0c8d51d4","Type":"ContainerStarted","Data":"2be71abf1d58c8f3ac615519d67a0dea3a94b23a4dadb34514ef54696d70f298"}
Jul 30 20:24:00.434788 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:00.434668    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:24:00.435874 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:00.435848    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5" event={"ID":"01816833-60b1-4083-94c5-a35e6a784d3c","Type":"ContainerStarted","Data":"0808da8930b49a16dd680de361454d2b419868709f65730a1dd79ef110c2223c"}
Jul 30 20:24:00.451466 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:00.451430    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz" podStartSLOduration=1.451417361 podStartE2EDuration="1.451417361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:23:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:24:00.449461816 +0000 UTC m=+2683.089876908" watchObservedRunningTime="2026-07-30 20:24:00.451417361 +0000 UTC m=+2683.091832470"
Jul 30 20:24:01.444067 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:01.444030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5" event={"ID":"01816833-60b1-4083-94c5-a35e6a784d3c","Type":"ContainerStarted","Data":"2093fecd333980371497080f3774dcdef7a2453edaf3b255b46ccb836046d2f5"}
Jul 30 20:24:01.444464 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:01.444243    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:24:01.461230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:01.461185    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5" podStartSLOduration=2.9144819159999997 podStartE2EDuration="3.461170806s" totalImagesPullingTime="546.68889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:24:01.460031645 +0000 UTC m=+2684.100446747" watchObservedRunningTime="2026-07-30 20:24:01.461170806 +0000 UTC m=+2684.101585886"
Jul 30 20:24:07.461830 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:07.461797    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:24:09.559460 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:09.559402    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:24:11.446161 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:11.446064    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:24:18.104150 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:18.104059    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:24:18.122567 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:18.107767    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:24:18.122567 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:18.111434    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:24:18.122567 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:18.115055    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:24:22.748176 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:22.748135    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:24:32.697530 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.697493    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"]
Jul 30 20:24:32.701347 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.701323    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.706080 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.706058    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-474e8f\"/\"kube-root-ca.crt\""
Jul 30 20:24:32.706502 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.706276    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-474e8f\"/\"openshift-service-ca.crt\""
Jul 30 20:24:32.706648 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.706332    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-474e8f\"/\"default-dockercfg-gz6mk\""
Jul 30 20:24:32.706822 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.706383    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-474e8f\"/\"auth-test-model-474e8f-kserve-self-signed-certs\""
Jul 30 20:24:32.709830 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.709808    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"]
Jul 30 20:24:32.730967 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.730940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:24:32.822869 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.822844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-home\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.823008 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.822881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-model-cache\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.823077 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.822997    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-dshm\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.823077 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.823047    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4psw9\" (UniqueName: \"kubernetes.io/projected/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-kube-api-access-4psw9\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.823159 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.823116    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tmp-dir\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.823159 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.823141    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tls-certs\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.924352 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.924322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4psw9\" (UniqueName: \"kubernetes.io/projected/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-kube-api-access-4psw9\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.924475 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.924370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tmp-dir\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.924475 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.924391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tls-certs\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.924475 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.924438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-home\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.924639 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.924481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-model-cache\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.924639 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.924538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-dshm\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.924790 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.924770    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tmp-dir\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.924831 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.924790    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-home\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.924910 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.924870    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-model-cache\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.926772 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.926755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-dshm\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.927175 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.927158    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tls-certs\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:32.932954 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:32.932937    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4psw9\" (UniqueName: \"kubernetes.io/projected/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-kube-api-access-4psw9\") pod \"auth-test-model-474e8f-kserve-56b7999bf9-m5klt\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") " pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:33.012959 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:33.012880    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:33.145960 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:33.145931    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"]
Jul 30 20:24:33.147855 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:24:33.147826    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9a2e954_2ae3_43bc_a8f7_f8ee2b530e1e.slice/crio-30a05840df6d1dcf2d7f2cfabb42d93a645b0efbee4a706bdc46d9d5beee7c24 WatchSource:0}: Error finding container 30a05840df6d1dcf2d7f2cfabb42d93a645b0efbee4a706bdc46d9d5beee7c24: Status 404 returned error can't find the container with id 30a05840df6d1dcf2d7f2cfabb42d93a645b0efbee4a706bdc46d9d5beee7c24
Jul 30 20:24:33.627752 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:33.627719    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt" event={"ID":"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e","Type":"ContainerStarted","Data":"dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5"}
Jul 30 20:24:33.627947 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:33.627758    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt" event={"ID":"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e","Type":"ContainerStarted","Data":"30a05840df6d1dcf2d7f2cfabb42d93a645b0efbee4a706bdc46d9d5beee7c24"}
Jul 30 20:24:33.645253 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:33.645212    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt" podStartSLOduration=1.645197409 podStartE2EDuration="1.645197409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:24:33.64400762 +0000 UTC m=+2716.284422701" watchObservedRunningTime="2026-07-30 20:24:33.645197409 +0000 UTC m=+2716.285612489"
Jul 30 20:24:43.013854 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:43.013814    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:43.014331 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:43.013876    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:43.026339 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:43.026307    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:43.697117 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:43.697088    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:24:56.700651 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.700618    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"]
Jul 30 20:24:56.704278 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.704256    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.708607 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.708585    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"openshift-service-ca.crt\""
Jul 30 20:24:56.708727 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.708590    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"default-dockercfg-7c2w8\""
Jul 30 20:24:56.708727 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.708590    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"auth-test-model-808798-kserve-self-signed-certs\""
Jul 30 20:24:56.708834 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.708779    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"kube-root-ca.crt\""
Jul 30 20:24:56.713503 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.713482    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"]
Jul 30 20:24:56.723649 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.723621    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:24:56.808161 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.808140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-home\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.808258 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.808173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v4mm\" (UniqueName: \"kubernetes.io/projected/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-kube-api-access-7v4mm\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.808258 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.808216    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-model-cache\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.808333 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.808268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-dshm\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.808333 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.808322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tmp-dir\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.808400 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.808340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tls-certs\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.909013 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.908981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-dshm\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.909125 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.909032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tmp-dir\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.909125 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.909050    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tls-certs\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.909125 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.909088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-home\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.909125 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.909110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v4mm\" (UniqueName: \"kubernetes.io/projected/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-kube-api-access-7v4mm\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.909351 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.909142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-model-cache\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.909480 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.909454    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tmp-dir\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.909554 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.909525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-model-cache\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.909598 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.909546    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-home\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.911601 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.911576    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-dshm\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.911812 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.911789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tls-certs\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:56.917465 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:56.917443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v4mm\" (UniqueName: \"kubernetes.io/projected/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-kube-api-access-7v4mm\") pod \"auth-test-model-808798-kserve-7f58465847-ttkdc\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") " pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:57.015626 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:57.015564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:24:57.147466 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:57.147433    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"]
Jul 30 20:24:57.149326 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:24:57.149299    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01f351f1_bfbe_4db4_a6c6_798154c3d8b7.slice/crio-fd02739b18272001abdc2ee01da48e3646216745c167bd03c9a1b52aea0870de WatchSource:0}: Error finding container fd02739b18272001abdc2ee01da48e3646216745c167bd03c9a1b52aea0870de: Status 404 returned error can't find the container with id fd02739b18272001abdc2ee01da48e3646216745c167bd03c9a1b52aea0870de
Jul 30 20:24:57.765406 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:57.765370    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc" event={"ID":"01f351f1-bfbe-4db4-a6c6-798154c3d8b7","Type":"ContainerStarted","Data":"bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8"}
Jul 30 20:24:57.765406 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:57.765411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc" event={"ID":"01f351f1-bfbe-4db4-a6c6-798154c3d8b7","Type":"ContainerStarted","Data":"fd02739b18272001abdc2ee01da48e3646216745c167bd03c9a1b52aea0870de"}
Jul 30 20:24:57.783968 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:24:57.783921    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc" podStartSLOduration=1.7839061059999999 podStartE2EDuration="1.783906106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:24:57.781851487 +0000 UTC m=+2740.422266617" watchObservedRunningTime="2026-07-30 20:24:57.783906106 +0000 UTC m=+2740.424321183"
Jul 30 20:25:07.016456 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:25:07.016418    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:25:07.017031 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:25:07.016472    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:25:07.029336 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:25:07.029308    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:25:07.842630 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:25:07.842602    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:25:35.574685 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:25:35.574646    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:02.978205 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:26:02.978170    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:28.225398 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:26:28.225350    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:59.718250 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:26:59.718184    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:59.826136 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:26:59.826095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:28:18.214687 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:28:18.214653    2561 scope.go:117] "RemoveContainer" containerID="8d48476961293e33204a37304ae63b0f5700d50554a76c7912bf927ff0a615b2"
Jul 30 20:29:09.537337 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:09.537297    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:18.146042 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:18.146016    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:29:18.151999 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:18.151976    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:29:18.153471 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:18.153448    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:29:18.159000 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:18.158981    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:29:34.854093 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:34.854059    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"]
Jul 30 20:29:34.875982 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:34.875953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:35.978285 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:35.978254    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"]
Jul 30 20:29:35.991876 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:35.991846    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:39.617677 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.617643    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"]
Jul 30 20:29:39.621412 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.621390    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.624345 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.624317    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-474e8f\"/\"sub-test-model-474e8f-kserve-self-signed-certs\""
Jul 30 20:29:39.631491 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.631465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:39.632336 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.632309    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"]
Jul 30 20:29:39.660731 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.660710    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-dshm\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.660825 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.660776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tls-certs\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.660870 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.660859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tmp-dir\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.660925 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.660898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5gm5\" (UniqueName: \"kubernetes.io/projected/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-kube-api-access-g5gm5\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.660962 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.660925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-home\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.660962 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.660953    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-model-cache\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.761540 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.761513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tls-certs\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.761642 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.761551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tmp-dir\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.761642 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.761574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5gm5\" (UniqueName: \"kubernetes.io/projected/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-kube-api-access-g5gm5\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.761642 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.761602    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-home\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.761642 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.761637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-model-cache\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.761907 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.761675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-dshm\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.762012 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.761987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tmp-dir\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.762070 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.762043    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-home\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.762116 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.762100    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-model-cache\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.763791 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.763765    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-dshm\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.764172 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.764152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tls-certs\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.770131 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.770113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5gm5\" (UniqueName: \"kubernetes.io/projected/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-kube-api-access-g5gm5\") pod \"sub-test-model-474e8f-kserve-5c58869c8c-8r4mv\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") " pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:39.932051 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:39.932027    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:40.063566 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:40.063536    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"]
Jul 30 20:29:40.064916 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:29:40.064867    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a4cfa80_73eb_4482_ad4f_79914f91e5e8.slice/crio-e01d208962abf3138a450d924bf0f2f84c0d1ac307b41d56dab872bc94741cff WatchSource:0}: Error finding container e01d208962abf3138a450d924bf0f2f84c0d1ac307b41d56dab872bc94741cff: Status 404 returned error can't find the container with id e01d208962abf3138a450d924bf0f2f84c0d1ac307b41d56dab872bc94741cff
Jul 30 20:29:40.340536 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:40.340449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv" event={"ID":"6a4cfa80-73eb-4482-ad4f-79914f91e5e8","Type":"ContainerStarted","Data":"16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761"}
Jul 30 20:29:40.340536 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:40.340499    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv" event={"ID":"6a4cfa80-73eb-4482-ad4f-79914f91e5e8","Type":"ContainerStarted","Data":"e01d208962abf3138a450d924bf0f2f84c0d1ac307b41d56dab872bc94741cff"}
Jul 30 20:29:40.359403 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:40.359363    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv" podStartSLOduration=1.359348356 podStartE2EDuration="1.359348356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:40.356910003 +0000 UTC m=+3022.997325076" watchObservedRunningTime="2026-07-30 20:29:40.359348356 +0000 UTC m=+3022.999763471"
Jul 30 20:29:49.872775 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:49.872717    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt" podUID="e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" containerName="main" containerID="cri-o://dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5" gracePeriod=45
Jul 30 20:29:49.932848 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:49.932823    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:49.932967 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:49.932870    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:49.946328 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:49.946308    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:50.124902 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.124839    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:29:50.243201 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243175    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tmp-dir\") pod \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") "
Jul 30 20:29:50.243330 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243216    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tls-certs\") pod \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") "
Jul 30 20:29:50.243330 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243255    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-home\") pod \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") "
Jul 30 20:29:50.243330 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243284    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4psw9\" (UniqueName: \"kubernetes.io/projected/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-kube-api-access-4psw9\") pod \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") "
Jul 30 20:29:50.243499 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243327    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-dshm\") pod \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") "
Jul 30 20:29:50.243499 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243415    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-model-cache\") pod \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\" (UID: \"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e\") "
Jul 30 20:29:50.243499 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243428    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" (UID: "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:29:50.243630 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243511    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-home" (OuterVolumeSpecName: "home") pod "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" (UID: "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:29:50.243701 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243679    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-model-cache" (OuterVolumeSpecName: "model-cache") pod "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" (UID: "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:29:50.243768 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243750    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:50.243768 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243764    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:50.243883 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.243773    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:50.245430 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.245406    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" (UID: "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:29:50.245527 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.245428    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-kube-api-access-4psw9" (OuterVolumeSpecName: "kube-api-access-4psw9") pod "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" (UID: "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e"). InnerVolumeSpecName "kube-api-access-4psw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:29:50.245527 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.245482    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-dshm" (OuterVolumeSpecName: "dshm") pod "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" (UID: "e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:29:50.344956 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.344935    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:50.344956 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.344955    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4psw9\" (UniqueName: \"kubernetes.io/projected/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-kube-api-access-4psw9\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:50.345081 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.344965    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:50.398744 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.398722    2561 generic.go:356] "Generic (PLEG): container finished" podID="e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" containerID="dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5" exitCode=0
Jul 30 20:29:50.398849 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.398765    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"
Jul 30 20:29:50.398849 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.398815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt" event={"ID":"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e","Type":"ContainerDied","Data":"dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5"}
Jul 30 20:29:50.398959 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.398860    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt" event={"ID":"e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e","Type":"ContainerDied","Data":"30a05840df6d1dcf2d7f2cfabb42d93a645b0efbee4a706bdc46d9d5beee7c24"}
Jul 30 20:29:50.398959 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.398881    2561 scope.go:117] "RemoveContainer" containerID="dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5"
Jul 30 20:29:50.415136 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.415113    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:29:50.416897 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.416874    2561 scope.go:117] "RemoveContainer" containerID="dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5"
Jul 30 20:29:50.417177 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:29:50.417159    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5\": container with ID starting with dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5 not found: ID does not exist" containerID="dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5"
Jul 30 20:29:50.417216 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.417185    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5"} err="failed to get container status \"dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5\": rpc error: code = NotFound desc = could not find container \"dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5\": container with ID starting with dd121c66e16c870eefd362190d9633b2f07373c139748e3e079430bce02e90c5 not found: ID does not exist"
Jul 30 20:29:50.426095 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.426065    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"]
Jul 30 20:29:50.431355 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.431336    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/auth-test-model-474e8f-kserve-56b7999bf9-m5klt"]
Jul 30 20:29:50.997781 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:50.997740    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc" podUID="01f351f1-bfbe-4db4-a6c6-798154c3d8b7" containerName="main" containerID="cri-o://bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8" gracePeriod=45
Jul 30 20:29:51.242267 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.242243    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:29:51.354472 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354414    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tmp-dir\") pod \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") "
Jul 30 20:29:51.354472 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354455    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v4mm\" (UniqueName: \"kubernetes.io/projected/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-kube-api-access-7v4mm\") pod \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") "
Jul 30 20:29:51.354607 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354477    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-model-cache\") pod \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") "
Jul 30 20:29:51.354607 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354516    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-dshm\") pod \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") "
Jul 30 20:29:51.354607 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354534    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tls-certs\") pod \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") "
Jul 30 20:29:51.354607 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354593    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-home\") pod \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\" (UID: \"01f351f1-bfbe-4db4-a6c6-798154c3d8b7\") "
Jul 30 20:29:51.354797 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354681    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "01f351f1-bfbe-4db4-a6c6-798154c3d8b7" (UID: "01f351f1-bfbe-4db4-a6c6-798154c3d8b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:29:51.354797 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354781    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "01f351f1-bfbe-4db4-a6c6-798154c3d8b7" (UID: "01f351f1-bfbe-4db4-a6c6-798154c3d8b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:29:51.354968 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354943    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-home" (OuterVolumeSpecName: "home") pod "01f351f1-bfbe-4db4-a6c6-798154c3d8b7" (UID: "01f351f1-bfbe-4db4-a6c6-798154c3d8b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:29:51.355033 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354953    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:51.355033 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.354999    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:51.356693 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.356669    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-dshm" (OuterVolumeSpecName: "dshm") pod "01f351f1-bfbe-4db4-a6c6-798154c3d8b7" (UID: "01f351f1-bfbe-4db4-a6c6-798154c3d8b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:29:51.356773 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.356730    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "01f351f1-bfbe-4db4-a6c6-798154c3d8b7" (UID: "01f351f1-bfbe-4db4-a6c6-798154c3d8b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:29:51.356830 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.356814    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-kube-api-access-7v4mm" (OuterVolumeSpecName: "kube-api-access-7v4mm") pod "01f351f1-bfbe-4db4-a6c6-798154c3d8b7" (UID: "01f351f1-bfbe-4db4-a6c6-798154c3d8b7"). InnerVolumeSpecName "kube-api-access-7v4mm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:29:51.404710 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.404686    2561 generic.go:356] "Generic (PLEG): container finished" podID="01f351f1-bfbe-4db4-a6c6-798154c3d8b7" containerID="bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8" exitCode=0
Jul 30 20:29:51.404804 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.404725    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"
Jul 30 20:29:51.404804 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.404776    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc" event={"ID":"01f351f1-bfbe-4db4-a6c6-798154c3d8b7","Type":"ContainerDied","Data":"bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8"}
Jul 30 20:29:51.404878 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.404813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc" event={"ID":"01f351f1-bfbe-4db4-a6c6-798154c3d8b7","Type":"ContainerDied","Data":"fd02739b18272001abdc2ee01da48e3646216745c167bd03c9a1b52aea0870de"}
Jul 30 20:29:51.404878 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.404831    2561 scope.go:117] "RemoveContainer" containerID="bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8"
Jul 30 20:29:51.415003 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.414982    2561 scope.go:117] "RemoveContainer" containerID="bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8"
Jul 30 20:29:51.415232 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:29:51.415213    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8\": container with ID starting with bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8 not found: ID does not exist" containerID="bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8"
Jul 30 20:29:51.415288 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.415239    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8"} err="failed to get container status \"bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8\": rpc error: code = NotFound desc = could not find container \"bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8\": container with ID starting with bbbcb3fb32ef37b18ea4a6eb9ad22e9e30956855052c6d7ba52f8c8386f9f3f8 not found: ID does not exist"
Jul 30 20:29:51.428187 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.428164    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"]
Jul 30 20:29:51.433279 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.433259    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-808798/auth-test-model-808798-kserve-7f58465847-ttkdc"]
Jul 30 20:29:51.456239 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.456219    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v4mm\" (UniqueName: \"kubernetes.io/projected/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-kube-api-access-7v4mm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:51.456337 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.456240    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:51.456337 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.456254    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:51.456337 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.456266    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01f351f1-bfbe-4db4-a6c6-798154c3d8b7-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:29:51.840824 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.840795    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f351f1-bfbe-4db4-a6c6-798154c3d8b7" path="/var/lib/kubelet/pods/01f351f1-bfbe-4db4-a6c6-798154c3d8b7/volumes"
Jul 30 20:29:51.841200 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:51.841186    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" path="/var/lib/kubelet/pods/e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e/volumes"
Jul 30 20:29:59.691346 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.691302    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"]
Jul 30 20:29:59.691927 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.691904    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" containerName="main"
Jul 30 20:29:59.691927 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.691929    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" containerName="main"
Jul 30 20:29:59.692094 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.691940    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f351f1-bfbe-4db4-a6c6-798154c3d8b7" containerName="main"
Jul 30 20:29:59.692094 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.691949    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f351f1-bfbe-4db4-a6c6-798154c3d8b7" containerName="main"
Jul 30 20:29:59.692094 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.692060    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a2e954-2ae3-43bc-a8f7-f8ee2b530e1e" containerName="main"
Jul 30 20:29:59.692094 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.692078    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f351f1-bfbe-4db4-a6c6-798154c3d8b7" containerName="main"
Jul 30 20:29:59.695230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.695206    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.699734 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.699710    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"kube-root-ca.crt\""
Jul 30 20:29:59.699853 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.699732    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"default-dockercfg-7c2w8\""
Jul 30 20:29:59.699853 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.699737    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"sub-test-model-808798-kserve-self-signed-certs\""
Jul 30 20:29:59.699853 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.699713    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"openshift-service-ca.crt\""
Jul 30 20:29:59.709601 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.709574    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"]
Jul 30 20:29:59.733131 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.733105    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:59.817479 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.817458    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-home\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.817572 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.817485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-dshm\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.817572 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.817528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tmp-dir\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.817644 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.817571    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tls-certs\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.817644 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.817615    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmn4p\" (UniqueName: \"kubernetes.io/projected/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-kube-api-access-dmn4p\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.817709 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.817642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-model-cache\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.918017 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.917994    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-home\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.918178 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.918021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-dshm\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.918178 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.918101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tmp-dir\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.918178 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.918126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tls-certs\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.918178 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.918158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmn4p\" (UniqueName: \"kubernetes.io/projected/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-kube-api-access-dmn4p\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.918396 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.918193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-model-cache\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.918454 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.918438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-home\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.918521 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.918483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tmp-dir\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.918574 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.918521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-model-cache\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.920194 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.920173    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-dshm\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.920453 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.920438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tls-certs\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:29:59.926290 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:29:59.926271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmn4p\" (UniqueName: \"kubernetes.io/projected/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-kube-api-access-dmn4p\") pod \"sub-test-model-808798-kserve-76b9669f5-z885l\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") " pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:30:00.005770 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:30:00.005719    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:30:00.145011 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:30:00.144980    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"]
Jul 30 20:30:00.146419 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:30:00.146387    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5e55dc0_7d47_4e7f_b1d9_44446cf2caaf.slice/crio-54f596c97209a2334992940bd24436e4d35b305e88374b5e29b7bc57ad7e18ed WatchSource:0}: Error finding container 54f596c97209a2334992940bd24436e4d35b305e88374b5e29b7bc57ad7e18ed: Status 404 returned error can't find the container with id 54f596c97209a2334992940bd24436e4d35b305e88374b5e29b7bc57ad7e18ed
Jul 30 20:30:00.460900 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:30:00.460856    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l" event={"ID":"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf","Type":"ContainerStarted","Data":"e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c"}
Jul 30 20:30:00.461060 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:30:00.460922    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l" event={"ID":"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf","Type":"ContainerStarted","Data":"54f596c97209a2334992940bd24436e4d35b305e88374b5e29b7bc57ad7e18ed"}
Jul 30 20:30:00.479360 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:30:00.479314    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l" podStartSLOduration=1.479299007 podStartE2EDuration="1.479299007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:30:00.478456896 +0000 UTC m=+3043.118871981" watchObservedRunningTime="2026-07-30 20:30:00.479299007 +0000 UTC m=+3043.119714140"
Jul 30 20:30:10.006305 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:30:10.006270    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:30:10.006709 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:30:10.006318    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:30:10.018660 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:30:10.018633    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:30:10.526058 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:30:10.526028    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:31:15.061277 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:15.061227    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:22.411695 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:22.411653    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:36.061830 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:36.061797    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"]
Jul 30 20:31:36.084949 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:36.084925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:36.976562 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:36.976528    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"]
Jul 30 20:31:36.994148 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:36.994123    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:40.506298 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:40.506210    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:51.080323 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.080267    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv" podUID="6a4cfa80-73eb-4482-ad4f-79914f91e5e8" containerName="main" containerID="cri-o://16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761" gracePeriod=45
Jul 30 20:31:51.323409 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.323384    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:31:51.395205 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.395180    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-dshm\") pod \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") "
Jul 30 20:31:51.395339 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.395219    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tls-certs\") pod \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") "
Jul 30 20:31:51.395339 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.395240    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5gm5\" (UniqueName: \"kubernetes.io/projected/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-kube-api-access-g5gm5\") pod \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") "
Jul 30 20:31:51.395339 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.395271    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tmp-dir\") pod \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") "
Jul 30 20:31:51.395339 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.395322    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-model-cache\") pod \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") "
Jul 30 20:31:51.395585 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.395356    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-home\") pod \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\" (UID: \"6a4cfa80-73eb-4482-ad4f-79914f91e5e8\") "
Jul 30 20:31:51.395585 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.395570    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6a4cfa80-73eb-4482-ad4f-79914f91e5e8" (UID: "6a4cfa80-73eb-4482-ad4f-79914f91e5e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:31:51.395686 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.395624    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "6a4cfa80-73eb-4482-ad4f-79914f91e5e8" (UID: "6a4cfa80-73eb-4482-ad4f-79914f91e5e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:31:51.395741 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.395684    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:51.395741 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.395725    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-home" (OuterVolumeSpecName: "home") pod "6a4cfa80-73eb-4482-ad4f-79914f91e5e8" (UID: "6a4cfa80-73eb-4482-ad4f-79914f91e5e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:31:51.397371 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.397350    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a4cfa80-73eb-4482-ad4f-79914f91e5e8" (UID: "6a4cfa80-73eb-4482-ad4f-79914f91e5e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:51.397371 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.397361    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-dshm" (OuterVolumeSpecName: "dshm") pod "6a4cfa80-73eb-4482-ad4f-79914f91e5e8" (UID: "6a4cfa80-73eb-4482-ad4f-79914f91e5e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:31:51.397498 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.397417    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-kube-api-access-g5gm5" (OuterVolumeSpecName: "kube-api-access-g5gm5") pod "6a4cfa80-73eb-4482-ad4f-79914f91e5e8" (UID: "6a4cfa80-73eb-4482-ad4f-79914f91e5e8"). InnerVolumeSpecName "kube-api-access-g5gm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:31:51.496078 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.496043    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:51.496078 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.496075    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:51.496215 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.496087    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:51.496215 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.496099    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:51.496215 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.496111    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5gm5\" (UniqueName: \"kubernetes.io/projected/6a4cfa80-73eb-4482-ad4f-79914f91e5e8-kube-api-access-g5gm5\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:51.995608 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:51.995545    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l" podUID="f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" containerName="main" containerID="cri-o://e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c" gracePeriod=45
Jul 30 20:31:52.083878 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.083847    2561 generic.go:356] "Generic (PLEG): container finished" podID="6a4cfa80-73eb-4482-ad4f-79914f91e5e8" containerID="16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761" exitCode=0
Jul 30 20:31:52.083878 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.083899    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"
Jul 30 20:31:52.084304 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.083925    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv" event={"ID":"6a4cfa80-73eb-4482-ad4f-79914f91e5e8","Type":"ContainerDied","Data":"16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761"}
Jul 30 20:31:52.084304 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.083967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv" event={"ID":"6a4cfa80-73eb-4482-ad4f-79914f91e5e8","Type":"ContainerDied","Data":"e01d208962abf3138a450d924bf0f2f84c0d1ac307b41d56dab872bc94741cff"}
Jul 30 20:31:52.084304 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.083986    2561 scope.go:117] "RemoveContainer" containerID="16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761"
Jul 30 20:31:52.101382 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.101327    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"]
Jul 30 20:31:52.106438 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.106416    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/sub-test-model-474e8f-kserve-5c58869c8c-8r4mv"]
Jul 30 20:31:52.107696 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.107682    2561 scope.go:117] "RemoveContainer" containerID="16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761"
Jul 30 20:31:52.108003 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:31:52.107975    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761\": container with ID starting with 16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761 not found: ID does not exist" containerID="16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761"
Jul 30 20:31:52.108073 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.108012    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761"} err="failed to get container status \"16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761\": rpc error: code = NotFound desc = could not find container \"16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761\": container with ID starting with 16b135c819c6c7ac8b9694a33b921c99936986e50de4b725431af21d1d2d4761 not found: ID does not exist"
Jul 30 20:31:52.241072 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.241050    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:31:52.302047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.302021    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-dshm\") pod \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") "
Jul 30 20:31:52.302178 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.302081    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tls-certs\") pod \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") "
Jul 30 20:31:52.302178 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.302111    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-home\") pod \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") "
Jul 30 20:31:52.302178 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.302134    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmn4p\" (UniqueName: \"kubernetes.io/projected/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-kube-api-access-dmn4p\") pod \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") "
Jul 30 20:31:52.302178 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.302154    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tmp-dir\") pod \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") "
Jul 30 20:31:52.302403 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.302229    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-model-cache\") pod \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\" (UID: \"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf\") "
Jul 30 20:31:52.302518 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.302422    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-home" (OuterVolumeSpecName: "home") pod "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" (UID: "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:31:52.302613 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.302508    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" (UID: "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:31:52.302657 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.302605    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-model-cache" (OuterVolumeSpecName: "model-cache") pod "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" (UID: "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:31:52.304334 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.304308    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-kube-api-access-dmn4p" (OuterVolumeSpecName: "kube-api-access-dmn4p") pod "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" (UID: "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf"). InnerVolumeSpecName "kube-api-access-dmn4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:31:52.304442 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.304375    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" (UID: "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:52.304442 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.304392    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-dshm" (OuterVolumeSpecName: "dshm") pod "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" (UID: "f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:31:52.402924 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.402879    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:52.402924 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.402922    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:52.403043 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.402934    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmn4p\" (UniqueName: \"kubernetes.io/projected/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-kube-api-access-dmn4p\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:52.403043 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.402945    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:52.403043 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.402955    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:52.403043 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:52.402962    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:31:53.090702 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.090662    2561 generic.go:356] "Generic (PLEG): container finished" podID="f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" containerID="e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c" exitCode=0
Jul 30 20:31:53.091233 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.090715    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"
Jul 30 20:31:53.091233 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.090756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l" event={"ID":"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf","Type":"ContainerDied","Data":"e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c"}
Jul 30 20:31:53.091233 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.090811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l" event={"ID":"f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf","Type":"ContainerDied","Data":"54f596c97209a2334992940bd24436e4d35b305e88374b5e29b7bc57ad7e18ed"}
Jul 30 20:31:53.091233 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.090832    2561 scope.go:117] "RemoveContainer" containerID="e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c"
Jul 30 20:31:53.100361 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.100344    2561 scope.go:117] "RemoveContainer" containerID="e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c"
Jul 30 20:31:53.100605 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:31:53.100587    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c\": container with ID starting with e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c not found: ID does not exist" containerID="e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c"
Jul 30 20:31:53.100684 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.100615    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c"} err="failed to get container status \"e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c\": rpc error: code = NotFound desc = could not find container \"e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c\": container with ID starting with e60b9b0bcd9e2e56dd7293d6c900b4b858e9b0ac71c86234a44e63769583156c not found: ID does not exist"
Jul 30 20:31:53.112788 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.112758    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"]
Jul 30 20:31:53.114981 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.114958    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-808798/sub-test-model-808798-kserve-76b9669f5-z885l"]
Jul 30 20:31:53.841636 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.841604    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a4cfa80-73eb-4482-ad4f-79914f91e5e8" path="/var/lib/kubelet/pods/6a4cfa80-73eb-4482-ad4f-79914f91e5e8/volumes"
Jul 30 20:31:53.842010 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:31:53.841994    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" path="/var/lib/kubelet/pods/f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf/volumes"
Jul 30 20:32:02.908441 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.908404    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"]
Jul 30 20:32:02.908814 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.908782    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4cfa80-73eb-4482-ad4f-79914f91e5e8" containerName="main"
Jul 30 20:32:02.908814 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.908792    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4cfa80-73eb-4482-ad4f-79914f91e5e8" containerName="main"
Jul 30 20:32:02.908814 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.908806    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" containerName="main"
Jul 30 20:32:02.908814 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.908811    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" containerName="main"
Jul 30 20:32:02.908990 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.908872    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5e55dc0-7d47-4e7f-b1d9-44446cf2caaf" containerName="main"
Jul 30 20:32:02.908990 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.908879    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a4cfa80-73eb-4482-ad4f-79914f91e5e8" containerName="main"
Jul 30 20:32:02.911789 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.911773    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:02.914478 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.914457    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-474e8f\"/\"kube-root-ca.crt\""
Jul 30 20:32:02.915869 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.915837    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-474e8f\"/\"openshift-service-ca.crt\""
Jul 30 20:32:02.915997 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.915841    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-474e8f\"/\"default-dockercfg-gz6mk\""
Jul 30 20:32:02.915997 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.915876    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-474e8f\"/\"rate-test-model-474e8f-kserve-self-signed-certs\""
Jul 30 20:32:02.919930 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.919882    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"]
Jul 30 20:32:02.986710 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.986688    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-dshm\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:02.986821 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.986717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-tmp-dir\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:02.986821 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.986734    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512df96b-ebff-4234-81a1-0b93fc53b7b4-tls-certs\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:02.986821 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.986755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq8bz\" (UniqueName: \"kubernetes.io/projected/512df96b-ebff-4234-81a1-0b93fc53b7b4-kube-api-access-gq8bz\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:02.986958 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.986852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-home\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:02.986958 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.986915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-model-cache\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:02.995075 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:02.995037    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:03.087959 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.087934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-model-cache\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.088047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.087990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-dshm\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.088047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.088019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-tmp-dir\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.088047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.088039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512df96b-ebff-4234-81a1-0b93fc53b7b4-tls-certs\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.088199 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.088071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq8bz\" (UniqueName: \"kubernetes.io/projected/512df96b-ebff-4234-81a1-0b93fc53b7b4-kube-api-access-gq8bz\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.088199 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.088115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-home\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.088391 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.088370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-model-cache\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.088467 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.088395    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-tmp-dir\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.088467 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.088443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-home\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.090350 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.090331    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-dshm\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.090635 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.090615    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512df96b-ebff-4234-81a1-0b93fc53b7b4-tls-certs\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.098625 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.098605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq8bz\" (UniqueName: \"kubernetes.io/projected/512df96b-ebff-4234-81a1-0b93fc53b7b4-kube-api-access-gq8bz\") pod \"rate-test-model-474e8f-kserve-769f9f99c5-62j42\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") " pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.221468 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.221406    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:03.355319 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:03.355293    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"]
Jul 30 20:32:03.356152 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:32:03.356130    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod512df96b_ebff_4234_81a1_0b93fc53b7b4.slice/crio-e7be241ce0507aec0b1651f9795773941f9a9267694e235d69527c366af7d9be WatchSource:0}: Error finding container e7be241ce0507aec0b1651f9795773941f9a9267694e235d69527c366af7d9be: Status 404 returned error can't find the container with id e7be241ce0507aec0b1651f9795773941f9a9267694e235d69527c366af7d9be
Jul 30 20:32:04.151752 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:04.151714    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42" event={"ID":"512df96b-ebff-4234-81a1-0b93fc53b7b4","Type":"ContainerStarted","Data":"c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5"}
Jul 30 20:32:04.152414 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:04.151764    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42" event={"ID":"512df96b-ebff-4234-81a1-0b93fc53b7b4","Type":"ContainerStarted","Data":"e7be241ce0507aec0b1651f9795773941f9a9267694e235d69527c366af7d9be"}
Jul 30 20:32:04.168690 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:04.168631    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42" podStartSLOduration=2.168617967 podStartE2EDuration="2.168617967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:32:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:32:04.167015856 +0000 UTC m=+3166.807430936" watchObservedRunningTime="2026-07-30 20:32:04.168617967 +0000 UTC m=+3166.809033047"
Jul 30 20:32:13.222158 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:13.222110    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:13.222581 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:13.222173    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:13.235151 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:13.235092    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:14.216728 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:14.216696    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:32:35.102834 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.102801    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"]
Jul 30 20:32:35.106423 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.106404    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.109275 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.109255    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"kube-root-ca.crt\""
Jul 30 20:32:35.110675 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.110658    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"openshift-service-ca.crt\""
Jul 30 20:32:35.110770 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.110691    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"rate-test-model-808798-kserve-self-signed-certs\""
Jul 30 20:32:35.110770 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.110762    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-808798\"/\"default-dockercfg-7c2w8\""
Jul 30 20:32:35.118221 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.118199    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"]
Jul 30 20:32:35.154020 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.153990    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:35.246276 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.246251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-model-cache\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.246378 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.246281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpwmg\" (UniqueName: \"kubernetes.io/projected/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-kube-api-access-dpwmg\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.246378 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.246314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-dshm\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.246452 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.246399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tmp-dir\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.246452 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.246435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-home\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.246517 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.246461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tls-certs\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.347429 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.347402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tmp-dir\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.347539 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.347445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-home\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.347539 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.347467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tls-certs\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.347539 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.347504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-model-cache\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.347676 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.347540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpwmg\" (UniqueName: \"kubernetes.io/projected/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-kube-api-access-dpwmg\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.347676 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.347567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-dshm\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.347832 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.347807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tmp-dir\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.347928 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.347865    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-home\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.347986 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.347926    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-model-cache\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.349748 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.349722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-dshm\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.349961 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.349942    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tls-certs\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.355976 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.355918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpwmg\" (UniqueName: \"kubernetes.io/projected/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-kube-api-access-dpwmg\") pod \"rate-test-model-808798-kserve-79b8567d99-pvp4w\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") " pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.419676 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.419655    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:35.549856 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:35.549830    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"]
Jul 30 20:32:36.329277 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:36.329239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w" event={"ID":"1de46b03-1c95-4652-ace6-fc0e2c7e37f1","Type":"ContainerStarted","Data":"6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536"}
Jul 30 20:32:36.329277 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:36.329279    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w" event={"ID":"1de46b03-1c95-4652-ace6-fc0e2c7e37f1","Type":"ContainerStarted","Data":"e177245ef37c34c96900969a0bd74c70fb6c3ed3d7623872b0cb47666cbc4603"}
Jul 30 20:32:36.353485 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:36.353440    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w" podStartSLOduration=1.353425687 podStartE2EDuration="1.353425687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:32:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:32:36.352113317 +0000 UTC m=+3198.992528396" watchObservedRunningTime="2026-07-30 20:32:36.353425687 +0000 UTC m=+3198.993840798"
Jul 30 20:32:45.420404 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:45.420369    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:45.420404 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:45.420410    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:45.432685 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:45.432657    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:32:46.397553 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:32:46.397525    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:34:18.182138 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:18.182042    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:34:18.188550 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:18.188524    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:34:18.189208 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:18.189191    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:34:18.195471 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:18.195455    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:34:20.337047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:20.337012    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"]
Jul 30 20:34:21.220791 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:21.220754    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:21.346084 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:21.346046    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"]
Jul 30 20:34:22.319898 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.319857    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7563-140481574997168"]
Jul 30 20:34:22.323390 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.323369    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481574997168"
Jul 30 20:34:22.326225 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.326201    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-b9qcd\""
Jul 30 20:34:22.330628 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.330591    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481574997168"]
Jul 30 20:34:22.397194 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.397169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqqtp\" (UniqueName: \"kubernetes.io/projected/b399073f-28dc-450a-9aa3-b8f7b3d98a1b-kube-api-access-xqqtp\") pod \"test-curl-7563-140481574997168\" (UID: \"b399073f-28dc-450a-9aa3-b8f7b3d98a1b\") " pod="opendatahub/test-curl-7563-140481574997168"
Jul 30 20:34:22.498350 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.498328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqqtp\" (UniqueName: \"kubernetes.io/projected/b399073f-28dc-450a-9aa3-b8f7b3d98a1b-kube-api-access-xqqtp\") pod \"test-curl-7563-140481574997168\" (UID: \"b399073f-28dc-450a-9aa3-b8f7b3d98a1b\") " pod="opendatahub/test-curl-7563-140481574997168"
Jul 30 20:34:22.506957 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.506928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqqtp\" (UniqueName: \"kubernetes.io/projected/b399073f-28dc-450a-9aa3-b8f7b3d98a1b-kube-api-access-xqqtp\") pod \"test-curl-7563-140481574997168\" (UID: \"b399073f-28dc-450a-9aa3-b8f7b3d98a1b\") " pod="opendatahub/test-curl-7563-140481574997168"
Jul 30 20:34:22.635186 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.635165    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481574997168"
Jul 30 20:34:22.764461 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.764435    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481574997168"]
Jul 30 20:34:22.765855 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:34:22.765829    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb399073f_28dc_450a_9aa3_b8f7b3d98a1b.slice/crio-2fde6fc821669184dedb9c64cd101adfc225503ee1662dbc9e26c70931da6fcd WatchSource:0}: Error finding container 2fde6fc821669184dedb9c64cd101adfc225503ee1662dbc9e26c70931da6fcd: Status 404 returned error can't find the container with id 2fde6fc821669184dedb9c64cd101adfc225503ee1662dbc9e26c70931da6fcd
Jul 30 20:34:22.767067 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.767049    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:34:22.939497 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.939425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481574997168" event={"ID":"b399073f-28dc-450a-9aa3-b8f7b3d98a1b","Type":"ContainerStarted","Data":"2fde6fc821669184dedb9c64cd101adfc225503ee1662dbc9e26c70931da6fcd"}
Jul 30 20:34:22.999291 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:22.999265    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:23.949839 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:23.949809    2561 generic.go:356] "Generic (PLEG): container finished" podID="b399073f-28dc-450a-9aa3-b8f7b3d98a1b" containerID="acb5709b5ae0f39ff2e3d4d2108121f4e765420db9b9f3cc148534586edcfbe7" exitCode=0
Jul 30 20:34:23.950227 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:23.949912    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481574997168" event={"ID":"b399073f-28dc-450a-9aa3-b8f7b3d98a1b","Type":"ContainerDied","Data":"acb5709b5ae0f39ff2e3d4d2108121f4e765420db9b9f3cc148534586edcfbe7"}
Jul 30 20:34:25.092075 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.092049    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481574997168"
Jul 30 20:34:25.110627 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.110601    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7563-140481574997168_b399073f-28dc-450a-9aa3-b8f7b3d98a1b/test-curl-7563-140481574997168/0.log"
Jul 30 20:34:25.137133 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.137110    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7563-140481574997168"]
Jul 30 20:34:25.139298 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.139277    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7563-140481574997168"]
Jul 30 20:34:25.223100 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.223042    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqqtp\" (UniqueName: \"kubernetes.io/projected/b399073f-28dc-450a-9aa3-b8f7b3d98a1b-kube-api-access-xqqtp\") pod \"b399073f-28dc-450a-9aa3-b8f7b3d98a1b\" (UID: \"b399073f-28dc-450a-9aa3-b8f7b3d98a1b\") "
Jul 30 20:34:25.225104 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.225081    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b399073f-28dc-450a-9aa3-b8f7b3d98a1b-kube-api-access-xqqtp" (OuterVolumeSpecName: "kube-api-access-xqqtp") pod "b399073f-28dc-450a-9aa3-b8f7b3d98a1b" (UID: "b399073f-28dc-450a-9aa3-b8f7b3d98a1b"). InnerVolumeSpecName "kube-api-access-xqqtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:34:25.260595 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.260576    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7563-140481574994992"]
Jul 30 20:34:25.260980 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.260967    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b399073f-28dc-450a-9aa3-b8f7b3d98a1b" containerName="test-curl-7563-140481574997168"
Jul 30 20:34:25.261034 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.260982    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b399073f-28dc-450a-9aa3-b8f7b3d98a1b" containerName="test-curl-7563-140481574997168"
Jul 30 20:34:25.261076 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.261055    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b399073f-28dc-450a-9aa3-b8f7b3d98a1b" containerName="test-curl-7563-140481574997168"
Jul 30 20:34:25.264035 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.264021    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481574994992"
Jul 30 20:34:25.268178 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.268148    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481574994992"]
Jul 30 20:34:25.323723 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.323702    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwpph\" (UniqueName: \"kubernetes.io/projected/09f26328-132c-4f83-a38e-5bbb1033841a-kube-api-access-cwpph\") pod \"test-curl-7563-140481574994992\" (UID: \"09f26328-132c-4f83-a38e-5bbb1033841a\") " pod="opendatahub/test-curl-7563-140481574994992"
Jul 30 20:34:25.323821 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.323810    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqqtp\" (UniqueName: \"kubernetes.io/projected/b399073f-28dc-450a-9aa3-b8f7b3d98a1b-kube-api-access-xqqtp\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:25.424991 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.424967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwpph\" (UniqueName: \"kubernetes.io/projected/09f26328-132c-4f83-a38e-5bbb1033841a-kube-api-access-cwpph\") pod \"test-curl-7563-140481574994992\" (UID: \"09f26328-132c-4f83-a38e-5bbb1033841a\") " pod="opendatahub/test-curl-7563-140481574994992"
Jul 30 20:34:25.433373 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.433346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwpph\" (UniqueName: \"kubernetes.io/projected/09f26328-132c-4f83-a38e-5bbb1033841a-kube-api-access-cwpph\") pod \"test-curl-7563-140481574994992\" (UID: \"09f26328-132c-4f83-a38e-5bbb1033841a\") " pod="opendatahub/test-curl-7563-140481574994992"
Jul 30 20:34:25.575093 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.575026    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481574994992"
Jul 30 20:34:25.706052 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.706026    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481574994992"]
Jul 30 20:34:25.707909 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:34:25.707866    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09f26328_132c_4f83_a38e_5bbb1033841a.slice/crio-176d93c9d22d087512e10a9e85cdbb438841330822f4e2a419a675ccda8c7f64 WatchSource:0}: Error finding container 176d93c9d22d087512e10a9e85cdbb438841330822f4e2a419a675ccda8c7f64: Status 404 returned error can't find the container with id 176d93c9d22d087512e10a9e85cdbb438841330822f4e2a419a675ccda8c7f64
Jul 30 20:34:25.841009 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.840951    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b399073f-28dc-450a-9aa3-b8f7b3d98a1b" path="/var/lib/kubelet/pods/b399073f-28dc-450a-9aa3-b8f7b3d98a1b/volumes"
Jul 30 20:34:25.961724 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.961703    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481574997168"
Jul 30 20:34:25.961832 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.961705    2561 scope.go:117] "RemoveContainer" containerID="acb5709b5ae0f39ff2e3d4d2108121f4e765420db9b9f3cc148534586edcfbe7"
Jul 30 20:34:25.963085 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:25.963008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481574994992" event={"ID":"09f26328-132c-4f83-a38e-5bbb1033841a","Type":"ContainerStarted","Data":"176d93c9d22d087512e10a9e85cdbb438841330822f4e2a419a675ccda8c7f64"}
Jul 30 20:34:26.970861 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:26.970829    2561 generic.go:356] "Generic (PLEG): container finished" podID="09f26328-132c-4f83-a38e-5bbb1033841a" containerID="608bed61ecb8e910c7d36783416134b5b716681890ab80fbe422aaa6ac2a95a0" exitCode=0
Jul 30 20:34:26.971234 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:26.970913    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481574994992" event={"ID":"09f26328-132c-4f83-a38e-5bbb1033841a","Type":"ContainerDied","Data":"608bed61ecb8e910c7d36783416134b5b716681890ab80fbe422aaa6ac2a95a0"}
Jul 30 20:34:28.108168 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.108146    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481574994992"
Jul 30 20:34:28.128622 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.128601    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7563-140481574994992_09f26328-132c-4f83-a38e-5bbb1033841a/test-curl-7563-140481574994992/0.log"
Jul 30 20:34:28.150592 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.150568    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7563-140481574994992"]
Jul 30 20:34:28.154750 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.154724    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7563-140481574994992"]
Jul 30 20:34:28.249047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.248995    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwpph\" (UniqueName: \"kubernetes.io/projected/09f26328-132c-4f83-a38e-5bbb1033841a-kube-api-access-cwpph\") pod \"09f26328-132c-4f83-a38e-5bbb1033841a\" (UID: \"09f26328-132c-4f83-a38e-5bbb1033841a\") "
Jul 30 20:34:28.250976 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.250946    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09f26328-132c-4f83-a38e-5bbb1033841a-kube-api-access-cwpph" (OuterVolumeSpecName: "kube-api-access-cwpph") pod "09f26328-132c-4f83-a38e-5bbb1033841a" (UID: "09f26328-132c-4f83-a38e-5bbb1033841a"). InnerVolumeSpecName "kube-api-access-cwpph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:34:28.313531 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.313499    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7563-140481575099824"]
Jul 30 20:34:28.313873 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.313860    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09f26328-132c-4f83-a38e-5bbb1033841a" containerName="test-curl-7563-140481574994992"
Jul 30 20:34:28.313944 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.313874    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="09f26328-132c-4f83-a38e-5bbb1033841a" containerName="test-curl-7563-140481574994992"
Jul 30 20:34:28.313981 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.313973    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="09f26328-132c-4f83-a38e-5bbb1033841a" containerName="test-curl-7563-140481574994992"
Jul 30 20:34:28.316952 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.316938    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:28.323335 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.323311    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481575099824"]
Jul 30 20:34:28.349831 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.349812    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwpph\" (UniqueName: \"kubernetes.io/projected/09f26328-132c-4f83-a38e-5bbb1033841a-kube-api-access-cwpph\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:28.450518 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.450498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svb69\" (UniqueName: \"kubernetes.io/projected/6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140-kube-api-access-svb69\") pod \"test-curl-7563-140481575099824\" (UID: \"6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140\") " pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:28.551179 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.551115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svb69\" (UniqueName: \"kubernetes.io/projected/6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140-kube-api-access-svb69\") pod \"test-curl-7563-140481575099824\" (UID: \"6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140\") " pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:28.559141 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.559110    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svb69\" (UniqueName: \"kubernetes.io/projected/6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140-kube-api-access-svb69\") pod \"test-curl-7563-140481575099824\" (UID: \"6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140\") " pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:28.627099 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.627068    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:28.760476 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.760399    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481575099824"]
Jul 30 20:34:28.763150 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:34:28.763122    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e11b3b1_36d1_41f3_be8f_7cc0c3b4f140.slice/crio-373b88fd36daef7d46a92fd86d402536cd66ffd91183d012b72330f1be752038 WatchSource:0}: Error finding container 373b88fd36daef7d46a92fd86d402536cd66ffd91183d012b72330f1be752038: Status 404 returned error can't find the container with id 373b88fd36daef7d46a92fd86d402536cd66ffd91183d012b72330f1be752038
Jul 30 20:34:28.982061 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.982038    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481574994992"
Jul 30 20:34:28.982206 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.982047    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="176d93c9d22d087512e10a9e85cdbb438841330822f4e2a419a675ccda8c7f64"
Jul 30 20:34:28.983392 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:28.983369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481575099824" event={"ID":"6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140","Type":"ContainerStarted","Data":"373b88fd36daef7d46a92fd86d402536cd66ffd91183d012b72330f1be752038"}
Jul 30 20:34:28.993188 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:34:28.993164    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7563-140481574994992\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="09f26328-132c-4f83-a38e-5bbb1033841a" pod="opendatahub/test-curl-7563-140481574994992"
Jul 30 20:34:29.841553 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:29.841518    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09f26328-132c-4f83-a38e-5bbb1033841a" path="/var/lib/kubelet/pods/09f26328-132c-4f83-a38e-5bbb1033841a/volumes"
Jul 30 20:34:29.990604 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:29.990573    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140" containerID="8a86e6f5c5a5fe3a8b8e7b014fc163cdfb637d20a6390502186a5b309ba57587" exitCode=0
Jul 30 20:34:29.990760 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:29.990612    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481575099824" event={"ID":"6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140","Type":"ContainerDied","Data":"8a86e6f5c5a5fe3a8b8e7b014fc163cdfb637d20a6390502186a5b309ba57587"}
Jul 30 20:34:31.124487 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.124461    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:31.143259 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.143236    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7563-140481575099824_6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140/test-curl-7563-140481575099824/0.log"
Jul 30 20:34:31.165290 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.165262    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7563-140481575099824"]
Jul 30 20:34:31.167447 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.167429    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7563-140481575099824"]
Jul 30 20:34:31.275203 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.275151    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svb69\" (UniqueName: \"kubernetes.io/projected/6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140-kube-api-access-svb69\") pod \"6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140\" (UID: \"6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140\") "
Jul 30 20:34:31.277088 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.277070    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140-kube-api-access-svb69" (OuterVolumeSpecName: "kube-api-access-svb69") pod "6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140" (UID: "6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140"). InnerVolumeSpecName "kube-api-access-svb69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:34:31.282966 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.282946    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7563-140481575099824"]
Jul 30 20:34:31.283411 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.283396    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140" containerName="test-curl-7563-140481575099824"
Jul 30 20:34:31.283505 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.283414    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140" containerName="test-curl-7563-140481575099824"
Jul 30 20:34:31.283562 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.283538    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140" containerName="test-curl-7563-140481575099824"
Jul 30 20:34:31.286486 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.286468    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:31.292260 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.292239    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481575099824"]
Jul 30 20:34:31.376083 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.376063    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbw69\" (UniqueName: \"kubernetes.io/projected/d12e56c8-f7f9-4957-9904-cdebb936733b-kube-api-access-dbw69\") pod \"test-curl-7563-140481575099824\" (UID: \"d12e56c8-f7f9-4957-9904-cdebb936733b\") " pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:31.376179 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.376127    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svb69\" (UniqueName: \"kubernetes.io/projected/6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140-kube-api-access-svb69\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:31.476846 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.476820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbw69\" (UniqueName: \"kubernetes.io/projected/d12e56c8-f7f9-4957-9904-cdebb936733b-kube-api-access-dbw69\") pod \"test-curl-7563-140481575099824\" (UID: \"d12e56c8-f7f9-4957-9904-cdebb936733b\") " pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:31.485664 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.485645    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbw69\" (UniqueName: \"kubernetes.io/projected/d12e56c8-f7f9-4957-9904-cdebb936733b-kube-api-access-dbw69\") pod \"test-curl-7563-140481575099824\" (UID: \"d12e56c8-f7f9-4957-9904-cdebb936733b\") " pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:31.597063 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.597007    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:31.841089 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.841059    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140" path="/var/lib/kubelet/pods/6e11b3b1-36d1-41f3-be8f-7cc0c3b4f140/volumes"
Jul 30 20:34:31.932308 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:31.932289    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481575099824"]
Jul 30 20:34:31.934161 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:34:31.934139    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd12e56c8_f7f9_4957_9904_cdebb936733b.slice/crio-6d0d8ec6e630ad115519fa93d81aa0d21713756cebb20a3b9d3bd2ccf93b21dc WatchSource:0}: Error finding container 6d0d8ec6e630ad115519fa93d81aa0d21713756cebb20a3b9d3bd2ccf93b21dc: Status 404 returned error can't find the container with id 6d0d8ec6e630ad115519fa93d81aa0d21713756cebb20a3b9d3bd2ccf93b21dc
Jul 30 20:34:32.002798 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:32.002773    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:32.002927 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:32.002832    2561 scope.go:117] "RemoveContainer" containerID="8a86e6f5c5a5fe3a8b8e7b014fc163cdfb637d20a6390502186a5b309ba57587"
Jul 30 20:34:32.004004 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:32.003976    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481575099824" event={"ID":"d12e56c8-f7f9-4957-9904-cdebb936733b","Type":"ContainerStarted","Data":"6d0d8ec6e630ad115519fa93d81aa0d21713756cebb20a3b9d3bd2ccf93b21dc"}
Jul 30 20:34:33.011883 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:33.011849    2561 generic.go:356] "Generic (PLEG): container finished" podID="d12e56c8-f7f9-4957-9904-cdebb936733b" containerID="548e44172c446b1e7164119b100f900c7707244feab8ffa7d10ca91134341a3a" exitCode=0
Jul 30 20:34:33.012310 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:33.011936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481575099824" event={"ID":"d12e56c8-f7f9-4957-9904-cdebb936733b","Type":"ContainerDied","Data":"548e44172c446b1e7164119b100f900c7707244feab8ffa7d10ca91134341a3a"}
Jul 30 20:34:34.156367 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.156344    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:34.175114 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.175087    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7563-140481575099824_d12e56c8-f7f9-4957-9904-cdebb936733b/test-curl-7563-140481575099824/0.log"
Jul 30 20:34:34.196895 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.196855    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7563-140481575099824"]
Jul 30 20:34:34.200811 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.200790    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7563-140481575099824"]
Jul 30 20:34:34.303494 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.303441    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbw69\" (UniqueName: \"kubernetes.io/projected/d12e56c8-f7f9-4957-9904-cdebb936733b-kube-api-access-dbw69\") pod \"d12e56c8-f7f9-4957-9904-cdebb936733b\" (UID: \"d12e56c8-f7f9-4957-9904-cdebb936733b\") "
Jul 30 20:34:34.305408 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.305378    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d12e56c8-f7f9-4957-9904-cdebb936733b-kube-api-access-dbw69" (OuterVolumeSpecName: "kube-api-access-dbw69") pod "d12e56c8-f7f9-4957-9904-cdebb936733b" (UID: "d12e56c8-f7f9-4957-9904-cdebb936733b"). InnerVolumeSpecName "kube-api-access-dbw69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:34:34.339800 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.339778    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7563-140481575207392"]
Jul 30 20:34:34.340154 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.340141    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d12e56c8-f7f9-4957-9904-cdebb936733b" containerName="test-curl-7563-140481575099824"
Jul 30 20:34:34.340204 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.340155    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d12e56c8-f7f9-4957-9904-cdebb936733b" containerName="test-curl-7563-140481575099824"
Jul 30 20:34:34.340241 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.340224    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d12e56c8-f7f9-4957-9904-cdebb936733b" containerName="test-curl-7563-140481575099824"
Jul 30 20:34:34.343305 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.343291    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:34.349085 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.349056    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481575207392"]
Jul 30 20:34:34.404663 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.404640    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbw69\" (UniqueName: \"kubernetes.io/projected/d12e56c8-f7f9-4957-9904-cdebb936733b-kube-api-access-dbw69\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:34.505682 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.505652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkslr\" (UniqueName: \"kubernetes.io/projected/f2edb47a-2859-4dad-8b84-9cb5d736e27a-kube-api-access-lkslr\") pod \"test-curl-7563-140481575207392\" (UID: \"f2edb47a-2859-4dad-8b84-9cb5d736e27a\") " pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:34.607029 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.606971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkslr\" (UniqueName: \"kubernetes.io/projected/f2edb47a-2859-4dad-8b84-9cb5d736e27a-kube-api-access-lkslr\") pod \"test-curl-7563-140481575207392\" (UID: \"f2edb47a-2859-4dad-8b84-9cb5d736e27a\") " pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:34.616263 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.616242    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkslr\" (UniqueName: \"kubernetes.io/projected/f2edb47a-2859-4dad-8b84-9cb5d736e27a-kube-api-access-lkslr\") pod \"test-curl-7563-140481575207392\" (UID: \"f2edb47a-2859-4dad-8b84-9cb5d736e27a\") " pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:34.655232 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.655213    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:34.783395 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:34.783370    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481575207392"]
Jul 30 20:34:34.784675 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:34:34.784651    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2edb47a_2859_4dad_8b84_9cb5d736e27a.slice/crio-bf59d62bfbe282f5df00e744ea1c910ec1930037f52f0f3ce8838a034f8b8315 WatchSource:0}: Error finding container bf59d62bfbe282f5df00e744ea1c910ec1930037f52f0f3ce8838a034f8b8315: Status 404 returned error can't find the container with id bf59d62bfbe282f5df00e744ea1c910ec1930037f52f0f3ce8838a034f8b8315
Jul 30 20:34:35.025424 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.025392    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481575207392" event={"ID":"f2edb47a-2859-4dad-8b84-9cb5d736e27a","Type":"ContainerStarted","Data":"bf59d62bfbe282f5df00e744ea1c910ec1930037f52f0f3ce8838a034f8b8315"}
Jul 30 20:34:35.026544 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.026527    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:35.026637 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.026575    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d0d8ec6e630ad115519fa93d81aa0d21713756cebb20a3b9d3bd2ccf93b21dc"
Jul 30 20:34:35.037280 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:34:35.037253    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7563-140481575099824\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="d12e56c8-f7f9-4957-9904-cdebb936733b" pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:35.355439 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.355382    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42" podUID="512df96b-ebff-4234-81a1-0b93fc53b7b4" containerName="main" containerID="cri-o://c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5" gracePeriod=45
Jul 30 20:34:35.607050 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.606998    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:34:35.626396 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:34:35.626367    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7563-140481575099824\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="d12e56c8-f7f9-4957-9904-cdebb936733b" pod="opendatahub/test-curl-7563-140481575099824"
Jul 30 20:34:35.717123 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.717101    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-tmp-dir\") pod \"512df96b-ebff-4234-81a1-0b93fc53b7b4\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") "
Jul 30 20:34:35.717234 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.717127    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512df96b-ebff-4234-81a1-0b93fc53b7b4-tls-certs\") pod \"512df96b-ebff-4234-81a1-0b93fc53b7b4\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") "
Jul 30 20:34:35.717234 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.717146    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-dshm\") pod \"512df96b-ebff-4234-81a1-0b93fc53b7b4\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") "
Jul 30 20:34:35.717234 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.717186    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-model-cache\") pod \"512df96b-ebff-4234-81a1-0b93fc53b7b4\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") "
Jul 30 20:34:35.717234 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.717220    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq8bz\" (UniqueName: \"kubernetes.io/projected/512df96b-ebff-4234-81a1-0b93fc53b7b4-kube-api-access-gq8bz\") pod \"512df96b-ebff-4234-81a1-0b93fc53b7b4\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") "
Jul 30 20:34:35.717442 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.717244    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-home\") pod \"512df96b-ebff-4234-81a1-0b93fc53b7b4\" (UID: \"512df96b-ebff-4234-81a1-0b93fc53b7b4\") "
Jul 30 20:34:35.717442 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.717405    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "512df96b-ebff-4234-81a1-0b93fc53b7b4" (UID: "512df96b-ebff-4234-81a1-0b93fc53b7b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:34:35.717547 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.717502    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "512df96b-ebff-4234-81a1-0b93fc53b7b4" (UID: "512df96b-ebff-4234-81a1-0b93fc53b7b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:34:35.717639 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.717606    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-home" (OuterVolumeSpecName: "home") pod "512df96b-ebff-4234-81a1-0b93fc53b7b4" (UID: "512df96b-ebff-4234-81a1-0b93fc53b7b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:34:35.719206 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.719187    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-dshm" (OuterVolumeSpecName: "dshm") pod "512df96b-ebff-4234-81a1-0b93fc53b7b4" (UID: "512df96b-ebff-4234-81a1-0b93fc53b7b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:34:35.719284 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.719261    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/512df96b-ebff-4234-81a1-0b93fc53b7b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "512df96b-ebff-4234-81a1-0b93fc53b7b4" (UID: "512df96b-ebff-4234-81a1-0b93fc53b7b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:34:35.719284 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.719267    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/512df96b-ebff-4234-81a1-0b93fc53b7b4-kube-api-access-gq8bz" (OuterVolumeSpecName: "kube-api-access-gq8bz") pod "512df96b-ebff-4234-81a1-0b93fc53b7b4" (UID: "512df96b-ebff-4234-81a1-0b93fc53b7b4"). InnerVolumeSpecName "kube-api-access-gq8bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:34:35.817737 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.817702    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:35.817737 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.817737    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512df96b-ebff-4234-81a1-0b93fc53b7b4-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:35.817737 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.817746    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:35.817917 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.817754    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:35.817917 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.817763    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq8bz\" (UniqueName: \"kubernetes.io/projected/512df96b-ebff-4234-81a1-0b93fc53b7b4-kube-api-access-gq8bz\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:35.817917 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.817772    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512df96b-ebff-4234-81a1-0b93fc53b7b4-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:35.841327 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:35.841301    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d12e56c8-f7f9-4957-9904-cdebb936733b" path="/var/lib/kubelet/pods/d12e56c8-f7f9-4957-9904-cdebb936733b/volumes"
Jul 30 20:34:36.033776 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.033750    2561 generic.go:356] "Generic (PLEG): container finished" podID="512df96b-ebff-4234-81a1-0b93fc53b7b4" containerID="c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5" exitCode=0
Jul 30 20:34:36.033922 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.033787    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"
Jul 30 20:34:36.033922 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.033826    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42" event={"ID":"512df96b-ebff-4234-81a1-0b93fc53b7b4","Type":"ContainerDied","Data":"c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5"}
Jul 30 20:34:36.033922 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.033868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42" event={"ID":"512df96b-ebff-4234-81a1-0b93fc53b7b4","Type":"ContainerDied","Data":"e7be241ce0507aec0b1651f9795773941f9a9267694e235d69527c366af7d9be"}
Jul 30 20:34:36.033922 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.033905    2561 scope.go:117] "RemoveContainer" containerID="c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5"
Jul 30 20:34:36.035876 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.035840    2561 generic.go:356] "Generic (PLEG): container finished" podID="f2edb47a-2859-4dad-8b84-9cb5d736e27a" containerID="b7c2e797fe5089f8c5c19a1b478e22af0870b02b960199c3c5b26b871b430ba9" exitCode=0
Jul 30 20:34:36.036008 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.035932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481575207392" event={"ID":"f2edb47a-2859-4dad-8b84-9cb5d736e27a","Type":"ContainerDied","Data":"b7c2e797fe5089f8c5c19a1b478e22af0870b02b960199c3c5b26b871b430ba9"}
Jul 30 20:34:36.042775 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.042755    2561 scope.go:117] "RemoveContainer" containerID="c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5"
Jul 30 20:34:36.043030 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:34:36.043009    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5\": container with ID starting with c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5 not found: ID does not exist" containerID="c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5"
Jul 30 20:34:36.043125 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.043037    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5"} err="failed to get container status \"c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5\": rpc error: code = NotFound desc = could not find container \"c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5\": container with ID starting with c2b3a8c3d3b94a667a4573724cbff08d91124627033584abc9e3c7a30f5faca5 not found: ID does not exist"
Jul 30 20:34:36.064581 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.064559    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"]
Jul 30 20:34:36.069929 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.069911    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-474e8f/rate-test-model-474e8f-kserve-769f9f99c5-62j42"]
Jul 30 20:34:36.364607 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.364537    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w" podUID="1de46b03-1c95-4652-ace6-fc0e2c7e37f1" containerName="main" containerID="cri-o://6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536" gracePeriod=45
Jul 30 20:34:36.384939 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.384912    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w" podUID="1de46b03-1c95-4652-ace6-fc0e2c7e37f1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": dial tcp 10.132.0.69:8000: connect: connection refused"
Jul 30 20:34:36.614773 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.614718    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:34:36.724902 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.724860    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpwmg\" (UniqueName: \"kubernetes.io/projected/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-kube-api-access-dpwmg\") pod \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") "
Jul 30 20:34:36.725044 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.724911    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tmp-dir\") pod \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") "
Jul 30 20:34:36.725044 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.724933    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-home\") pod \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") "
Jul 30 20:34:36.725044 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.725001    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tls-certs\") pod \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") "
Jul 30 20:34:36.725185 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.725064    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-model-cache\") pod \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") "
Jul 30 20:34:36.725185 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.725093    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-dshm\") pod \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\" (UID: \"1de46b03-1c95-4652-ace6-fc0e2c7e37f1\") "
Jul 30 20:34:36.725185 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.725174    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1de46b03-1c95-4652-ace6-fc0e2c7e37f1" (UID: "1de46b03-1c95-4652-ace6-fc0e2c7e37f1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:34:36.725344 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.725224    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-home" (OuterVolumeSpecName: "home") pod "1de46b03-1c95-4652-ace6-fc0e2c7e37f1" (UID: "1de46b03-1c95-4652-ace6-fc0e2c7e37f1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:34:36.725344 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.725326    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-model-cache" (OuterVolumeSpecName: "model-cache") pod "1de46b03-1c95-4652-ace6-fc0e2c7e37f1" (UID: "1de46b03-1c95-4652-ace6-fc0e2c7e37f1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:34:36.725459 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.725441    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:36.725511 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.725466    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:36.725511 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.725481    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:36.727117 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.727088    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-kube-api-access-dpwmg" (OuterVolumeSpecName: "kube-api-access-dpwmg") pod "1de46b03-1c95-4652-ace6-fc0e2c7e37f1" (UID: "1de46b03-1c95-4652-ace6-fc0e2c7e37f1"). InnerVolumeSpecName "kube-api-access-dpwmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:34:36.727117 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.727110    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-dshm" (OuterVolumeSpecName: "dshm") pod "1de46b03-1c95-4652-ace6-fc0e2c7e37f1" (UID: "1de46b03-1c95-4652-ace6-fc0e2c7e37f1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:34:36.727260 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.727164    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1de46b03-1c95-4652-ace6-fc0e2c7e37f1" (UID: "1de46b03-1c95-4652-ace6-fc0e2c7e37f1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:34:36.826782 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.826759    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:36.826782 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.826779    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:36.826929 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:36.826788    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpwmg\" (UniqueName: \"kubernetes.io/projected/1de46b03-1c95-4652-ace6-fc0e2c7e37f1-kube-api-access-dpwmg\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:37.052452 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.052418    2561 generic.go:356] "Generic (PLEG): container finished" podID="1de46b03-1c95-4652-ace6-fc0e2c7e37f1" containerID="6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536" exitCode=0
Jul 30 20:34:37.052591 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.052483    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"
Jul 30 20:34:37.052591 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.052524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w" event={"ID":"1de46b03-1c95-4652-ace6-fc0e2c7e37f1","Type":"ContainerDied","Data":"6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536"}
Jul 30 20:34:37.052591 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.052581    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w" event={"ID":"1de46b03-1c95-4652-ace6-fc0e2c7e37f1","Type":"ContainerDied","Data":"e177245ef37c34c96900969a0bd74c70fb6c3ed3d7623872b0cb47666cbc4603"}
Jul 30 20:34:37.052710 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.052605    2561 scope.go:117] "RemoveContainer" containerID="6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536"
Jul 30 20:34:37.063872 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.063850    2561 scope.go:117] "RemoveContainer" containerID="6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536"
Jul 30 20:34:37.064165 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:34:37.064145    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536\": container with ID starting with 6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536 not found: ID does not exist" containerID="6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536"
Jul 30 20:34:37.064233 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.064171    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536"} err="failed to get container status \"6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536\": rpc error: code = NotFound desc = could not find container \"6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536\": container with ID starting with 6cf0b912f55573bbc09220a41e2cae8b3f15dc100325c431f5c63a7b50102536 not found: ID does not exist"
Jul 30 20:34:37.075778 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.075748    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"]
Jul 30 20:34:37.078870 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.078846    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-808798/rate-test-model-808798-kserve-79b8567d99-pvp4w"]
Jul 30 20:34:37.202404 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.202378    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:37.222321 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.222287    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7563-140481575207392_f2edb47a-2859-4dad-8b84-9cb5d736e27a/test-curl-7563-140481575207392/0.log"
Jul 30 20:34:37.243814 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.243794    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7563-140481575207392"]
Jul 30 20:34:37.247009 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.246990    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7563-140481575207392"]
Jul 30 20:34:37.331670 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.331617    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkslr\" (UniqueName: \"kubernetes.io/projected/f2edb47a-2859-4dad-8b84-9cb5d736e27a-kube-api-access-lkslr\") pod \"f2edb47a-2859-4dad-8b84-9cb5d736e27a\" (UID: \"f2edb47a-2859-4dad-8b84-9cb5d736e27a\") "
Jul 30 20:34:37.333580 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.333549    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2edb47a-2859-4dad-8b84-9cb5d736e27a-kube-api-access-lkslr" (OuterVolumeSpecName: "kube-api-access-lkslr") pod "f2edb47a-2859-4dad-8b84-9cb5d736e27a" (UID: "f2edb47a-2859-4dad-8b84-9cb5d736e27a"). InnerVolumeSpecName "kube-api-access-lkslr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:34:37.364267 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.364245    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7563-140481575207392"]
Jul 30 20:34:37.364598 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.364587    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de46b03-1c95-4652-ace6-fc0e2c7e37f1" containerName="main"
Jul 30 20:34:37.364640 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.364601    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de46b03-1c95-4652-ace6-fc0e2c7e37f1" containerName="main"
Jul 30 20:34:37.364640 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.364610    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="512df96b-ebff-4234-81a1-0b93fc53b7b4" containerName="main"
Jul 30 20:34:37.364640 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.364616    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="512df96b-ebff-4234-81a1-0b93fc53b7b4" containerName="main"
Jul 30 20:34:37.364640 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.364637    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2edb47a-2859-4dad-8b84-9cb5d736e27a" containerName="test-curl-7563-140481575207392"
Jul 30 20:34:37.364983 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.364642    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2edb47a-2859-4dad-8b84-9cb5d736e27a" containerName="test-curl-7563-140481575207392"
Jul 30 20:34:37.364983 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.364698    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de46b03-1c95-4652-ace6-fc0e2c7e37f1" containerName="main"
Jul 30 20:34:37.364983 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.364706    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="512df96b-ebff-4234-81a1-0b93fc53b7b4" containerName="main"
Jul 30 20:34:37.364983 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.364714    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2edb47a-2859-4dad-8b84-9cb5d736e27a" containerName="test-curl-7563-140481575207392"
Jul 30 20:34:37.367659 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.367644    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:37.375323 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.375304    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481575207392"]
Jul 30 20:34:37.432567 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.432542    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkslr\" (UniqueName: \"kubernetes.io/projected/f2edb47a-2859-4dad-8b84-9cb5d736e27a-kube-api-access-lkslr\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:37.533424 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.533401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m79wn\" (UniqueName: \"kubernetes.io/projected/de2165c5-027e-4231-9085-bf84fe158413-kube-api-access-m79wn\") pod \"test-curl-7563-140481575207392\" (UID: \"de2165c5-027e-4231-9085-bf84fe158413\") " pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:37.634156 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.634135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79wn\" (UniqueName: \"kubernetes.io/projected/de2165c5-027e-4231-9085-bf84fe158413-kube-api-access-m79wn\") pod \"test-curl-7563-140481575207392\" (UID: \"de2165c5-027e-4231-9085-bf84fe158413\") " pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:37.642633 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.642605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m79wn\" (UniqueName: \"kubernetes.io/projected/de2165c5-027e-4231-9085-bf84fe158413-kube-api-access-m79wn\") pod \"test-curl-7563-140481575207392\" (UID: \"de2165c5-027e-4231-9085-bf84fe158413\") " pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:37.677011 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.676991    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:37.807397 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.807370    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7563-140481575207392"]
Jul 30 20:34:37.808873 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:34:37.808848    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde2165c5_027e_4231_9085_bf84fe158413.slice/crio-ac1ba778d157d4aa389ff9a46436dd5fb0047cbb7402f8e93adfa092af097296 WatchSource:0}: Error finding container ac1ba778d157d4aa389ff9a46436dd5fb0047cbb7402f8e93adfa092af097296: Status 404 returned error can't find the container with id ac1ba778d157d4aa389ff9a46436dd5fb0047cbb7402f8e93adfa092af097296
Jul 30 20:34:37.841681 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.841657    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1de46b03-1c95-4652-ace6-fc0e2c7e37f1" path="/var/lib/kubelet/pods/1de46b03-1c95-4652-ace6-fc0e2c7e37f1/volumes"
Jul 30 20:34:37.842084 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.842069    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="512df96b-ebff-4234-81a1-0b93fc53b7b4" path="/var/lib/kubelet/pods/512df96b-ebff-4234-81a1-0b93fc53b7b4/volumes"
Jul 30 20:34:37.842379 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:37.842367    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2edb47a-2859-4dad-8b84-9cb5d736e27a" path="/var/lib/kubelet/pods/f2edb47a-2859-4dad-8b84-9cb5d736e27a/volumes"
Jul 30 20:34:38.059367 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:38.059304    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481575207392" event={"ID":"de2165c5-027e-4231-9085-bf84fe158413","Type":"ContainerStarted","Data":"ac1ba778d157d4aa389ff9a46436dd5fb0047cbb7402f8e93adfa092af097296"}
Jul 30 20:34:38.060628 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:38.060607    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:38.060749 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:38.060626    2561 scope.go:117] "RemoveContainer" containerID="b7c2e797fe5089f8c5c19a1b478e22af0870b02b960199c3c5b26b871b430ba9"
Jul 30 20:34:39.068495 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:39.068457    2561 generic.go:356] "Generic (PLEG): container finished" podID="de2165c5-027e-4231-9085-bf84fe158413" containerID="3f652da4372c8d835641719c21dd231b9dff5f2e79ed78a41b8da08d5c431ec2" exitCode=0
Jul 30 20:34:39.068934 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:39.068498    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7563-140481575207392" event={"ID":"de2165c5-027e-4231-9085-bf84fe158413","Type":"ContainerDied","Data":"3f652da4372c8d835641719c21dd231b9dff5f2e79ed78a41b8da08d5c431ec2"}
Jul 30 20:34:40.212299 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:40.212277    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:40.230398 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:40.230376    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7563-140481575207392_de2165c5-027e-4231-9085-bf84fe158413/test-curl-7563-140481575207392/0.log"
Jul 30 20:34:40.250699 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:40.250677    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7563-140481575207392"]
Jul 30 20:34:40.254335 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:40.254310    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7563-140481575207392"]
Jul 30 20:34:40.358670 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:40.358595    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m79wn\" (UniqueName: \"kubernetes.io/projected/de2165c5-027e-4231-9085-bf84fe158413-kube-api-access-m79wn\") pod \"de2165c5-027e-4231-9085-bf84fe158413\" (UID: \"de2165c5-027e-4231-9085-bf84fe158413\") "
Jul 30 20:34:40.360532 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:40.360512    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de2165c5-027e-4231-9085-bf84fe158413-kube-api-access-m79wn" (OuterVolumeSpecName: "kube-api-access-m79wn") pod "de2165c5-027e-4231-9085-bf84fe158413" (UID: "de2165c5-027e-4231-9085-bf84fe158413"). InnerVolumeSpecName "kube-api-access-m79wn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:34:40.460207 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:40.460187    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m79wn\" (UniqueName: \"kubernetes.io/projected/de2165c5-027e-4231-9085-bf84fe158413-kube-api-access-m79wn\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:34:40.755221 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:40.755197    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:41.060687 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:41.060579    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:41.081276 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:41.081250    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:41.081276 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:41.081269    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac1ba778d157d4aa389ff9a46436dd5fb0047cbb7402f8e93adfa092af097296"
Jul 30 20:34:41.091265 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:34:41.091238    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7563-140481575207392\" is forbidden: User \"system:node:ip-10-0-135-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-254.ec2.internal' and this object" podUID="de2165c5-027e-4231-9085-bf84fe158413" pod="opendatahub/test-curl-7563-140481575207392"
Jul 30 20:34:41.683949 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:41.683916    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:41.840495 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:41.840457    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de2165c5-027e-4231-9085-bf84fe158413" path="/var/lib/kubelet/pods/de2165c5-027e-4231-9085-bf84fe158413/volumes"
Jul 30 20:34:46.720214 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:46.720179    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:46.955645 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:46.955613    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:47.935722 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:47.935693    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:48.082523 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.082498    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:48.441329 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.441293    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:48.514002 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.513963    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:48.545062 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.545036    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"]
Jul 30 20:34:48.545392 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.545379    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2165c5-027e-4231-9085-bf84fe158413" containerName="test-curl-7563-140481575207392"
Jul 30 20:34:48.545441 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.545393    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2165c5-027e-4231-9085-bf84fe158413" containerName="test-curl-7563-140481575207392"
Jul 30 20:34:48.545473 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.545459    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="de2165c5-027e-4231-9085-bf84fe158413" containerName="test-curl-7563-140481575207392"
Jul 30 20:34:48.548287 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.548270    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:34:48.551804 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.551786    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-7f2993-dockercfg-r64nq\""
Jul 30 20:34:48.551929 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.551839    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-7f2993\""
Jul 30 20:34:48.562358 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.562328    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"]
Jul 30 20:34:48.622828 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.622805    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxkks\" (UniqueName: \"kubernetes.io/projected/96f7952c-42ba-4b50-bd97-ff896be6ebf9-kube-api-access-jxkks\") pod \"payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56\" (UID: \"96f7952c-42ba-4b50-bd97-ff896be6ebf9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:34:48.622968 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.622844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f7952c-42ba-4b50-bd97-ff896be6ebf9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56\" (UID: \"96f7952c-42ba-4b50-bd97-ff896be6ebf9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:34:48.723843 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.723774    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxkks\" (UniqueName: \"kubernetes.io/projected/96f7952c-42ba-4b50-bd97-ff896be6ebf9-kube-api-access-jxkks\") pod \"payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56\" (UID: \"96f7952c-42ba-4b50-bd97-ff896be6ebf9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:34:48.723843 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.723818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f7952c-42ba-4b50-bd97-ff896be6ebf9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56\" (UID: \"96f7952c-42ba-4b50-bd97-ff896be6ebf9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:34:48.724501 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.724482    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f7952c-42ba-4b50-bd97-ff896be6ebf9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56\" (UID: \"96f7952c-42ba-4b50-bd97-ff896be6ebf9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:34:48.731843 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.731814    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxkks\" (UniqueName: \"kubernetes.io/projected/96f7952c-42ba-4b50-bd97-ff896be6ebf9-kube-api-access-jxkks\") pod \"payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56\" (UID: \"96f7952c-42ba-4b50-bd97-ff896be6ebf9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:34:48.863105 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.863078    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:34:48.998894 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:48.998857    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"]
Jul 30 20:34:49.000778 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:34:49.000740    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f7952c_42ba_4b50_bd97_ff896be6ebf9.slice/crio-9cbf4938801a0d4573d2581a98c62c511406c58f28bb668094eed4e4254b810b WatchSource:0}: Error finding container 9cbf4938801a0d4573d2581a98c62c511406c58f28bb668094eed4e4254b810b: Status 404 returned error can't find the container with id 9cbf4938801a0d4573d2581a98c62c511406c58f28bb668094eed4e4254b810b
Jul 30 20:34:49.126818 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:49.126790    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56" event={"ID":"96f7952c-42ba-4b50-bd97-ff896be6ebf9","Type":"ContainerStarted","Data":"9a90c19aab5a54302bc78c1dbf37b308c39589fd4f2157ceac136059ede330af"}
Jul 30 20:34:49.126952 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:49.126848    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56" event={"ID":"96f7952c-42ba-4b50-bd97-ff896be6ebf9","Type":"ContainerStarted","Data":"9cbf4938801a0d4573d2581a98c62c511406c58f28bb668094eed4e4254b810b"}
Jul 30 20:34:49.126952 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:49.126878    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:34:49.144492 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:34:49.144449    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56" podStartSLOduration=1.1444344 podStartE2EDuration="1.1444344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:34:49.142445811 +0000 UTC m=+3331.782860891" watchObservedRunningTime="2026-07-30 20:34:49.1444344 +0000 UTC m=+3331.784849529"
Jul 30 20:35:00.135054 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:00.135018    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:35:11.716225 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:11.716186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:12.428197 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:12.428161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:12.759282 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:12.759188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:13.036433 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:13.036339    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:15.862739 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:15.862698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:15.963300 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:15.963268    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:17.132390 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.132353    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"]
Jul 30 20:35:17.136064 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.136046    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.143874 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.143856    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-9d3c06-serving-cert\""
Jul 30 20:35:17.165217 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.165192    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"]
Jul 30 20:35:17.257636 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.257608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.257760 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.257653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.257813 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.257758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgnqd\" (UniqueName: \"kubernetes.io/projected/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-kube-api-access-zgnqd\") pod \"maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.263042 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.263016    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:17.358759 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.358734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgnqd\" (UniqueName: \"kubernetes.io/projected/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-kube-api-access-zgnqd\") pod \"maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.358861 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.358772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.358861 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.358798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.358989 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:35:17.358904    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-serving-cert: secret "maas-api-e2e-ipp-b-9d3c06-serving-cert" not found
Jul 30 20:35:17.358989 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:35:17.358979    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-maas-api-tls podName:d4815e43-bab3-4f96-90b3-1c8737fc4cd8 nodeName:}" failed. No retries permitted until 2026-07-30 20:35:17.858960975 +0000 UTC m=+3360.499376046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-maas-api-tls") pod "maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s" (UID: "d4815e43-bab3-4f96-90b3-1c8737fc4cd8") : secret "maas-api-e2e-ipp-b-9d3c06-serving-cert" not found
Jul 30 20:35:17.359401 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.359384    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.375660 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.375636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgnqd\" (UniqueName: \"kubernetes.io/projected/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-kube-api-access-zgnqd\") pod \"maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.789603 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.789572    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:17.862807 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.862780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.865071 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.865049    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:17.889004 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.888976    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:17.965659 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.965631    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"]
Jul 30 20:35:17.969116 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.969100    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:35:17.972386 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.972368    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-9d3c06-dockercfg-xd542\""
Jul 30 20:35:17.972951 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.972936    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-9d3c06\""
Jul 30 20:35:17.981323 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:17.981287    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"]
Jul 30 20:35:18.046271 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.046214    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:18.064310 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.064285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e307611-c35d-4650-8ef2-dee8853179da-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s\" (UID: \"1e307611-c35d-4650-8ef2-dee8853179da\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:35:18.064443 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.064330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7shn\" (UniqueName: \"kubernetes.io/projected/1e307611-c35d-4650-8ef2-dee8853179da-kube-api-access-n7shn\") pod \"payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s\" (UID: \"1e307611-c35d-4650-8ef2-dee8853179da\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:35:18.165437 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.165399    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e307611-c35d-4650-8ef2-dee8853179da-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s\" (UID: \"1e307611-c35d-4650-8ef2-dee8853179da\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:35:18.165843 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.165445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7shn\" (UniqueName: \"kubernetes.io/projected/1e307611-c35d-4650-8ef2-dee8853179da-kube-api-access-n7shn\") pod \"payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s\" (UID: \"1e307611-c35d-4650-8ef2-dee8853179da\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:35:18.166190 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.166170    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e307611-c35d-4650-8ef2-dee8853179da-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s\" (UID: \"1e307611-c35d-4650-8ef2-dee8853179da\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:35:18.177600 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.177576    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7shn\" (UniqueName: \"kubernetes.io/projected/1e307611-c35d-4650-8ef2-dee8853179da-kube-api-access-n7shn\") pod \"payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s\" (UID: \"1e307611-c35d-4650-8ef2-dee8853179da\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:35:18.183874 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.183850    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"]
Jul 30 20:35:18.184530 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:35:18.184510    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4815e43_bab3_4f96_90b3_1c8737fc4cd8.slice/crio-6f90fb6345e9d3eaed7b676d07c0eee198504133b4147fade5ae1b0a5028266d WatchSource:0}: Error finding container 6f90fb6345e9d3eaed7b676d07c0eee198504133b4147fade5ae1b0a5028266d: Status 404 returned error can't find the container with id 6f90fb6345e9d3eaed7b676d07c0eee198504133b4147fade5ae1b0a5028266d
Jul 30 20:35:18.279960 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.279937    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:35:18.319285 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.319256    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s" event={"ID":"d4815e43-bab3-4f96-90b3-1c8737fc4cd8","Type":"ContainerStarted","Data":"6f90fb6345e9d3eaed7b676d07c0eee198504133b4147fade5ae1b0a5028266d"}
Jul 30 20:35:18.415689 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:18.415652    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"]
Jul 30 20:35:18.416059 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:35:18.416033    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e307611_c35d_4650_8ef2_dee8853179da.slice/crio-842fc29b7ec913dae6eb0a5c1ccdc961da6777b04a3bfafe9c27f7a4248f922e WatchSource:0}: Error finding container 842fc29b7ec913dae6eb0a5c1ccdc961da6777b04a3bfafe9c27f7a4248f922e: Status 404 returned error can't find the container with id 842fc29b7ec913dae6eb0a5c1ccdc961da6777b04a3bfafe9c27f7a4248f922e
Jul 30 20:35:19.326243 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:19.326203    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s" event={"ID":"d4815e43-bab3-4f96-90b3-1c8737fc4cd8","Type":"ContainerStarted","Data":"660e114ab47d7ce559696d6751750958cbdda8c73f48e4d9595e0feee3666db0"}
Jul 30 20:35:19.326702 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:19.326384    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:19.327907 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:19.327866    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s" event={"ID":"1e307611-c35d-4650-8ef2-dee8853179da","Type":"ContainerStarted","Data":"ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe"}
Jul 30 20:35:19.328006 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:19.327930    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s" event={"ID":"1e307611-c35d-4650-8ef2-dee8853179da","Type":"ContainerStarted","Data":"842fc29b7ec913dae6eb0a5c1ccdc961da6777b04a3bfafe9c27f7a4248f922e"}
Jul 30 20:35:19.328006 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:19.328000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:35:19.360088 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:19.360046    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s" podStartSLOduration=2.083495417 podStartE2EDuration="2.360032666s" totalImagesPullingTime="276.537249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:35:19.359131678 +0000 UTC m=+3361.999546760" watchObservedRunningTime="2026-07-30 20:35:19.360032666 +0000 UTC m=+3362.000447758"
Jul 30 20:35:19.402564 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:19.402527    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s" podStartSLOduration=2.402511289 podStartE2EDuration="2.402511289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:35:19.401838633 +0000 UTC m=+3362.042253713" watchObservedRunningTime="2026-07-30 20:35:19.402511289 +0000 UTC m=+3362.042926373"
Jul 30 20:35:25.339138 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:25.339105    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:35:30.335980 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:30.335950    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:35:40.811308 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:40.811260    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:51.290179 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.290136    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"]
Jul 30 20:35:51.294144 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.294126    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.297216 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.297190    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-7f2993\"/\"openshift-service-ca.crt\""
Jul 30 20:35:51.298606 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.298581    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-7f2993\"/\"ipp-route-7f2993-kserve-self-signed-certs\""
Jul 30 20:35:51.298740 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.298626    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-7f2993\"/\"kube-root-ca.crt\""
Jul 30 20:35:51.298740 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.298637    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-7f2993\"/\"default-dockercfg-tbfs6\""
Jul 30 20:35:51.303900 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.303865    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"]
Jul 30 20:35:51.326126 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.326084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:51.426591 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.426571    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-model-cache\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.426695 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.426603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tmp-dir\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.426695 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.426629    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-dshm\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.426695 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.426648    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-home\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.426831 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.426725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tls-certs\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.426831 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.426766    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl7b6\" (UniqueName: \"kubernetes.io/projected/4ef2af0b-c7b8-41d2-9702-b2501373eb93-kube-api-access-gl7b6\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.527294 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.527273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tls-certs\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.527450 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.527311    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl7b6\" (UniqueName: \"kubernetes.io/projected/4ef2af0b-c7b8-41d2-9702-b2501373eb93-kube-api-access-gl7b6\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.527450 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.527336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-model-cache\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.527450 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.527362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tmp-dir\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.527450 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.527403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-dshm\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.527450 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.527426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-home\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.527820 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.527797    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-model-cache\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.527859 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.527818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tmp-dir\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.527924 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.527873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-home\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.529898 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.529860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-dshm\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.529997 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.529950    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tls-certs\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.535535 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.535514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl7b6\" (UniqueName: \"kubernetes.io/projected/4ef2af0b-c7b8-41d2-9702-b2501373eb93-kube-api-access-gl7b6\") pod \"ipp-route-7f2993-kserve-76894fd7ff-djj57\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") " pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.604079 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.604018    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:35:51.740029 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:51.740000    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"]
Jul 30 20:35:51.740941 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:35:51.740879    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ef2af0b_c7b8_41d2_9702_b2501373eb93.slice/crio-aba65d5cc7958274f7f79196afc6f97ad3f9709089bbef2d91dde9459bdbe0a1 WatchSource:0}: Error finding container aba65d5cc7958274f7f79196afc6f97ad3f9709089bbef2d91dde9459bdbe0a1: Status 404 returned error can't find the container with id aba65d5cc7958274f7f79196afc6f97ad3f9709089bbef2d91dde9459bdbe0a1
Jul 30 20:35:52.524356 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:52.524324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57" event={"ID":"4ef2af0b-c7b8-41d2-9702-b2501373eb93","Type":"ContainerStarted","Data":"8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b"}
Jul 30 20:35:52.524811 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:52.524365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57" event={"ID":"4ef2af0b-c7b8-41d2-9702-b2501373eb93","Type":"ContainerStarted","Data":"aba65d5cc7958274f7f79196afc6f97ad3f9709089bbef2d91dde9459bdbe0a1"}
Jul 30 20:35:52.542288 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:35:52.542243    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57" podStartSLOduration=1.542227418 podStartE2EDuration="1.542227418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:35:52.541279286 +0000 UTC m=+3395.181694366" watchObservedRunningTime="2026-07-30 20:35:52.542227418 +0000 UTC m=+3395.182642511"
Jul 30 20:36:01.604988 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:01.604937    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:36:01.604988 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:01.604997    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:36:01.618485 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:01.618458    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:36:02.600787 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:02.600756    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:36:38.073750 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:38.073668    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56_96f7952c-42ba-4b50-bd97-ff896be6ebf9/payload-processing/0.log"
Jul 30 20:36:38.658409 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:38.658374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:39.160228 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:39.160191    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:39.280991 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:39.280960    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:42.222004 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:42.221973    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:42.321664 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:42.321633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:43.352927 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:43.352868    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:43.512920 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:43.512860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:44.010832 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:44.010804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:44.109086 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:36:44.109049    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:07.222476 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:07.222442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:14.037279 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:14.037250    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:14.108541 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:14.108512    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:14.208118 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:14.208083    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:14.261001 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:14.260976    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:14.590063 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:14.590025    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:20.344442 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:20.344409    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:20.445418 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:20.445383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:20.606203 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:20.606124    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:20.861858 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:20.861791    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:39.951388 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:39.951353    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:39.983136 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:39.983106    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"]
Jul 30 20:37:39.983386 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:39.983358    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56" podUID="96f7952c-42ba-4b50-bd97-ff896be6ebf9" containerName="payload-processing" containerID="cri-o://9a90c19aab5a54302bc78c1dbf37b308c39589fd4f2157ceac136059ede330af" gracePeriod=30
Jul 30 20:37:40.023433 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.023405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:40.123921 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.123879    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:40.134005 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.133972    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56" podUID="96f7952c-42ba-4b50-bd97-ff896be6ebf9" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.76:9004: connect: connection refused"
Jul 30 20:37:40.159578 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.159546    2561 generic.go:356] "Generic (PLEG): container finished" podID="96f7952c-42ba-4b50-bd97-ff896be6ebf9" containerID="9a90c19aab5a54302bc78c1dbf37b308c39589fd4f2157ceac136059ede330af" exitCode=0
Jul 30 20:37:40.159701 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.159629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56" event={"ID":"96f7952c-42ba-4b50-bd97-ff896be6ebf9","Type":"ContainerDied","Data":"9a90c19aab5a54302bc78c1dbf37b308c39589fd4f2157ceac136059ede330af"}
Jul 30 20:37:40.223716 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.223684    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:40.231928 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.231908    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:37:40.370869 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.370807    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f7952c-42ba-4b50-bd97-ff896be6ebf9-plugins-config-volume\") pod \"96f7952c-42ba-4b50-bd97-ff896be6ebf9\" (UID: \"96f7952c-42ba-4b50-bd97-ff896be6ebf9\") "
Jul 30 20:37:40.370869 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.370848    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxkks\" (UniqueName: \"kubernetes.io/projected/96f7952c-42ba-4b50-bd97-ff896be6ebf9-kube-api-access-jxkks\") pod \"96f7952c-42ba-4b50-bd97-ff896be6ebf9\" (UID: \"96f7952c-42ba-4b50-bd97-ff896be6ebf9\") "
Jul 30 20:37:40.371186 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.371162    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f7952c-42ba-4b50-bd97-ff896be6ebf9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96f7952c-42ba-4b50-bd97-ff896be6ebf9" (UID: "96f7952c-42ba-4b50-bd97-ff896be6ebf9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:37:40.372849 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.372829    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96f7952c-42ba-4b50-bd97-ff896be6ebf9-kube-api-access-jxkks" (OuterVolumeSpecName: "kube-api-access-jxkks") pod "96f7952c-42ba-4b50-bd97-ff896be6ebf9" (UID: "96f7952c-42ba-4b50-bd97-ff896be6ebf9"). InnerVolumeSpecName "kube-api-access-jxkks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:37:40.471508 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.471452    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f7952c-42ba-4b50-bd97-ff896be6ebf9-plugins-config-volume\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:37:40.471508 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.471475    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxkks\" (UniqueName: \"kubernetes.io/projected/96f7952c-42ba-4b50-bd97-ff896be6ebf9-kube-api-access-jxkks\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:37:40.574138 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:40.574112    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:41.166364 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:41.166332    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56" event={"ID":"96f7952c-42ba-4b50-bd97-ff896be6ebf9","Type":"ContainerDied","Data":"9cbf4938801a0d4573d2581a98c62c511406c58f28bb668094eed4e4254b810b"}
Jul 30 20:37:41.166764 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:41.166387    2561 scope.go:117] "RemoveContainer" containerID="9a90c19aab5a54302bc78c1dbf37b308c39589fd4f2157ceac136059ede330af"
Jul 30 20:37:41.166764 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:41.166340    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"
Jul 30 20:37:41.192565 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:41.192535    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"]
Jul 30 20:37:41.197305 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:41.197284    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7f2993-6d8f969bdb-pqt56"]
Jul 30 20:37:41.840715 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:41.840680    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96f7952c-42ba-4b50-bd97-ff896be6ebf9" path="/var/lib/kubelet/pods/96f7952c-42ba-4b50-bd97-ff896be6ebf9/volumes"
Jul 30 20:37:45.508105 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:45.508065    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"]
Jul 30 20:37:45.553060 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:37:45.553030    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:00.527277 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.527223    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57" podUID="4ef2af0b-c7b8-41d2-9702-b2501373eb93" containerName="main" containerID="cri-o://8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b" gracePeriod=45
Jul 30 20:38:00.781657 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.781606    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:38:00.935113 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935084    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-dshm\") pod \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") "
Jul 30 20:38:00.935272 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935156    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-home\") pod \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") "
Jul 30 20:38:00.935272 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935176    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-model-cache\") pod \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") "
Jul 30 20:38:00.935272 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935208    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tls-certs\") pod \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") "
Jul 30 20:38:00.935272 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935242    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tmp-dir\") pod \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") "
Jul 30 20:38:00.935272 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935271    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl7b6\" (UniqueName: \"kubernetes.io/projected/4ef2af0b-c7b8-41d2-9702-b2501373eb93-kube-api-access-gl7b6\") pod \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\" (UID: \"4ef2af0b-c7b8-41d2-9702-b2501373eb93\") "
Jul 30 20:38:00.935526 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935435    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-model-cache" (OuterVolumeSpecName: "model-cache") pod "4ef2af0b-c7b8-41d2-9702-b2501373eb93" (UID: "4ef2af0b-c7b8-41d2-9702-b2501373eb93"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:38:00.935526 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935452    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-home" (OuterVolumeSpecName: "home") pod "4ef2af0b-c7b8-41d2-9702-b2501373eb93" (UID: "4ef2af0b-c7b8-41d2-9702-b2501373eb93"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:38:00.935639 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935536    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4ef2af0b-c7b8-41d2-9702-b2501373eb93" (UID: "4ef2af0b-c7b8-41d2-9702-b2501373eb93"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:38:00.935696 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935641    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-home\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:00.935696 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935659    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-model-cache\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:00.935696 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.935673    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tmp-dir\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:00.937577 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.937550    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4ef2af0b-c7b8-41d2-9702-b2501373eb93" (UID: "4ef2af0b-c7b8-41d2-9702-b2501373eb93"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:38:00.937693 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.937599    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-dshm" (OuterVolumeSpecName: "dshm") pod "4ef2af0b-c7b8-41d2-9702-b2501373eb93" (UID: "4ef2af0b-c7b8-41d2-9702-b2501373eb93"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:38:00.937693 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:00.937642    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef2af0b-c7b8-41d2-9702-b2501373eb93-kube-api-access-gl7b6" (OuterVolumeSpecName: "kube-api-access-gl7b6") pod "4ef2af0b-c7b8-41d2-9702-b2501373eb93" (UID: "4ef2af0b-c7b8-41d2-9702-b2501373eb93"). InnerVolumeSpecName "kube-api-access-gl7b6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:38:01.036812 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.036733    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef2af0b-c7b8-41d2-9702-b2501373eb93-tls-certs\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:01.036812 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.036762    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl7b6\" (UniqueName: \"kubernetes.io/projected/4ef2af0b-c7b8-41d2-9702-b2501373eb93-kube-api-access-gl7b6\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:01.036812 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.036771    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ef2af0b-c7b8-41d2-9702-b2501373eb93-dshm\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:01.283161 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.283127    2561 generic.go:356] "Generic (PLEG): container finished" podID="4ef2af0b-c7b8-41d2-9702-b2501373eb93" containerID="8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b" exitCode=0
Jul 30 20:38:01.283326 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.283176    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"
Jul 30 20:38:01.283326 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.283210    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57" event={"ID":"4ef2af0b-c7b8-41d2-9702-b2501373eb93","Type":"ContainerDied","Data":"8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b"}
Jul 30 20:38:01.283326 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.283251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57" event={"ID":"4ef2af0b-c7b8-41d2-9702-b2501373eb93","Type":"ContainerDied","Data":"aba65d5cc7958274f7f79196afc6f97ad3f9709089bbef2d91dde9459bdbe0a1"}
Jul 30 20:38:01.283326 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.283269    2561 scope.go:117] "RemoveContainer" containerID="8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b"
Jul 30 20:38:01.292904 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.292869    2561 scope.go:117] "RemoveContainer" containerID="8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b"
Jul 30 20:38:01.293166 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:38:01.293146    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b\": container with ID starting with 8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b not found: ID does not exist" containerID="8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b"
Jul 30 20:38:01.293232 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.293175    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b"} err="failed to get container status \"8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b\": rpc error: code = NotFound desc = could not find container \"8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b\": container with ID starting with 8f61f505491bcfe7aa862cf7470a41f0c38e298bdc49974919ffb80de2dc281b not found: ID does not exist"
Jul 30 20:38:01.304669 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.304645    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"]
Jul 30 20:38:01.308450 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.308431    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-7f2993/ipp-route-7f2993-kserve-76894fd7ff-djj57"]
Jul 30 20:38:01.841351 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:01.841301    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ef2af0b-c7b8-41d2-9702-b2501373eb93" path="/var/lib/kubelet/pods/4ef2af0b-c7b8-41d2-9702-b2501373eb93/volumes"
Jul 30 20:38:21.859516 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:21.859475    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:22.510137 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:22.510096    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:28.259664 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:28.259627    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:34.395177 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:34.395135    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:42.403297 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:42.403258    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:42.469861 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:42.469819    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:42.691954 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:42.691856    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:42.909461 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:42.909425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:53.457918 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.457856    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"]
Jul 30 20:38:53.458510 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.458117    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s" podUID="d4815e43-bab3-4f96-90b3-1c8737fc4cd8" containerName="maas-api" containerID="cri-o://660e114ab47d7ce559696d6751750958cbdda8c73f48e4d9595e0feee3666db0" gracePeriod=30
Jul 30 20:38:53.489907 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.489833    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:53.527431 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.527402    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"]
Jul 30 20:38:53.527661 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.527633    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s" podUID="1e307611-c35d-4650-8ef2-dee8853179da" containerName="payload-pre-processing" containerID="cri-o://ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe" gracePeriod=30
Jul 30 20:38:53.587669 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.587636    2561 generic.go:356] "Generic (PLEG): container finished" podID="d4815e43-bab3-4f96-90b3-1c8737fc4cd8" containerID="660e114ab47d7ce559696d6751750958cbdda8c73f48e4d9595e0feee3666db0" exitCode=0
Jul 30 20:38:53.587776 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.587711    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s" event={"ID":"d4815e43-bab3-4f96-90b3-1c8737fc4cd8","Type":"ContainerDied","Data":"660e114ab47d7ce559696d6751750958cbdda8c73f48e4d9595e0feee3666db0"}
Jul 30 20:38:53.590753 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.590727    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:53.666974 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.666944    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:53.728779 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.728746    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:53.776547 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.776521    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:38:53.805584 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.805561    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:38:53.825325 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.825300    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e307611-c35d-4650-8ef2-dee8853179da-plugins-config-volume\") pod \"1e307611-c35d-4650-8ef2-dee8853179da\" (UID: \"1e307611-c35d-4650-8ef2-dee8853179da\") "
Jul 30 20:38:53.825460 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.825361    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-openshift-service-ca\") pod \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") "
Jul 30 20:38:53.825460 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.825427    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7shn\" (UniqueName: \"kubernetes.io/projected/1e307611-c35d-4650-8ef2-dee8853179da-kube-api-access-n7shn\") pod \"1e307611-c35d-4650-8ef2-dee8853179da\" (UID: \"1e307611-c35d-4650-8ef2-dee8853179da\") "
Jul 30 20:38:53.825571 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.825482    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgnqd\" (UniqueName: \"kubernetes.io/projected/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-kube-api-access-zgnqd\") pod \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") "
Jul 30 20:38:53.825571 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.825511    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-maas-api-tls\") pod \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\" (UID: \"d4815e43-bab3-4f96-90b3-1c8737fc4cd8\") "
Jul 30 20:38:53.825774 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.825733    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e307611-c35d-4650-8ef2-dee8853179da-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e307611-c35d-4650-8ef2-dee8853179da" (UID: "1e307611-c35d-4650-8ef2-dee8853179da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:38:53.825774 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.825756    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d4815e43-bab3-4f96-90b3-1c8737fc4cd8" (UID: "d4815e43-bab3-4f96-90b3-1c8737fc4cd8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:38:53.828069 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.828013    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d4815e43-bab3-4f96-90b3-1c8737fc4cd8" (UID: "d4815e43-bab3-4f96-90b3-1c8737fc4cd8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:38:53.828184 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.828131    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-kube-api-access-zgnqd" (OuterVolumeSpecName: "kube-api-access-zgnqd") pod "d4815e43-bab3-4f96-90b3-1c8737fc4cd8" (UID: "d4815e43-bab3-4f96-90b3-1c8737fc4cd8"). InnerVolumeSpecName "kube-api-access-zgnqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:38:53.828184 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.828166    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e307611-c35d-4650-8ef2-dee8853179da-kube-api-access-n7shn" (OuterVolumeSpecName: "kube-api-access-n7shn") pod "1e307611-c35d-4650-8ef2-dee8853179da" (UID: "1e307611-c35d-4650-8ef2-dee8853179da"). InnerVolumeSpecName "kube-api-access-n7shn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:38:53.927143 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.927116    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7shn\" (UniqueName: \"kubernetes.io/projected/1e307611-c35d-4650-8ef2-dee8853179da-kube-api-access-n7shn\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:53.927143 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.927137    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgnqd\" (UniqueName: \"kubernetes.io/projected/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-kube-api-access-zgnqd\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:53.927143 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.927146    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-maas-api-tls\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:53.927365 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.927156    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e307611-c35d-4650-8ef2-dee8853179da-plugins-config-volume\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:53.927365 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:53.927166    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4815e43-bab3-4f96-90b3-1c8737fc4cd8-openshift-service-ca\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:38:54.052278 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.052210    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:54.595385 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.595354    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"
Jul 30 20:38:54.595794 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.595391    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s" event={"ID":"d4815e43-bab3-4f96-90b3-1c8737fc4cd8","Type":"ContainerDied","Data":"6f90fb6345e9d3eaed7b676d07c0eee198504133b4147fade5ae1b0a5028266d"}
Jul 30 20:38:54.595794 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.595469    2561 scope.go:117] "RemoveContainer" containerID="660e114ab47d7ce559696d6751750958cbdda8c73f48e4d9595e0feee3666db0"
Jul 30 20:38:54.596910 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.596792    2561 generic.go:356] "Generic (PLEG): container finished" podID="1e307611-c35d-4650-8ef2-dee8853179da" containerID="ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe" exitCode=0
Jul 30 20:38:54.596910 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.596834    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"
Jul 30 20:38:54.596910 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.596841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s" event={"ID":"1e307611-c35d-4650-8ef2-dee8853179da","Type":"ContainerDied","Data":"ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe"}
Jul 30 20:38:54.596910 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.596872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s" event={"ID":"1e307611-c35d-4650-8ef2-dee8853179da","Type":"ContainerDied","Data":"842fc29b7ec913dae6eb0a5c1ccdc961da6777b04a3bfafe9c27f7a4248f922e"}
Jul 30 20:38:54.604442 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.604426    2561 scope.go:117] "RemoveContainer" containerID="ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe"
Jul 30 20:38:54.612538 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.612520    2561 scope.go:117] "RemoveContainer" containerID="ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe"
Jul 30 20:38:54.612781 ip-10-0-135-254 kubenswrapper[2561]: E0730 20:38:54.612764    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe\": container with ID starting with ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe not found: ID does not exist" containerID="ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe"
Jul 30 20:38:54.612844 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.612788    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe"} err="failed to get container status \"ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe\": rpc error: code = NotFound desc = could not find container \"ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe\": container with ID starting with ca6da073d0c7de83c9c14d28216da042ef3ac233112eaff24e7826edc3de0bfe not found: ID does not exist"
Jul 30 20:38:54.620454 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.620433    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"]
Jul 30 20:38:54.624919 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.624900    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9d3c06-58476ccc68-4c89s"]
Jul 30 20:38:54.634837 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.634816    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"]
Jul 30 20:38:54.638109 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:54.638088    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9d3c06-69744d4556-p5n4s"]
Jul 30 20:38:55.842426 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:55.842388    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e307611-c35d-4650-8ef2-dee8853179da" path="/var/lib/kubelet/pods/1e307611-c35d-4650-8ef2-dee8853179da/volumes"
Jul 30 20:38:55.843545 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:55.843517    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4815e43-bab3-4f96-90b3-1c8737fc4cd8" path="/var/lib/kubelet/pods/d4815e43-bab3-4f96-90b3-1c8737fc4cd8/volumes"
Jul 30 20:38:59.650678 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:59.650636    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:59.750444 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:59.750415    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:59.936079 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:38:59.935994    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:00.128877 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:00.128846    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:08.795191 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:08.795145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:08.857506 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:08.857469    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:10.736223 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:10.736143    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:10.808695 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:10.808649    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:10.868457 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:10.868427    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:10.929833 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:10.929803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:11.280847 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:11.280809    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:17.143107 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:17.143071    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:17.212856 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:17.212823    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:17.404374 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:17.404295    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:17.626981 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:17.626949    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:18.216793 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:18.216690    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:39:18.234389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:18.223925    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:39:18.234389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:18.225051    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:39:18.234389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:18.232190    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ld8sn_eb104d86-24bd-4152-b455-5280f8753668/ovn-acl-logging/0.log"
Jul 30 20:39:24.551321 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.551285    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"]
Jul 30 20:39:24.551836 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.551513    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5" podUID="01816833-60b1-4083-94c5-a35e6a784d3c" containerName="maas-api" containerID="cri-o://2093fecd333980371497080f3774dcdef7a2453edaf3b255b46ccb836046d2f5" gracePeriod=30
Jul 30 20:39:24.584794 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.584766    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:24.613576 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.613550    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"]
Jul 30 20:39:24.613762 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.613740    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz" podUID="c3badce3-e488-4f8e-860d-7c8d0c8d51d4" containerName="payload-pre-processing" containerID="cri-o://4f6c42ea40680534962af6fd0ce64f5918cd784da08addada65e0eebeb95cc15" gracePeriod=30
Jul 30 20:39:24.778534 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.778499    2561 generic.go:356] "Generic (PLEG): container finished" podID="01816833-60b1-4083-94c5-a35e6a784d3c" containerID="2093fecd333980371497080f3774dcdef7a2453edaf3b255b46ccb836046d2f5" exitCode=0
Jul 30 20:39:24.778675 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.778568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5" event={"ID":"01816833-60b1-4083-94c5-a35e6a784d3c","Type":"ContainerDied","Data":"2093fecd333980371497080f3774dcdef7a2453edaf3b255b46ccb836046d2f5"}
Jul 30 20:39:24.780416 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.780346    2561 generic.go:356] "Generic (PLEG): container finished" podID="c3badce3-e488-4f8e-860d-7c8d0c8d51d4" containerID="4f6c42ea40680534962af6fd0ce64f5918cd784da08addada65e0eebeb95cc15" exitCode=0
Jul 30 20:39:24.780416 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.780387    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz" event={"ID":"c3badce3-e488-4f8e-860d-7c8d0c8d51d4","Type":"ContainerDied","Data":"4f6c42ea40680534962af6fd0ce64f5918cd784da08addada65e0eebeb95cc15"}
Jul 30 20:39:24.854861 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.854840    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:39:24.883505 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.883485    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:39:24.966769 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.966739    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01816833-60b1-4083-94c5-a35e6a784d3c-maas-api-tls\") pod \"01816833-60b1-4083-94c5-a35e6a784d3c\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") "
Jul 30 20:39:24.966929 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.966797    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxlhp\" (UniqueName: \"kubernetes.io/projected/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-kube-api-access-vxlhp\") pod \"c3badce3-e488-4f8e-860d-7c8d0c8d51d4\" (UID: \"c3badce3-e488-4f8e-860d-7c8d0c8d51d4\") "
Jul 30 20:39:24.966929 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.966832    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01816833-60b1-4083-94c5-a35e6a784d3c-openshift-service-ca\") pod \"01816833-60b1-4083-94c5-a35e6a784d3c\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") "
Jul 30 20:39:24.966929 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.966852    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km2xj\" (UniqueName: \"kubernetes.io/projected/01816833-60b1-4083-94c5-a35e6a784d3c-kube-api-access-km2xj\") pod \"01816833-60b1-4083-94c5-a35e6a784d3c\" (UID: \"01816833-60b1-4083-94c5-a35e6a784d3c\") "
Jul 30 20:39:24.967116 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.966945    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-plugins-config-volume\") pod \"c3badce3-e488-4f8e-860d-7c8d0c8d51d4\" (UID: \"c3badce3-e488-4f8e-860d-7c8d0c8d51d4\") "
Jul 30 20:39:24.967260 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.967236    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01816833-60b1-4083-94c5-a35e6a784d3c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01816833-60b1-4083-94c5-a35e6a784d3c" (UID: "01816833-60b1-4083-94c5-a35e6a784d3c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:39:24.967354 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.967334    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3badce3-e488-4f8e-860d-7c8d0c8d51d4" (UID: "c3badce3-e488-4f8e-860d-7c8d0c8d51d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:39:24.968927 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.968898    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01816833-60b1-4083-94c5-a35e6a784d3c-kube-api-access-km2xj" (OuterVolumeSpecName: "kube-api-access-km2xj") pod "01816833-60b1-4083-94c5-a35e6a784d3c" (UID: "01816833-60b1-4083-94c5-a35e6a784d3c"). InnerVolumeSpecName "kube-api-access-km2xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:39:24.969037 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.968940    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01816833-60b1-4083-94c5-a35e6a784d3c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01816833-60b1-4083-94c5-a35e6a784d3c" (UID: "01816833-60b1-4083-94c5-a35e6a784d3c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:39:24.969037 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:24.968961    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-kube-api-access-vxlhp" (OuterVolumeSpecName: "kube-api-access-vxlhp") pod "c3badce3-e488-4f8e-860d-7c8d0c8d51d4" (UID: "c3badce3-e488-4f8e-860d-7c8d0c8d51d4"). InnerVolumeSpecName "kube-api-access-vxlhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:39:25.068289 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.068237    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxlhp\" (UniqueName: \"kubernetes.io/projected/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-kube-api-access-vxlhp\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:39:25.068289 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.068258    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01816833-60b1-4083-94c5-a35e6a784d3c-openshift-service-ca\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:39:25.068289 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.068268    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km2xj\" (UniqueName: \"kubernetes.io/projected/01816833-60b1-4083-94c5-a35e6a784d3c-kube-api-access-km2xj\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:39:25.068289 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.068276    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3badce3-e488-4f8e-860d-7c8d0c8d51d4-plugins-config-volume\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:39:25.068289 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.068286    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01816833-60b1-4083-94c5-a35e6a784d3c-maas-api-tls\") on node \"ip-10-0-135-254.ec2.internal\" DevicePath \"\""
Jul 30 20:39:25.768414 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.768379    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:25.787132 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.787112    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"
Jul 30 20:39:25.787270 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.787147    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5" event={"ID":"01816833-60b1-4083-94c5-a35e6a784d3c","Type":"ContainerDied","Data":"0808da8930b49a16dd680de361454d2b419868709f65730a1dd79ef110c2223c"}
Jul 30 20:39:25.787270 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.787229    2561 scope.go:117] "RemoveContainer" containerID="2093fecd333980371497080f3774dcdef7a2453edaf3b255b46ccb836046d2f5"
Jul 30 20:39:25.788732 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.788702    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz" event={"ID":"c3badce3-e488-4f8e-860d-7c8d0c8d51d4","Type":"ContainerDied","Data":"2be71abf1d58c8f3ac615519d67a0dea3a94b23a4dadb34514ef54696d70f298"}
Jul 30 20:39:25.788732 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.788727    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"
Jul 30 20:39:25.797739 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.797724    2561 scope.go:117] "RemoveContainer" containerID="4f6c42ea40680534962af6fd0ce64f5918cd784da08addada65e0eebeb95cc15"
Jul 30 20:39:25.811010 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.810987    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"]
Jul 30 20:39:25.813124 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.813105    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-808798-78454c477f-wn8g5"]
Jul 30 20:39:25.822094 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.822051    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"]
Jul 30 20:39:25.825543 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.825526    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-808798-d86b8c796-9zqmz"]
Jul 30 20:39:25.840563 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.840541    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01816833-60b1-4083-94c5-a35e6a784d3c" path="/var/lib/kubelet/pods/01816833-60b1-4083-94c5-a35e6a784d3c/volumes"
Jul 30 20:39:25.840876 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:25.840864    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3badce3-e488-4f8e-860d-7c8d0c8d51d4" path="/var/lib/kubelet/pods/c3badce3-e488-4f8e-860d-7c8d0c8d51d4/volumes"
Jul 30 20:39:31.099573 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:31.099518    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:31.165051 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:31.165017    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:31.372918 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:31.372810    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:31.585786 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:31.585745    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:32.060941 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:32.060908    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-559c9c7696-rcxdr_3feeb4e7-6265-42c0-a39f-50c9ebb82e71/authorino/0.log"
Jul 30 20:39:37.658136 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:37.658089    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kvbls_b536bd68-f527-4104-a93e-475514fdf197/server/0.log"
Jul 30 20:39:37.777176 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:37.777133    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rvgmt_d3612b28-3e51-4860-b6e8-bb091b22ffce/manager/0.log"
Jul 30 20:39:37.884500 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:37.884476    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-jtt9w_09852a2f-9efb-4ae9-b626-6b3b1978ea6b/copy-manifests/0.log"
Jul 30 20:39:37.890692 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:37.890671    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-jtt9w_09852a2f-9efb-4ae9-b626-6b3b1978ea6b/manager/0.log"
Jul 30 20:39:39.722656 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:39.722624    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq_63f58856-8b84-4622-bc0f-f0a6e705f098/extract/0.log"
Jul 30 20:39:39.728227 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:39.728203    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq_63f58856-8b84-4622-bc0f-f0a6e705f098/util/0.log"
Jul 30 20:39:39.733954 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:39.733913    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq_63f58856-8b84-4622-bc0f-f0a6e705f098/pull/0.log"
Jul 30 20:39:39.845680 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:39.845656    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k_4e114f8d-dab3-43b5-bba2-52d1be3a5f98/pull/0.log"
Jul 30 20:39:39.851998 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:39.851977    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k_4e114f8d-dab3-43b5-bba2-52d1be3a5f98/extract/0.log"
Jul 30 20:39:39.857453 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:39.857433    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k_4e114f8d-dab3-43b5-bba2-52d1be3a5f98/util/0.log"
Jul 30 20:39:39.967450 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:39.967428    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95_c3fefcff-530e-41dc-b377-d1103127b4db/util/0.log"
Jul 30 20:39:39.973488 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:39.973436    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95_c3fefcff-530e-41dc-b377-d1103127b4db/pull/0.log"
Jul 30 20:39:39.978955 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:39.978939    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95_c3fefcff-530e-41dc-b377-d1103127b4db/extract/0.log"
Jul 30 20:39:40.096471 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:40.096450    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g_3375b9b7-0131-475a-822d-ab60df59a324/pull/0.log"
Jul 30 20:39:40.102043 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:40.102022    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g_3375b9b7-0131-475a-822d-ab60df59a324/extract/0.log"
Jul 30 20:39:40.107549 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:40.107533    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g_3375b9b7-0131-475a-822d-ab60df59a324/util/0.log"
Jul 30 20:39:40.232443 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:40.232388    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-559c9c7696-rcxdr_3feeb4e7-6265-42c0-a39f-50c9ebb82e71/authorino/0.log"
Jul 30 20:39:40.566391 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:40.566338    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dcr9r_041b2303-a7fd-4251-a644-0728fd5bc491/kuadrant-console-plugin/0.log"
Jul 30 20:39:41.648251 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:41.648216    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75997846f9-mk9wl_58b043c5-b949-4ed8-aa93-34c8db286d2a/kube-auth-proxy/0.log"
Jul 30 20:39:42.011770 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:42.011697    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-j8z4b_65eb85d6-5e35-4450-ac1f-9f1dd71fa99e/payload-pre-processing/0.log"
Jul 30 20:39:42.241149 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:42.241114    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c87c77cd-zw8kz_20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7/router/0.log"
Jul 30 20:39:42.683389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:42.683362    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-xb67r_cc79b080-c0e0-4e8a-9ab9-c425110dd5fa/main/0.log"
Jul 30 20:39:42.922070 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:42.922039    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9mgsk_e12d1b00-1bb3-4e0f-9366-cb2b64f7c045/main/0.log"
Jul 30 20:39:48.821608 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.821570    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v4f7q/must-gather-wbcmw"]
Jul 30 20:39:48.822134 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822110    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4815e43-bab3-4f96-90b3-1c8737fc4cd8" containerName="maas-api"
Jul 30 20:39:48.822230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822137    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4815e43-bab3-4f96-90b3-1c8737fc4cd8" containerName="maas-api"
Jul 30 20:39:48.822230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822158    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3badce3-e488-4f8e-860d-7c8d0c8d51d4" containerName="payload-pre-processing"
Jul 30 20:39:48.822230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822167    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3badce3-e488-4f8e-860d-7c8d0c8d51d4" containerName="payload-pre-processing"
Jul 30 20:39:48.822230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822176    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e307611-c35d-4650-8ef2-dee8853179da" containerName="payload-pre-processing"
Jul 30 20:39:48.822230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822186    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e307611-c35d-4650-8ef2-dee8853179da" containerName="payload-pre-processing"
Jul 30 20:39:48.822230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822197    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f7952c-42ba-4b50-bd97-ff896be6ebf9" containerName="payload-processing"
Jul 30 20:39:48.822230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822206    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f7952c-42ba-4b50-bd97-ff896be6ebf9" containerName="payload-processing"
Jul 30 20:39:48.822230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822223    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01816833-60b1-4083-94c5-a35e6a784d3c" containerName="maas-api"
Jul 30 20:39:48.822230 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822231    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="01816833-60b1-4083-94c5-a35e6a784d3c" containerName="maas-api"
Jul 30 20:39:48.822711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822241    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef2af0b-c7b8-41d2-9702-b2501373eb93" containerName="main"
Jul 30 20:39:48.822711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822249    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef2af0b-c7b8-41d2-9702-b2501373eb93" containerName="main"
Jul 30 20:39:48.822711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822362    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="01816833-60b1-4083-94c5-a35e6a784d3c" containerName="maas-api"
Jul 30 20:39:48.822711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822375    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef2af0b-c7b8-41d2-9702-b2501373eb93" containerName="main"
Jul 30 20:39:48.822711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822385    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4815e43-bab3-4f96-90b3-1c8737fc4cd8" containerName="maas-api"
Jul 30 20:39:48.822711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822399    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3badce3-e488-4f8e-860d-7c8d0c8d51d4" containerName="payload-pre-processing"
Jul 30 20:39:48.822711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822408    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="96f7952c-42ba-4b50-bd97-ff896be6ebf9" containerName="payload-processing"
Jul 30 20:39:48.822711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.822417    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e307611-c35d-4650-8ef2-dee8853179da" containerName="payload-pre-processing"
Jul 30 20:39:48.825876 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.825853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4f7q/must-gather-wbcmw"
Jul 30 20:39:48.828732 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.828710    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v4f7q\"/\"kube-root-ca.crt\""
Jul 30 20:39:48.830047 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.830030    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v4f7q\"/\"openshift-service-ca.crt\""
Jul 30 20:39:48.830146 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.830075    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v4f7q\"/\"default-dockercfg-g22vb\""
Jul 30 20:39:48.835445 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.835424    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4f7q/must-gather-wbcmw"]
Jul 30 20:39:48.840904 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.840866    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:48.902263 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.902233    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log" limit=1024
Jul 30 20:39:48.951129 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.951106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79x6k\" (UniqueName: \"kubernetes.io/projected/69d9f756-8cb1-42f2-834a-a2997c9ec9bc-kube-api-access-79x6k\") pod \"must-gather-wbcmw\" (UID: \"69d9f756-8cb1-42f2-834a-a2997c9ec9bc\") " pod="openshift-must-gather-v4f7q/must-gather-wbcmw"
Jul 30 20:39:48.951245 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:48.951160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69d9f756-8cb1-42f2-834a-a2997c9ec9bc-must-gather-output\") pod \"must-gather-wbcmw\" (UID: \"69d9f756-8cb1-42f2-834a-a2997c9ec9bc\") " pod="openshift-must-gather-v4f7q/must-gather-wbcmw"
Jul 30 20:39:49.052467 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:49.052447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x6k\" (UniqueName: \"kubernetes.io/projected/69d9f756-8cb1-42f2-834a-a2997c9ec9bc-kube-api-access-79x6k\") pod \"must-gather-wbcmw\" (UID: \"69d9f756-8cb1-42f2-834a-a2997c9ec9bc\") " pod="openshift-must-gather-v4f7q/must-gather-wbcmw"
Jul 30 20:39:49.052577 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:49.052509    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69d9f756-8cb1-42f2-834a-a2997c9ec9bc-must-gather-output\") pod \"must-gather-wbcmw\" (UID: \"69d9f756-8cb1-42f2-834a-a2997c9ec9bc\") " pod="openshift-must-gather-v4f7q/must-gather-wbcmw"
Jul 30 20:39:49.052852 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:49.052834    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69d9f756-8cb1-42f2-834a-a2997c9ec9bc-must-gather-output\") pod \"must-gather-wbcmw\" (UID: \"69d9f756-8cb1-42f2-834a-a2997c9ec9bc\") " pod="openshift-must-gather-v4f7q/must-gather-wbcmw"
Jul 30 20:39:49.060536 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:49.060516    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79x6k\" (UniqueName: \"kubernetes.io/projected/69d9f756-8cb1-42f2-834a-a2997c9ec9bc-kube-api-access-79x6k\") pod \"must-gather-wbcmw\" (UID: \"69d9f756-8cb1-42f2-834a-a2997c9ec9bc\") " pod="openshift-must-gather-v4f7q/must-gather-wbcmw"
Jul 30 20:39:49.136522 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:49.136498    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4f7q/must-gather-wbcmw"
Jul 30 20:39:49.262575 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:49.262553    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4f7q/must-gather-wbcmw"]
Jul 30 20:39:49.264250 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:39:49.264221    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69d9f756_8cb1_42f2_834a_a2997c9ec9bc.slice/crio-b5c1a78a44876947355ca43cf1c79dc66198ea875f85656f5394efe51a826a09 WatchSource:0}: Error finding container b5c1a78a44876947355ca43cf1c79dc66198ea875f85656f5394efe51a826a09: Status 404 returned error can't find the container with id b5c1a78a44876947355ca43cf1c79dc66198ea875f85656f5394efe51a826a09
Jul 30 20:39:49.266330 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:49.266315    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:39:49.919352 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:49.919308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4f7q/must-gather-wbcmw" event={"ID":"69d9f756-8cb1-42f2-834a-a2997c9ec9bc","Type":"ContainerStarted","Data":"b5c1a78a44876947355ca43cf1c79dc66198ea875f85656f5394efe51a826a09"}
Jul 30 20:39:50.939310 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:50.939274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4f7q/must-gather-wbcmw" event={"ID":"69d9f756-8cb1-42f2-834a-a2997c9ec9bc","Type":"ContainerStarted","Data":"cc874528562a0b5ce7b3c3070fa7bb2551d0e3c1e82ce83c37001ea15390031d"}
Jul 30 20:39:50.939826 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:50.939800    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4f7q/must-gather-wbcmw" event={"ID":"69d9f756-8cb1-42f2-834a-a2997c9ec9bc","Type":"ContainerStarted","Data":"d7ab5c4041d4da02a489c49ef2fe085270b32ac7c115e31e0768d8bd9e51b219"}
Jul 30 20:39:50.958352 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:50.958298    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v4f7q/must-gather-wbcmw" podStartSLOduration=2.178525375 podStartE2EDuration="2.958282147s" totalImagesPullingTime="779.756772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:39:50.956847889 +0000 UTC m=+3633.597262970" watchObservedRunningTime="2026-07-30 20:39:50.958282147 +0000 UTC m=+3633.598697227"
Jul 30 20:39:51.536045 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:51.536014    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7gqnk_8b118d49-f09f-41b4-8960-189b923082f0/global-pull-secret-syncer/0.log"
Jul 30 20:39:51.671601 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:51.671562    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7dk8g_7a724735-f963-4de4-818e-0dd9f65bbaa9/konnectivity-agent/0.log"
Jul 30 20:39:51.779756 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:51.779722    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-254.ec2.internal_a4a8295436f2a97d041aabd413f285d2/haproxy/0.log"
Jul 30 20:39:56.401118 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.401083    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq_63f58856-8b84-4622-bc0f-f0a6e705f098/extract/0.log"
Jul 30 20:39:56.422881 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.422851    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq_63f58856-8b84-4622-bc0f-f0a6e705f098/util/0.log"
Jul 30 20:39:56.442482 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.442451    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592ffrq_63f58856-8b84-4622-bc0f-f0a6e705f098/pull/0.log"
Jul 30 20:39:56.477504 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.477470    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k_4e114f8d-dab3-43b5-bba2-52d1be3a5f98/extract/0.log"
Jul 30 20:39:56.506184 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.506156    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k_4e114f8d-dab3-43b5-bba2-52d1be3a5f98/util/0.log"
Jul 30 20:39:56.528730 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.528698    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ftt7k_4e114f8d-dab3-43b5-bba2-52d1be3a5f98/pull/0.log"
Jul 30 20:39:56.563292 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.563257    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95_c3fefcff-530e-41dc-b377-d1103127b4db/extract/0.log"
Jul 30 20:39:56.589145 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.589117    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95_c3fefcff-530e-41dc-b377-d1103127b4db/util/0.log"
Jul 30 20:39:56.605739 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.605715    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbv95_c3fefcff-530e-41dc-b377-d1103127b4db/pull/0.log"
Jul 30 20:39:56.632568 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.632532    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g_3375b9b7-0131-475a-822d-ab60df59a324/extract/0.log"
Jul 30 20:39:56.652735 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.652638    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g_3375b9b7-0131-475a-822d-ab60df59a324/util/0.log"
Jul 30 20:39:56.672964 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:56.672933    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tj79g_3375b9b7-0131-475a-822d-ab60df59a324/pull/0.log"
Jul 30 20:39:57.338349 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:57.338308    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-559c9c7696-rcxdr_3feeb4e7-6265-42c0-a39f-50c9ebb82e71/authorino/0.log"
Jul 30 20:39:57.453264 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:57.453233    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dcr9r_041b2303-a7fd-4251-a644-0728fd5bc491/kuadrant-console-plugin/0.log"
Jul 30 20:39:59.517762 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:59.517727    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-hgm8k_ddfb3012-64c9-4a83-9a6f-c39b9e768cc4/cluster-monitoring-operator/0.log"
Jul 30 20:39:59.698494 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:59.698462    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zfd4_8217d49b-b30f-485f-82f0-841ee2dd526d/node-exporter/0.log"
Jul 30 20:39:59.722796 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:59.722764    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zfd4_8217d49b-b30f-485f-82f0-841ee2dd526d/kube-rbac-proxy/0.log"
Jul 30 20:39:59.750229 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:39:59.750198    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zfd4_8217d49b-b30f-485f-82f0-841ee2dd526d/init-textfile/0.log"
Jul 30 20:40:00.295635 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:00.295608    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-4mrnq_6bf8e845-73bd-441e-a535-a8931421dad6/prometheus-operator-admission-webhook/0.log"
Jul 30 20:40:01.492192 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.492153    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"]
Jul 30 20:40:01.500562 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.500529    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.507565 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.507536    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"]
Jul 30 20:40:01.685337 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.685294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl87g\" (UniqueName: \"kubernetes.io/projected/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-kube-api-access-dl87g\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.685561 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.685355    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-proc\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.685561 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.685412    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-podres\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.685561 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.685435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-lib-modules\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.685561 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.685500    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-sys\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.758533 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.758451    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-d6pb4_6e504161-83cf-456c-a22c-b931f7229f6b/networking-console-plugin/0.log"
Jul 30 20:40:01.786792 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.786740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-podres\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.786995 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.786811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-lib-modules\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.786995 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.786941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-sys\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.786995 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.786955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-podres\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.787183 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.787049    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-sys\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.787183 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.787048    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl87g\" (UniqueName: \"kubernetes.io/projected/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-kube-api-access-dl87g\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.787183 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.787146    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-lib-modules\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.787353 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.787215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-proc\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.787353 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.787307    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-proc\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.797534 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.797500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl87g\" (UniqueName: \"kubernetes.io/projected/0921b25c-6dd2-47ab-8cc4-aa78b1e86446-kube-api-access-dl87g\") pod \"perf-node-gather-daemonset-qm7rj\" (UID: \"0921b25c-6dd2-47ab-8cc4-aa78b1e86446\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:01.818775 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:01.818734    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:02.001060 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:02.001028    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"]
Jul 30 20:40:02.001635 ip-10-0-135-254 kubenswrapper[2561]: W0730 20:40:02.001597    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0921b25c_6dd2_47ab_8cc4_aa78b1e86446.slice/crio-bee71065af1333a910473abb3929e94a31cd2e318f41dd178a27beb3ea988dc6 WatchSource:0}: Error finding container bee71065af1333a910473abb3929e94a31cd2e318f41dd178a27beb3ea988dc6: Status 404 returned error can't find the container with id bee71065af1333a910473abb3929e94a31cd2e318f41dd178a27beb3ea988dc6
Jul 30 20:40:02.043470 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:02.043441    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj" event={"ID":"0921b25c-6dd2-47ab-8cc4-aa78b1e86446","Type":"ContainerStarted","Data":"bee71065af1333a910473abb3929e94a31cd2e318f41dd178a27beb3ea988dc6"}
Jul 30 20:40:02.392919 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:02.392860    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/2.log"
Jul 30 20:40:02.400096 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:02.400067    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fcfsk_17e8b2b9-1baf-4271-9291-5820bfc1d24e/console-operator/3.log"
Jul 30 20:40:02.874147 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:02.874052    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-778df8d7df-h7cwn_4e686c57-5a99-495e-a31b-fa0ecfd6dd20/console/0.log"
Jul 30 20:40:02.921623 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:02.921587    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-np9p8_69647bac-0a80-4a9c-acda-d6bcbe5926f3/download-server/0.log"
Jul 30 20:40:03.052423 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:03.052378    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj" event={"ID":"0921b25c-6dd2-47ab-8cc4-aa78b1e86446","Type":"ContainerStarted","Data":"16c7587013cb0b1c76cea33c087c8b2f2aa164b20fb0891f0620101c909902c8"}
Jul 30 20:40:03.052625 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:03.052532    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:03.070316 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:03.070263    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj" podStartSLOduration=2.070247208 podStartE2EDuration="2.070247208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:40:03.069924211 +0000 UTC m=+3645.710339292" watchObservedRunningTime="2026-07-30 20:40:03.070247208 +0000 UTC m=+3645.710662289"
Jul 30 20:40:03.462505 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:03.462473    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-prwbz_209c514e-4f86-4faf-919b-551402c28e8c/volume-data-source-validator/0.log"
Jul 30 20:40:04.556251 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:04.556224    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-74wzd_883492c1-b9b3-4281-9928-4c3bc84bf805/dns/0.log"
Jul 30 20:40:04.575645 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:04.575617    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-74wzd_883492c1-b9b3-4281-9928-4c3bc84bf805/kube-rbac-proxy/0.log"
Jul 30 20:40:04.640008 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:04.639978    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-968bf_66d5706a-702f-4e2f-a517-683598ce3f44/dns-node-resolver/0.log"
Jul 30 20:40:05.431050 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:05.431015    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q4bfz_dc9e19c5-f02f-4948-989d-f3a1f4cd28fe/node-ca/0.log"
Jul 30 20:40:06.511454 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:06.511421    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75997846f9-mk9wl_58b043c5-b949-4ed8-aa93-34c8db286d2a/kube-auth-proxy/0.log"
Jul 30 20:40:06.657652 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:06.657614    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-j8z4b_65eb85d6-5e35-4450-ac1f-9f1dd71fa99e/payload-pre-processing/0.log"
Jul 30 20:40:06.708673 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:06.708640    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c87c77cd-zw8kz_20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7/router/0.log"
Jul 30 20:40:07.506165 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:07.506134    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fftjg_059ae0e7-1f8f-4604-ac8e-408810ec9693/serve-healthcheck-canary/0.log"
Jul 30 20:40:07.967625 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:07.967594    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-rqlds_07a83901-0254-4f62-be31-1d43d8ab70c4/insights-operator/0.log"
Jul 30 20:40:07.968110 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:07.967923    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-rqlds_07a83901-0254-4f62-be31-1d43d8ab70c4/insights-operator/1.log"
Jul 30 20:40:08.132149 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:08.132113    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zf89s_449696b7-b408-455a-8070-ee0b669b5925/kube-rbac-proxy/0.log"
Jul 30 20:40:08.162065 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:08.162031    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zf89s_449696b7-b408-455a-8070-ee0b669b5925/exporter/0.log"
Jul 30 20:40:08.191689 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:08.191659    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zf89s_449696b7-b408-455a-8070-ee0b669b5925/extractor/0.log"
Jul 30 20:40:09.070224 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:09.070192    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-qm7rj"
Jul 30 20:40:10.870367 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:10.870339    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kvbls_b536bd68-f527-4104-a93e-475514fdf197/server/0.log"
Jul 30 20:40:10.999537 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:10.998475    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rvgmt_d3612b28-3e51-4860-b6e8-bb091b22ffce/manager/0.log"
Jul 30 20:40:11.021908 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:11.021863    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-jtt9w_09852a2f-9efb-4ae9-b626-6b3b1978ea6b/manager/0.log"
Jul 30 20:40:11.043027 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:11.042996    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-jtt9w_09852a2f-9efb-4ae9-b626-6b3b1978ea6b/copy-manifests/0.log"
Jul 30 20:40:11.693970 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:11.693941    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75997846f9-mk9wl_58b043c5-b949-4ed8-aa93-34c8db286d2a/kube-auth-proxy/0.log"
Jul 30 20:40:11.792508 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:11.792432    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-j8z4b_65eb85d6-5e35-4450-ac1f-9f1dd71fa99e/payload-pre-processing/0.log"
Jul 30 20:40:11.829951 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:11.829909    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c87c77cd-zw8kz_20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7/router/0.log"
Jul 30 20:40:12.434750 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:12.434718    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-996655b6d-jhlqt_312eb697-5cce-462c-a45a-68e4ea890d44/manager/0.log"
Jul 30 20:40:12.488944 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:12.488871    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-k92kp_2f836985-301d-4bcf-9f6d-ea6f35f2d454/openshift-lws-operator/0.log"
Jul 30 20:40:13.332535 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:13.332507    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75997846f9-mk9wl_58b043c5-b949-4ed8-aa93-34c8db286d2a/kube-auth-proxy/0.log"
Jul 30 20:40:13.424389 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:13.424361    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-j8z4b_65eb85d6-5e35-4450-ac1f-9f1dd71fa99e/payload-pre-processing/0.log"
Jul 30 20:40:13.461603 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:13.461569    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c87c77cd-zw8kz_20fbe8bf-fa0b-4233-b844-52ae5b5a4ee7/router/0.log"
Jul 30 20:40:17.374244 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:17.374207    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-j5vtm_c07eb7f6-b249-4a53-96ec-055a46e4330c/kube-storage-version-migrator-operator/1.log"
Jul 30 20:40:17.376262 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:17.376230    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-j5vtm_c07eb7f6-b249-4a53-96ec-055a46e4330c/kube-storage-version-migrator-operator/0.log"
Jul 30 20:40:18.305854 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:18.305824    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tp65_88042802-62d0-4a1d-97f9-6471afa98d05/kube-multus-additional-cni-plugins/0.log"
Jul 30 20:40:18.324288 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:18.324259    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tp65_88042802-62d0-4a1d-97f9-6471afa98d05/egress-router-binary-copy/0.log"
Jul 30 20:40:18.341535 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:18.341515    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tp65_88042802-62d0-4a1d-97f9-6471afa98d05/cni-plugins/0.log"
Jul 30 20:40:18.359446 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:18.359390    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tp65_88042802-62d0-4a1d-97f9-6471afa98d05/bond-cni-plugin/0.log"
Jul 30 20:40:18.378971 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:18.378954    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tp65_88042802-62d0-4a1d-97f9-6471afa98d05/routeoverride-cni/0.log"
Jul 30 20:40:18.398466 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:18.398445    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tp65_88042802-62d0-4a1d-97f9-6471afa98d05/whereabouts-cni-bincopy/0.log"
Jul 30 20:40:18.419502 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:18.419486    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tp65_88042802-62d0-4a1d-97f9-6471afa98d05/whereabouts-cni/0.log"
Jul 30 20:40:18.788711 ip-10-0-135-254 kubenswrapper[2561]: I0730 20:40:18.788679    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zwk5n_d6a4cff9-ed0a-43ab-b6b7-199bbdd66954/kube-multus/0.log"