Jul 16 08:55:04.319915 ip-10-0-135-178 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.729899    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735516    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735549    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735555    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735558    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735561    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735564    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735567    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 08:55:04.740948 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735570    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735574    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735576    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735579    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735582    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735584    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735587    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735589    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735592    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735595    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735597    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735600    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735603    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735611    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735614    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735618    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735623    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735626    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735629    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735632    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 08:55:04.742442 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735636    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735639    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735642    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735644    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735647    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735650    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735653    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735656    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735659    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735662    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735664    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735667    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735669    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735672    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735674    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735677    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735679    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735682    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735684    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735687    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 08:55:04.743307 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735689    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735692    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735695    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735698    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735700    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735706    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735709    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735712    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735714    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735716    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735720    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735722    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735725    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735729    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735733    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735737    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735740    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735742    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735745    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 08:55:04.744169 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735747    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735750    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735754    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735757    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735760    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735763    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735766    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735769    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735773    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735776    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735778    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735781    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735784    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735787    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735789    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735792    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735794    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735798    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735801    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 08:55:04.746389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735804    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735806    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735809    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735811    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735814    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735816    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735819    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735821    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735824    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735826    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735829    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735831    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735834    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.735836    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736574    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736582    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736585    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736589    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736591    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736595    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 08:55:04.746956 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736598    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736602    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736606    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736609    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736613    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736616    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736618    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736621    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736624    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736627    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736630    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736634    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736637    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736639    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736642    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736644    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736647    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736650    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736652    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 08:55:04.747572 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736654    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736657    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736660    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736662    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736664    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736667    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736669    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736672    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736674    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736677    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736680    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736683    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736685    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736688    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736691    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736693    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736695    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736698    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736701    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736703    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 08:55:04.748068 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736706    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736708    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736710    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736713    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736716    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736720    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736724    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736728    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736731    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736733    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736737    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736739    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736742    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736744    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736747    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736750    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736753    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736755    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736758    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736760    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 08:55:04.748658 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736763    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736766    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736769    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736771    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736774    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736777    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736779    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736782    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736784    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736787    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736790    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736792    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736795    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736797    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736800    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736802    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736805    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736808    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736812    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736816    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 08:55:04.749188 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736819    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736822    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736825    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736829    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736831    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736834    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736837    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736839    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736841    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736844    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736847    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736849    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736854    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.736857    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737250    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737255    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737257    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737260    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737263    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737265    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 08:55:04.882513 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737268    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 08:55:04.805606 ip-10-0-135-178 systemd[1]: Started Kubernetes Kubelet.
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737270    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737273    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737275    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737278    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737280    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737283    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737286    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737289    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737292    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737295    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737298    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737301    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737304    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737306    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737309    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737312    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737315    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737317    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 08:55:04.883767 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737320    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737322    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737325    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737327    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737329    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737334    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737338    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737342    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737346    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737348    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737351    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737354    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737356    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737359    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737362    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737364    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737367    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737369    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737372    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737375    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 08:55:04.885306 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737378    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737380    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737382    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737386    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737389    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737392    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737396    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737399    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737402    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737405    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737407    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737411    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737413    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737416    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737419    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737422    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737425    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737430    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737433    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 08:55:04.886373 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737440    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737443    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737446    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737448    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737451    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737455    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737457    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737460    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737462    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737465    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737467    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737470    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737472    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737475    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737477    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737480    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737482    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737485    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737488    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737490    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 08:55:04.887483 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737493    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737495    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737498    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737501    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737505    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737508    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737510    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737513    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737515    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737518    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737521    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737524    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737526    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737541    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.737544    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737613    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737620    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737628    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737632    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737637    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737640    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 08:55:04.892300 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737645    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737649    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737652    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737655    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737659    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737662    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737665    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737668    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737671    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737674    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737677    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737681    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737685    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737687    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737690    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737693    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737696    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737700    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737703    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737706    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737709    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737713    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737716    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737719    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 08:55:04.893367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737722    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737725    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737729    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737732    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737736    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737739    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737742    2570 flags.go:64] FLAG: --enable-server="true"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737744    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737749    2570 flags.go:64] FLAG: --event-burst="100"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737753    2570 flags.go:64] FLAG: --event-qps="50"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737755    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737758    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737761    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737765    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737768    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737770    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737773    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737776    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737779    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737783    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737786    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737788    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737791    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737794    2570 flags.go:64] FLAG: --feature-gates=""
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737797    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 08:55:04.894443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737800    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737803    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737806    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737809    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737814    2570 flags.go:64] FLAG: --help="false"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737816    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-135-178.ec2.internal"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737820    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737823    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737826    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737829    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737832    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737836    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737839    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737842    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737844    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737847    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737850    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737853    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737856    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737858    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737861    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737864    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737867    2570 flags.go:64] FLAG: --lock-file=""
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737869    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 08:55:04.896357 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737872    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737875    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737880    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737883    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737886    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737889    2570 flags.go:64] FLAG: --logging-format="text"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737892    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737895    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737898    2570 flags.go:64] FLAG: --manifest-url=""
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737900    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737904    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737907    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737912    2570 flags.go:64] FLAG: --max-pods="110"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737915    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737918    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737921    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737924    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737927    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737930    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737933    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737941    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737944    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737946    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 08:55:04.897451 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737949    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737952    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737957    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737960    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737963    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737966    2570 flags.go:64] FLAG: --port="10250"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737969    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737972    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a872a433217d57f3"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737975    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737978    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737981    2570 flags.go:64] FLAG: --register-node="true"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737984    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737987    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737991    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737994    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.737997    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738000    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738003    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738006    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738009    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738012    2570 flags.go:64] FLAG: --runonce="false"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738016    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738019    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738022    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738025    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 08:55:04.898541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738027    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738030    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738033    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738036    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738040    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738043    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738046    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738048    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738051    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738054    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738057    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738062    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738065    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738068    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738071    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738074    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738077    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738079    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738082    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738085    2570 flags.go:64] FLAG: --v="2"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738089    2570 flags.go:64] FLAG: --version="false"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738093    2570 flags.go:64] FLAG: --vmodule=""
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738097    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.738100    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738214    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 08:55:04.900849 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738218    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738220    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738223    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738228    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738231    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738233    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738236    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738238    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738241    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738244    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738246    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738250    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738253    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738256    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738259    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738261    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738265    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738269    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738271    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 08:55:04.902139 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738274    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738277    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738279    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738281    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738284    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738286    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738289    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738291    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738294    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738296    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738305    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738308    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738310    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738313    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738315    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738317    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738323    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738325    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738328    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738330    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 08:55:04.903580 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738333    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738335    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738338    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738341    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738344    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738347    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738349    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738352    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738355    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738357    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738360    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738362    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738365    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738367    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738370    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738373    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738375    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738378    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738380    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738383    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 08:55:04.904830 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738385    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738388    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738390    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738400    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738404    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738407    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738410    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738412    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738416    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738418    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738421    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738423    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738426    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738428    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738431    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738433    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738437    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738439    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738443    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 08:55:04.905484 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738447    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738451    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738453    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738456    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738459    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738461    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738464    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738466    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738469    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738471    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738474    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738477    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738479    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738482    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738490    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738493    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738495    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738503    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738506    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 08:55:04.906074 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.738509    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.739279    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.746653    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.746670    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.747544    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.747553    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747618    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747624    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747627    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747631    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747634    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747637    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747640    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747643    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747646    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 08:55:04.906621 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747649    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747651    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747654    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747656    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747659    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747663    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747666    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747670    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747673    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747676    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747679    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747682    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747685    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747687    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747690    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747693    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747696    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747699    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747702    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747705    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 08:55:04.907069 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747707    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747710    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747712    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747715    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747717    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747720    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747722    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747725    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747728    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747731    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747733    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747736    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747738    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747741    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747745    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747749    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747752    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747754    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747757    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 08:55:04.907614 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747761    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747764    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747767    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747769    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747772    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747776    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747779    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747782    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747785    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747789    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747792    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747795    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747798    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747801    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747803    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747806    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747809    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747812    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747815    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 08:55:04.908141 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747818    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747821    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747824    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747826    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747829    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747833    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747836    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747839    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747841    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747844    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747846    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747849    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747851    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747854    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747857    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747860    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747862    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747865    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747867    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 08:55:04.908642 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747870    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747872    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747874    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747877    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747880    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747883    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747885    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747888    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747890    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747893    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747896    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747898    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.747902    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.747907    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748015    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 08:55:04.910925 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748020    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748022    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748025    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748029    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748033    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748035    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748038    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748041    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748043    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748046    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748049    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748051    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748055    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748057    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748060    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748062    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748065    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748067    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748071    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748073    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 08:55:04.911389 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748076    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748078    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748083    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748085    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748088    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748091    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748093    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748096    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748098    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748101    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748103    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748105    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748108    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748110    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748114    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748117    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748120    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748123    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748126    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 08:55:04.926954 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748128    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748131    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748134    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748136    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748139    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748141    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748144    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748147    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748150    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748152    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748155    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748158    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748161    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748165    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748168    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748170    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748174    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748176    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748179    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748181    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 08:55:04.927994 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748184    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748187    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748189    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748192    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748194    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748197    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748199    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748202    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748204    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748207    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748210    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748213    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748215    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748218    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748220    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748222    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748225    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748228    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748230    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748233    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 08:55:04.929028 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748236    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748238    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748241    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748244    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748246    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748249    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748251    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748254    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748257    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748260    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748262    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748265    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748267    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748269    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748272    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748274    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748277    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748280    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 08:55:04.930510 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:04.748282    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.748287    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.748387    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.750331    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.751705    2570 server.go:1019] "Starting client certificate rotation"
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.751813    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.751853    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.754171    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.755284    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.767980    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.773136    2570 log.go:25] "Validated CRI v1 image API"
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.774589    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 08:55:04.931367 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.778911    2570 fs.go:135] Filesystem UUIDs: map[70e2b2a2-1585-4eea-bbeb-12b53aeb492a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cc715044-5c6f-4f13-bda3-06bde447194b:/dev/nvme0n1p4]
Jul 16 08:55:04.933045 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.778932    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 08:55:05.109933 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.784823    2570 manager.go:216] Machine: {Timestamp:2026-07-16 08:55:04.783472811 +0000 UTC m=+0.335505528 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101895 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c8a2cb313d2152f46e8d45ca3ab8c SystemUUID:ec2c8a2c-b313-d215-2f46-e8d45ca3ab8c BootID:6e5ba848-894e-4f7a-a27e-c8601192942b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:ce:4c:76:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:ce:4c:76:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:7e:73:eb:1e:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 08:55:05.109933 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.784928    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 08:55:05.109933 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.785051    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 08:55:05.109933 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.786092    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 08:55:05.109933 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.788064    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 08:55:05.109933 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.788095    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 08:55:05.109933 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.788871    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.788881    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.788888    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.789893    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.791255    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.794411    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.794568    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.794599    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.794611    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.794627    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.794638    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.794653    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.795002    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.795025    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.797735    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.799595    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.799627    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.799773    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.799785    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.799792    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.799799    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.799808    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.799813    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.800363    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.800371    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.800378    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.800391    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.800407    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.800417    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.801245    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.801255    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.804295    2570 server.go:1268] "Started kubelet"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.804387    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.804898    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.804963    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.806101    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.806280    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.806522    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.806556    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 08:55:05.111580 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.808151    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.809910    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.813204    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-smjmp"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.813736    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.813751    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.813913    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.812302    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-178.ec2.internal.18c2b94429ea3a30  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-178.ec2.internal,UID:ip-10-0-135-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-178.ec2.internal,},FirstTimestamp:2026-07-16 08:55:04.804268592 +0000 UTC m=+0.356301330,LastTimestamp:2026-07-16 08:55:04.804268592 +0000 UTC m=+0.356301330,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-178.ec2.internal,}"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.814362    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.814518    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.814632    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.814805    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.814813    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.815616    2570 factory.go:153] Registering CRI-O factory
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.815638    2570 factory.go:223] Registration of the crio container factory successfully
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.816077    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.816091    2570 factory.go:55] Registering systemd factory
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.816102    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.816800    2570 factory.go:103] Registering Raw factory
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.816837    2570 manager.go:1196] Started watching for new ooms in manager
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.817278    2570 manager.go:349] Starting recovery of all containers
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.820753    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-smjmp"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.822574    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.822652    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.828305    2570 manager.go:354] Recovery completed
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.833265    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.835089    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.835122    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.835134    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.835709    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.835720    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.835735    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.835764    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 08:55:05.112724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.836455    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.836490    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.836499    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.836966    2570 policy_none.go:49] "None policy: Start"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.836980    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.837004    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.837024    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-178.ec2.internal.18c2b9442bc0bc50  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-178.ec2.internal,UID:ip-10-0-135-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-178.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-178.ec2.internal,},FirstTimestamp:2026-07-16 08:55:04.835103824 +0000 UTC m=+0.387136546,LastTimestamp:2026-07-16 08:55:04.835103824 +0000 UTC m=+0.387136546,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-178.ec2.internal,}"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.838037    2570 policy_none.go:47] "Start"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.884190    2570 manager.go:337] "Starting Device Plugin manager"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.884387    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.884401    2570 server.go:87] "Starting device plugin registration server"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.884626    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.884637    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.884960    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.885016    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.885022    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.885683    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.885743    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.963946    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.965155    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.965189    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.965220    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.965260    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.969043    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.985482    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.986275    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.986296    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.986307    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.986329    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:04.992663    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:04.992679    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-178.ec2.internal\": node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.004421    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.065836    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"]
Jul 16 08:55:05.113643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.065907    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.066798    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.066827    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.066839    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.068153    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.068267    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.068296    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.068789    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.068796    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.068815    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.068824    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.068830    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.068837    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.070058    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.070083    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.073489    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.073507    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.073516    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeHasSufficientPID"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.103141    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-178.ec2.internal\" not found" node="ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.104571    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.114652 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.111403    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-178.ec2.internal\" not found" node="ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.300135 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.119475    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.300135 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.119496    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.300135 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.119512    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/102fbd48ff7ff0cfcd397c73fd966f70-config\") pod \"kube-apiserver-proxy-ip-10-0-135-178.ec2.internal\" (UID: \"102fbd48ff7ff0cfcd397c73fd966f70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.300135 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.205003    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.300135 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.220362    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.300135 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.220389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.300135 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.220405    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/102fbd48ff7ff0cfcd397c73fd966f70-config\") pod \"kube-apiserver-proxy-ip-10-0-135-178.ec2.internal\" (UID: \"102fbd48ff7ff0cfcd397c73fd966f70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.300135 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.220452    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.300135 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.220466    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e193e431239fbdd2a5f918e7173fd13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal\" (UID: \"2e193e431239fbdd2a5f918e7173fd13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.300135 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.220518    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/102fbd48ff7ff0cfcd397c73fd966f70-config\") pod \"kube-apiserver-proxy-ip-10-0-135-178.ec2.internal\" (UID: \"102fbd48ff7ff0cfcd397c73fd966f70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.500644 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.305628    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.500644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.405131    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.500644 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.406180    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.500644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.414656    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:05.682910 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.507053    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.682910 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.607492    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.785063 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.707820    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.785063 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.751040    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 08:55:05.785063 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.751156    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 08:55:05.886854 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.807915    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:05.886854 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.824117    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 08:50:04 +0000 UTC" deadline="2028-02-28 09:14:44.472789532 +0000 UTC"
Jul 16 08:55:05.886854 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.824137    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14208h19m38.648655196s"
Jul 16 08:55:05.886854 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.830071    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 08:55:05.986393 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:05.907460    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 08:55:05.986393 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:05.908467    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:06.077188 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.008855    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:06.109778 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.109753    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-178.ec2.internal\" not found"
Jul 16 08:55:06.189917 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.189892    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 08:55:06.214646 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.214617    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:06.227630 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.227609    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 08:55:06.228443 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.228431    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal"
Jul 16 08:55:06.238396 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.238347    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 08:55:06.296351 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:06.296324    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e193e431239fbdd2a5f918e7173fd13.slice/crio-fa80f38a3e38141beb33dc7736f3f4f7b4037bf76c9870d8566ec0d008304b0d WatchSource:0}: Error finding container fa80f38a3e38141beb33dc7736f3f4f7b4037bf76c9870d8566ec0d008304b0d: Status 404 returned error can't find the container with id fa80f38a3e38141beb33dc7736f3f4f7b4037bf76c9870d8566ec0d008304b0d
Jul 16 08:55:06.296862 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:06.296840    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102fbd48ff7ff0cfcd397c73fd966f70.slice/crio-619f89dea3275f09fa3cda29da8aa2f003b33e070288ee4d6c3913d158676375 WatchSource:0}: Error finding container 619f89dea3275f09fa3cda29da8aa2f003b33e070288ee4d6c3913d158676375: Status 404 returned error can't find the container with id 619f89dea3275f09fa3cda29da8aa2f003b33e070288ee4d6c3913d158676375
Jul 16 08:55:06.300584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.300568    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 08:55:06.795621 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.795583    2570 apiserver.go:52] "Watching apiserver"
Jul 16 08:55:06.804269 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.804246    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 08:55:06.806640 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.806541    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-s27fh","openshift-image-registry/node-ca-2mpmb","openshift-multus/network-metrics-daemon-l78hg","openshift-network-diagnostics/network-check-target-c4f2k","openshift-network-operator/iptables-alerter-fvjmz","openshift-ovn-kubernetes/ovnkube-node-v5lm4","kube-system/global-pull-secret-syncer-75242","kube-system/konnectivity-agent-5bwwx","kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal","openshift-multus/multus-additional-cni-plugins-p5g9k","openshift-multus/multus-j7cl9","openshift-cluster-node-tuning-operator/tuned-rd722"]
Jul 16 08:55:06.809178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.809150    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.811900 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.811460    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pqvpg\""
Jul 16 08:55:06.811900 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.811809    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 08:55:06.812049 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.811909    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 08:55:06.812049 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.811959    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 08:55:06.812283 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.812264    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.814383 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.814365    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:06.814483 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.814429    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:06.815046 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.815024    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 08:55:06.815231 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.815208    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5k9zn\""
Jul 16 08:55:06.815267 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.815223    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 08:55:06.815414 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.815401    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 08:55:06.815474 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.815459    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 08:55:06.815539 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.815462    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 08:55:06.816494 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.816365    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:06.816494 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.816417    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:06.819683 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.819140    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:06.821949 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.820869    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:06.821949 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.821134    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 08:55:06.821949 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.821315    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-72l49\""
Jul 16 08:55:06.821949 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.821590    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 08:55:06.821949 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.821764    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 08:55:06.823786 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.822825    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:06.823786 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.823286    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zw8jd\""
Jul 16 08:55:06.823786 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.823292    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 08:55:06.823786 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.823613    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 08:55:06.824014 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.823985    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 08:55:06.824792 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.824773    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 08:55:06.825584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.824952    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:06.825584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.825169    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v5qpc\""
Jul 16 08:55:06.825584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.825279    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 08:55:06.827287 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:06.827287 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.827104    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:06.827287 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827136    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 08:55:06.827434 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827308    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-socket-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.827434 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827333    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-socket-dir-parent\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.827434 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-var-lib-cni-multus\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.827434 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827375    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:06.827434 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/973d613a-c79d-4c0e-9945-0fcb9454fffb-cni-binary-copy\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.827434 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-run-netns\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827435    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-etc-kubernetes\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l67bf\" (UniqueName: \"kubernetes.io/projected/96702d5b-3be0-4729-9ddb-022b16b20cd1-kube-api-access-l67bf\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827488    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827520    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-hostroot\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827565    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd7tw\" (UniqueName: \"kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw\") pod \"network-check-target-c4f2k\" (UID: \"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988\") " pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827585    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-registration-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827604    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-cni-dir\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-etc-selinux\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827673    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsj9r\" (UniqueName: \"kubernetes.io/projected/45d3c2d5-81ed-417a-903b-3697f488fa2d-kube-api-access-rsj9r\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-system-cni-dir\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.827736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827732    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-cnibin\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.828219 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827770    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-run-k8s-cni-cncf-io\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.828219 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-var-lib-cni-bin\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.828219 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827817    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-var-lib-kubelet\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.828219 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827839    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-conf-dir\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.828219 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827860    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-daemon-config\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.828219 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827914    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-run-multus-certs\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.828219 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvz6r\" (UniqueName: \"kubernetes.io/projected/973d613a-c79d-4c0e-9945-0fcb9454fffb-kube-api-access-pvz6r\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.828219 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.827987    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-device-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.828219 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.828032    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-sys-fs\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.828219 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.828064    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-os-release\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.828654 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.828597    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 08:55:06.828704 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.828679    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kdsms\""
Jul 16 08:55:06.829046 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.828911    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 08:55:06.829426 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.829409    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:06.833997 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.833977    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 08:55:06.836943 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.834805    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.836943 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.834938    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m5hqm\""
Jul 16 08:55:06.836943 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.835967    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 08:55:06.837548 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.837399    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 08:55:06.837970 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.837752    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 08:55:06.837970 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.837902    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 08:55:06.838387 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.838107    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 08:55:06.838387 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.838197    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-msdnz\""
Jul 16 08:55:06.838387 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.838230    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 08:55:06.838387 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.838197    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 08:55:06.839640 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.839477    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.841718 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.841701    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 08:55:06.842073 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.842053    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 08:55:06.842352 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.842297    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jfcl2\""
Jul 16 08:55:06.849725 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.849686    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lfnfs"
Jul 16 08:55:06.856937 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.856918    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lfnfs"
Jul 16 08:55:06.915863 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.915839    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 08:55:06.920337 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.920317    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 08:55:06.929093 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929074    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-run-netns\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.929215 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-env-overrides\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.929215 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929121    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-sysctl-conf\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.929215 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-hostroot\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929215 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929177    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gsrb\" (UniqueName: \"kubernetes.io/projected/4683ed3c-f68e-4dcd-b1ab-db92a12dac6e-kube-api-access-7gsrb\") pod \"iptables-alerter-fvjmz\" (UID: \"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e\") " pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:06.929390 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929219    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-hostroot\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929390 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929272    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-etc-selinux\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.929390 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-system-cni-dir\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929390 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929338    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-system-cni-dir\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:06.929390 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929372    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-etc-selinux\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.929390 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:06.929684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929419    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-system-cni-dir\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929465    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-var-lib-cni-bin\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-var-lib-kubelet\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929550    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-var-lib-cni-bin\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929567    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-run-multus-certs\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929581    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-var-lib-kubelet\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvz6r\" (UniqueName: \"kubernetes.io/projected/973d613a-c79d-4c0e-9945-0fcb9454fffb-kube-api-access-pvz6r\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929616    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-run-multus-certs\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.929684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-os-release\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929751    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-sysconfig\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4683ed3c-f68e-4dcd-b1ab-db92a12dac6e-iptables-alerter-script\") pod \"iptables-alerter-fvjmz\" (UID: \"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e\") " pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929812    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-device-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929835    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-sys-fs\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929885    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-sys-fs\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929895    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929933    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-device-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929938    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-kubernetes\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.929974    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86304cd0-9239-4c83-b9af-3c58aab39d97-tmp\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930007    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-var-lib-openvswitch\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.930055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930040    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930074    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-socket-dir-parent\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930097    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-var-lib-cni-multus\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930119    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4bcb10aa-9fbd-4739-9033-498353921729-dbus\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/973d613a-c79d-4c0e-9945-0fcb9454fffb-cni-binary-copy\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-etc-kubernetes\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930188    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l67bf\" (UniqueName: \"kubernetes.io/projected/96702d5b-3be0-4729-9ddb-022b16b20cd1-kube-api-access-l67bf\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c804ded-6c2b-48c6-b551-2cdde96f775a-tmp-dir\") pod \"node-resolver-s27fh\" (UID: \"1c804ded-6c2b-48c6-b551-2cdde96f775a\") " pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930239    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-socket-dir-parent\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930243    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-kubelet\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930273    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-modprobe-d\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930294    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-run\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930315    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcc43300-1f1f-44a4-8919-b6384063d625-konnectivity-ca\") pod \"konnectivity-agent-5bwwx\" (UID: \"dcc43300-1f1f-44a4-8919-b6384063d625\") " pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930335    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-run-openvswitch\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.930562 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930356    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-log-socket\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-systemd\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcb6l\" (UniqueName: \"kubernetes.io/projected/86304cd0-9239-4c83-b9af-3c58aab39d97-kube-api-access-vcb6l\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930415    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-etc-kubernetes\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcc43300-1f1f-44a4-8919-b6384063d625-agent-certs\") pod \"konnectivity-agent-5bwwx\" (UID: \"dcc43300-1f1f-44a4-8919-b6384063d625\") " pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930374    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-var-lib-cni-multus\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930464    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930515    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930520    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-run-systemd\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930593    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-cni-netd\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930616    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-ovn-node-metrics-cert\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-ovnkube-script-lib\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930677    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-sysctl-d\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.931178 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-host\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930730    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7tw\" (UniqueName: \"kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw\") pod \"network-check-target-c4f2k\" (UID: \"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988\") " pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930761    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-registration-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930815    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/973d613a-c79d-4c0e-9945-0fcb9454fffb-cni-binary-copy\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930818    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-cni-dir\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930855    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-etc-openvswitch\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930886    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-cni-bin\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930906    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-registration-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-sys\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930946    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-cni-dir\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930970    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4683ed3c-f68e-4dcd-b1ab-db92a12dac6e-host-slash\") pod \"iptables-alerter-fvjmz\" (UID: \"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e\") " pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.930996    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsj9r\" (UniqueName: \"kubernetes.io/projected/45d3c2d5-81ed-417a-903b-3697f488fa2d-kube-api-access-rsj9r\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931019    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-cnibin\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931038    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-cnibin\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:06.931798 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931076    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931091    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-cnibin\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qdqx\" (UniqueName: \"kubernetes.io/projected/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-kube-api-access-5qdqx\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931120    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-node-log\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931145    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-run-k8s-cni-cncf-io\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931166    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-conf-dir\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931187    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-daemon-config\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931207    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-run-ovn\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931216    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-run-k8s-cni-cncf-io\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931231    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-os-release\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931221    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-conf-dir\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931260    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931287    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-slash\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931293    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-os-release\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-lib-modules\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.932415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zbpw\" (UniqueName: \"kubernetes.io/projected/36d590a8-21ff-4ae1-912c-548319c0559c-kube-api-access-4zbpw\") pod \"node-ca-2mpmb\" (UID: \"36d590a8-21ff-4ae1-912c-548319c0559c\") " pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931394    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4bcb10aa-9fbd-4739-9033-498353921729-kubelet-config\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-socket-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931476    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c804ded-6c2b-48c6-b551-2cdde96f775a-hosts-file\") pod \"node-resolver-s27fh\" (UID: \"1c804ded-6c2b-48c6-b551-2cdde96f775a\") " pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931507    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.931542    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931551    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-systemd-units\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931571    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45d3c2d5-81ed-417a-903b-3697f488fa2d-socket-dir\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931572    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-tuned\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.931610    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs podName:96702d5b-3be0-4729-9ddb-022b16b20cd1 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:07.431577007 +0000 UTC m=+2.983609728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs") pod "network-metrics-daemon-l78hg" (UID: "96702d5b-3be0-4729-9ddb-022b16b20cd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36d590a8-21ff-4ae1-912c-548319c0559c-host\") pod \"node-ca-2mpmb\" (UID: \"36d590a8-21ff-4ae1-912c-548319c0559c\") " pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931661    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-run-netns\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hdm2\" (UniqueName: \"kubernetes.io/projected/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-kube-api-access-8hdm2\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:06.933081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931660    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/973d613a-c79d-4c0e-9945-0fcb9454fffb-multus-daemon-config\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.933709 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-ovnkube-config\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:06.933709 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931708    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/973d613a-c79d-4c0e-9945-0fcb9454fffb-host-run-netns\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.933709 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931739    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-var-lib-kubelet\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:06.933709 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931774    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36d590a8-21ff-4ae1-912c-548319c0559c-serviceca\") pod \"node-ca-2mpmb\" (UID: \"36d590a8-21ff-4ae1-912c-548319c0559c\") " pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:06.933709 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.931818    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbsvk\" (UniqueName: \"kubernetes.io/projected/1c804ded-6c2b-48c6-b551-2cdde96f775a-kube-api-access-cbsvk\") pod \"node-resolver-s27fh\" (UID: \"1c804ded-6c2b-48c6-b551-2cdde96f775a\") " pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:06.936224 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.936196    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 08:55:06.937093 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.936668    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 08:55:06.937093 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.936690    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 08:55:06.937093 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.936702    2570 projected.go:196] Error preparing data for projected volume kube-api-access-rd7tw for pod openshift-network-diagnostics/network-check-target-c4f2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:06.937093 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:06.936767    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw podName:da8c6ed6-dc5a-48b3-bf03-8b8dccdac988 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:07.436750556 +0000 UTC m=+2.988783280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rd7tw" (UniqueName: "kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw") pod "network-check-target-c4f2k" (UID: "da8c6ed6-dc5a-48b3-bf03-8b8dccdac988") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:06.940039 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.940014    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l67bf\" (UniqueName: \"kubernetes.io/projected/96702d5b-3be0-4729-9ddb-022b16b20cd1-kube-api-access-l67bf\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:06.940360 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.940344    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvz6r\" (UniqueName: \"kubernetes.io/projected/973d613a-c79d-4c0e-9945-0fcb9454fffb-kube-api-access-pvz6r\") pod \"multus-j7cl9\" (UID: \"973d613a-c79d-4c0e-9945-0fcb9454fffb\") " pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:06.940483 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:06.940465    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsj9r\" (UniqueName: \"kubernetes.io/projected/45d3c2d5-81ed-417a-903b-3697f488fa2d-kube-api-access-rsj9r\") pod \"aws-ebs-csi-driver-node-477k9\" (UID: \"45d3c2d5-81ed-417a-903b-3697f488fa2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:07.023954 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.023904    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal" event={"ID":"102fbd48ff7ff0cfcd397c73fd966f70","Type":"ContainerStarted","Data":"619f89dea3275f09fa3cda29da8aa2f003b33e070288ee4d6c3913d158676375"}
Jul 16 08:55:07.025155 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.025130    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal" event={"ID":"2e193e431239fbdd2a5f918e7173fd13","Type":"ContainerStarted","Data":"fa80f38a3e38141beb33dc7736f3f4f7b4037bf76c9870d8566ec0d008304b0d"}
Jul 16 08:55:07.032456 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hdm2\" (UniqueName: \"kubernetes.io/projected/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-kube-api-access-8hdm2\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.032575 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032466    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-ovnkube-config\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.032575 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-var-lib-kubelet\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.032575 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032523    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36d590a8-21ff-4ae1-912c-548319c0559c-serviceca\") pod \"node-ca-2mpmb\" (UID: \"36d590a8-21ff-4ae1-912c-548319c0559c\") " pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:07.032575 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032560    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbsvk\" (UniqueName: \"kubernetes.io/projected/1c804ded-6c2b-48c6-b551-2cdde96f775a-kube-api-access-cbsvk\") pod \"node-resolver-s27fh\" (UID: \"1c804ded-6c2b-48c6-b551-2cdde96f775a\") " pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:07.032756 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032608    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-run-netns\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.032756 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032618    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-var-lib-kubelet\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.032756 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032629    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-env-overrides\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.032756 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-sysctl-conf\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.032756 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032673    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gsrb\" (UniqueName: \"kubernetes.io/projected/4683ed3c-f68e-4dcd-b1ab-db92a12dac6e-kube-api-access-7gsrb\") pod \"iptables-alerter-fvjmz\" (UID: \"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e\") " pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:07.032756 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032703    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-system-cni-dir\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.032756 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:07.032756 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032752    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-os-release\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032775    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-sysconfig\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032797    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4683ed3c-f68e-4dcd-b1ab-db92a12dac6e-iptables-alerter-script\") pod \"iptables-alerter-fvjmz\" (UID: \"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e\") " pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032844    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-kubernetes\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032868    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86304cd0-9239-4c83-b9af-3c58aab39d97-tmp\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032890    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-var-lib-openvswitch\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032912    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032918    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-run-netns\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.032936    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4bcb10aa-9fbd-4739-9033-498353921729-dbus\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033006    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-os-release\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033006    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36d590a8-21ff-4ae1-912c-548319c0559c-serviceca\") pod \"node-ca-2mpmb\" (UID: \"36d590a8-21ff-4ae1-912c-548319c0559c\") " pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:07.033110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033056    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-sysconfig\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.033204    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033233    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.033269    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret podName:4bcb10aa-9fbd-4739-9033-498353921729 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:07.533252706 +0000 UTC m=+3.085285420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret") pod "global-pull-secret-syncer-75242" (UID: "4bcb10aa-9fbd-4739-9033-498353921729") : object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-ovnkube-config\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033280    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-var-lib-openvswitch\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-sysctl-conf\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033298    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-env-overrides\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033304    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-system-cni-dir\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033333    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-kubernetes\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033347    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c804ded-6c2b-48c6-b551-2cdde96f775a-tmp-dir\") pod \"node-resolver-s27fh\" (UID: \"1c804ded-6c2b-48c6-b551-2cdde96f775a\") " pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033355    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4bcb10aa-9fbd-4739-9033-498353921729-dbus\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033375    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-kubelet\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033400    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-modprobe-d\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.033644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-run\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcc43300-1f1f-44a4-8919-b6384063d625-konnectivity-ca\") pod \"konnectivity-agent-5bwwx\" (UID: \"dcc43300-1f1f-44a4-8919-b6384063d625\") " pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033462    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-kubelet\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-run-openvswitch\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033508    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-log-socket\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033512    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-run-openvswitch\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033518    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4683ed3c-f68e-4dcd-b1ab-db92a12dac6e-iptables-alerter-script\") pod \"iptables-alerter-fvjmz\" (UID: \"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e\") " pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033553    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-systemd\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcb6l\" (UniqueName: \"kubernetes.io/projected/86304cd0-9239-4c83-b9af-3c58aab39d97-kube-api-access-vcb6l\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033588    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-run\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcc43300-1f1f-44a4-8919-b6384063d625-agent-certs\") pod \"konnectivity-agent-5bwwx\" (UID: \"dcc43300-1f1f-44a4-8919-b6384063d625\") " pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033623    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c804ded-6c2b-48c6-b551-2cdde96f775a-tmp-dir\") pod \"node-resolver-s27fh\" (UID: \"1c804ded-6c2b-48c6-b551-2cdde96f775a\") " pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033679    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-run-systemd\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033634    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-modprobe-d\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034229 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033694    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-systemd\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033648    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-run-systemd\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033729    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-log-socket\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-cni-netd\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033755    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-ovn-node-metrics-cert\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033776    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-ovnkube-script-lib\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-sysctl-d\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033815    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-host\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.033885    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-host\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034047    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcc43300-1f1f-44a4-8919-b6384063d625-konnectivity-ca\") pod \"konnectivity-agent-5bwwx\" (UID: \"dcc43300-1f1f-44a4-8919-b6384063d625\") " pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034177    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-sysctl-d\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-cni-netd\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034268    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-etc-openvswitch\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-cni-bin\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-sys\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.034905 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4683ed3c-f68e-4dcd-b1ab-db92a12dac6e-host-slash\") pod \"iptables-alerter-fvjmz\" (UID: \"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e\") " pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034367    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-ovnkube-script-lib\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034382    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-cnibin\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034412    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-cnibin\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034413    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qdqx\" (UniqueName: \"kubernetes.io/projected/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-kube-api-access-5qdqx\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034459    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034468    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-node-log\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034492    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-run-ovn\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034510    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-sys\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034525    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4683ed3c-f68e-4dcd-b1ab-db92a12dac6e-host-slash\") pod \"iptables-alerter-fvjmz\" (UID: \"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e\") " pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034561    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034593    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-slash\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034597    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-cni-bin\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.035584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034599    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-node-log\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034615    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-lib-modules\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034637    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-host-slash\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034626    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034639    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zbpw\" (UniqueName: \"kubernetes.io/projected/36d590a8-21ff-4ae1-912c-548319c0559c-kube-api-access-4zbpw\") pod \"node-ca-2mpmb\" (UID: \"36d590a8-21ff-4ae1-912c-548319c0559c\") " pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034666    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-etc-openvswitch\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034566    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-run-ovn\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4bcb10aa-9fbd-4739-9033-498353921729-kubelet-config\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034734    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c804ded-6c2b-48c6-b551-2cdde96f775a-hosts-file\") pod \"node-resolver-s27fh\" (UID: \"1c804ded-6c2b-48c6-b551-2cdde96f775a\") " pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034768    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034798    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86304cd0-9239-4c83-b9af-3c58aab39d97-lib-modules\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034827    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4bcb10aa-9fbd-4739-9033-498353921729-kubelet-config\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034829    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c804ded-6c2b-48c6-b551-2cdde96f775a-hosts-file\") pod \"node-resolver-s27fh\" (UID: \"1c804ded-6c2b-48c6-b551-2cdde96f775a\") " pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:07.036131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-systemd-units\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.036541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034859    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-tuned\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.036541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034863    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-systemd-units\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.036541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034875    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36d590a8-21ff-4ae1-912c-548319c0559c-host\") pod \"node-ca-2mpmb\" (UID: \"36d590a8-21ff-4ae1-912c-548319c0559c\") " pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:07.036541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.034921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36d590a8-21ff-4ae1-912c-548319c0559c-host\") pod \"node-ca-2mpmb\" (UID: \"36d590a8-21ff-4ae1-912c-548319c0559c\") " pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:07.036541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.035148    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.036541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.035209    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.036541 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.036339    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcc43300-1f1f-44a4-8919-b6384063d625-agent-certs\") pod \"konnectivity-agent-5bwwx\" (UID: \"dcc43300-1f1f-44a4-8919-b6384063d625\") " pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:07.036873 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.036855    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-ovn-node-metrics-cert\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.037269 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.037248    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86304cd0-9239-4c83-b9af-3c58aab39d97-etc-tuned\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.038064 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.038044    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86304cd0-9239-4c83-b9af-3c58aab39d97-tmp\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.043267 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.043244    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gsrb\" (UniqueName: \"kubernetes.io/projected/4683ed3c-f68e-4dcd-b1ab-db92a12dac6e-kube-api-access-7gsrb\") pod \"iptables-alerter-fvjmz\" (UID: \"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e\") " pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:07.044415 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.044236    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbsvk\" (UniqueName: \"kubernetes.io/projected/1c804ded-6c2b-48c6-b551-2cdde96f775a-kube-api-access-cbsvk\") pod \"node-resolver-s27fh\" (UID: \"1c804ded-6c2b-48c6-b551-2cdde96f775a\") " pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:07.044769 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.044728    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hdm2\" (UniqueName: \"kubernetes.io/projected/72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2-kube-api-access-8hdm2\") pod \"multus-additional-cni-plugins-p5g9k\" (UID: \"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2\") " pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.045250 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.045229    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qdqx\" (UniqueName: \"kubernetes.io/projected/c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31-kube-api-access-5qdqx\") pod \"ovnkube-node-v5lm4\" (UID: \"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.045851 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.045802    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zbpw\" (UniqueName: \"kubernetes.io/projected/36d590a8-21ff-4ae1-912c-548319c0559c-kube-api-access-4zbpw\") pod \"node-ca-2mpmb\" (UID: \"36d590a8-21ff-4ae1-912c-548319c0559c\") " pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:07.047037 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.047019    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcb6l\" (UniqueName: \"kubernetes.io/projected/86304cd0-9239-4c83-b9af-3c58aab39d97-kube-api-access-vcb6l\") pod \"tuned-rd722\" (UID: \"86304cd0-9239-4c83-b9af-3c58aab39d97\") " pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.122988 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.122956    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9"
Jul 16 08:55:07.130980 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.130958    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7cl9"
Jul 16 08:55:07.134180 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:07.134154    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d3c2d5_81ed_417a_903b_3697f488fa2d.slice/crio-e490b06c19e7d3e97191aa592da5a6c9c85c5aa2e9441941762141158186a7ef WatchSource:0}: Error finding container e490b06c19e7d3e97191aa592da5a6c9c85c5aa2e9441941762141158186a7ef: Status 404 returned error can't find the container with id e490b06c19e7d3e97191aa592da5a6c9c85c5aa2e9441941762141158186a7ef
Jul 16 08:55:07.141051 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:07.141022    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973d613a_c79d_4c0e_9945_0fcb9454fffb.slice/crio-ae66dc157689263cf6d291e88384362b540aba991b81de09cdef030e90f57cb6 WatchSource:0}: Error finding container ae66dc157689263cf6d291e88384362b540aba991b81de09cdef030e90f57cb6: Status 404 returned error can't find the container with id ae66dc157689263cf6d291e88384362b540aba991b81de09cdef030e90f57cb6
Jul 16 08:55:07.142374 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.142291    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fvjmz"
Jul 16 08:55:07.150650 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.150631    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:07.151607 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:07.151577    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4683ed3c_f68e_4dcd_b1ab_db92a12dac6e.slice/crio-dc232bf0233c49dd549615274b0eb4d83f20bb93588cfa63100ecde61344ebec WatchSource:0}: Error finding container dc232bf0233c49dd549615274b0eb4d83f20bb93588cfa63100ecde61344ebec: Status 404 returned error can't find the container with id dc232bf0233c49dd549615274b0eb4d83f20bb93588cfa63100ecde61344ebec
Jul 16 08:55:07.157181 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.157028    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p5g9k"
Jul 16 08:55:07.165781 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.165758    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2mpmb"
Jul 16 08:55:07.173387 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.173362    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s27fh"
Jul 16 08:55:07.179989 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.179959    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:07.186502 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.186481    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rd722"
Jul 16 08:55:07.437774 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.437695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:07.437919 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.437779    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7tw\" (UniqueName: \"kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw\") pod \"network-check-target-c4f2k\" (UID: \"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988\") " pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:07.437919 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.437858    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:07.437919 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.437903    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 08:55:07.437919 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.437919    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 08:55:07.438071 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.437928    2570 projected.go:196] Error preparing data for projected volume kube-api-access-rd7tw for pod openshift-network-diagnostics/network-check-target-c4f2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:07.438071 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.437929    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs podName:96702d5b-3be0-4729-9ddb-022b16b20cd1 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:08.437910263 +0000 UTC m=+3.989942987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs") pod "network-metrics-daemon-l78hg" (UID: "96702d5b-3be0-4729-9ddb-022b16b20cd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:07.438071 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.437972    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw podName:da8c6ed6-dc5a-48b3-bf03-8b8dccdac988 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:08.437950634 +0000 UTC m=+3.989983336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd7tw" (UniqueName: "kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw") pod "network-check-target-c4f2k" (UID: "da8c6ed6-dc5a-48b3-bf03-8b8dccdac988") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:07.538548 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.538500    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:07.538704 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.538631    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:07.538704 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.538697    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret podName:4bcb10aa-9fbd-4739-9033-498353921729 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:08.538677747 +0000 UTC m=+4.090710454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret") pod "global-pull-secret-syncer-75242" (UID: "4bcb10aa-9fbd-4739-9033-498353921729") : object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:07.860603 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.860504    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 08:50:06 +0000 UTC" deadline="2028-03-30 23:22:42.570685226 +0000 UTC"
Jul 16 08:55:07.860603 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.860551    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14966h27m34.710138819s"
Jul 16 08:55:07.966062 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:07.966029    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:07.966210 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:07.966149    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:08.027884 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:08.027846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fvjmz" event={"ID":"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e","Type":"ContainerStarted","Data":"dc232bf0233c49dd549615274b0eb4d83f20bb93588cfa63100ecde61344ebec"}
Jul 16 08:55:08.029128 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:08.029099    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7cl9" event={"ID":"973d613a-c79d-4c0e-9945-0fcb9454fffb","Type":"ContainerStarted","Data":"ae66dc157689263cf6d291e88384362b540aba991b81de09cdef030e90f57cb6"}
Jul 16 08:55:08.030402 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:08.030375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9" event={"ID":"45d3c2d5-81ed-417a-903b-3697f488fa2d","Type":"ContainerStarted","Data":"e490b06c19e7d3e97191aa592da5a6c9c85c5aa2e9441941762141158186a7ef"}
Jul 16 08:55:08.178039 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:08.178006    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c1d9a0_45e6_4b19_b06f_c0a2b3c267a2.slice/crio-a8676159a7ce0e9d2e06b347f614a727be254e346139186be1dd7a3390dab59d WatchSource:0}: Error finding container a8676159a7ce0e9d2e06b347f614a727be254e346139186be1dd7a3390dab59d: Status 404 returned error can't find the container with id a8676159a7ce0e9d2e06b347f614a727be254e346139186be1dd7a3390dab59d
Jul 16 08:55:08.180794 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:08.180560    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc43300_1f1f_44a4_8919_b6384063d625.slice/crio-d3baed9e1e47c4d1405b26632a526108aac20363a3531e2e2d4c150a476b26b2 WatchSource:0}: Error finding container d3baed9e1e47c4d1405b26632a526108aac20363a3531e2e2d4c150a476b26b2: Status 404 returned error can't find the container with id d3baed9e1e47c4d1405b26632a526108aac20363a3531e2e2d4c150a476b26b2
Jul 16 08:55:08.181923 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:08.181893    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ea6fc6_f2f5_4f89_bc95_0ffae0954b31.slice/crio-b180dd19842f5b91e76dd6512f114421e2de7aabfefbfc5cd835ec2628d05edc WatchSource:0}: Error finding container b180dd19842f5b91e76dd6512f114421e2de7aabfefbfc5cd835ec2628d05edc: Status 404 returned error can't find the container with id b180dd19842f5b91e76dd6512f114421e2de7aabfefbfc5cd835ec2628d05edc
Jul 16 08:55:08.444216 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:08.443989    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:08.444362 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:08.444147    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:08.444362 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:08.444296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7tw\" (UniqueName: \"kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw\") pod \"network-check-target-c4f2k\" (UID: \"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988\") " pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:08.444362 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:08.444339    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs podName:96702d5b-3be0-4729-9ddb-022b16b20cd1 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:10.444321945 +0000 UTC m=+5.996354649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs") pod "network-metrics-daemon-l78hg" (UID: "96702d5b-3be0-4729-9ddb-022b16b20cd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:08.444554 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:08.444430    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 08:55:08.444554 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:08.444462    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 08:55:08.444554 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:08.444475    2570 projected.go:196] Error preparing data for projected volume kube-api-access-rd7tw for pod openshift-network-diagnostics/network-check-target-c4f2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:08.444554 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:08.444524    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw podName:da8c6ed6-dc5a-48b3-bf03-8b8dccdac988 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:10.444509278 +0000 UTC m=+5.996542000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd7tw" (UniqueName: "kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw") pod "network-check-target-c4f2k" (UID: "da8c6ed6-dc5a-48b3-bf03-8b8dccdac988") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:08.546028 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:08.545339    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:08.546028 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:08.545578    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:08.546028 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:08.545643    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret podName:4bcb10aa-9fbd-4739-9033-498353921729 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:10.545625928 +0000 UTC m=+6.097658633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret") pod "global-pull-secret-syncer-75242" (UID: "4bcb10aa-9fbd-4739-9033-498353921729") : object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:08.861247 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:08.861125    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 08:50:06 +0000 UTC" deadline="2027-12-21 22:57:00.807270209 +0000 UTC"
Jul 16 08:55:08.861247 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:08.861197    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12566h1m51.946078309s"
Jul 16 08:55:08.969131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:08.966001    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:08.969131 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:08.966152    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:08.969131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:08.966604    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:08.969131 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:08.966713    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:09.050085 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.049430    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal" event={"ID":"102fbd48ff7ff0cfcd397c73fd966f70","Type":"ContainerStarted","Data":"d8e2417bd141929df9c35339ac389ff3b2a83ca5bb0cde446f82395c23b44267"}
Jul 16 08:55:09.062457 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.061797    2570 generic.go:356] "Generic (PLEG): container finished" podID="2e193e431239fbdd2a5f918e7173fd13" containerID="bbfeb3fd1e47f438da61f411ec3799ceda9a8c2a8526c0186265b16390c57c53" exitCode=0
Jul 16 08:55:09.062457 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.061894    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal" event={"ID":"2e193e431239fbdd2a5f918e7173fd13","Type":"ContainerDied","Data":"bbfeb3fd1e47f438da61f411ec3799ceda9a8c2a8526c0186265b16390c57c53"}
Jul 16 08:55:09.083558 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.081907    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-178.ec2.internal" podStartSLOduration=3.081886604 podStartE2EDuration="3.081886604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:09.065755092 +0000 UTC m=+4.617787819" watchObservedRunningTime="2026-07-16 08:55:09.081886604 +0000 UTC m=+4.633919332"
Jul 16 08:55:09.084026 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.083946    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rd722" event={"ID":"86304cd0-9239-4c83-b9af-3c58aab39d97","Type":"ContainerStarted","Data":"d6a77637a13042e952ca032e30d00c7a0c9e6117058549b313866b0e16dde4d2"}
Jul 16 08:55:09.100775 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.100749    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s27fh" event={"ID":"1c804ded-6c2b-48c6-b551-2cdde96f775a","Type":"ContainerStarted","Data":"a6667db170ce6c1132ce1a33710dcbd7b46a5e9fcc6b4e28b2c0eafa93255459"}
Jul 16 08:55:09.110293 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.110203    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" event={"ID":"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31","Type":"ContainerStarted","Data":"b180dd19842f5b91e76dd6512f114421e2de7aabfefbfc5cd835ec2628d05edc"}
Jul 16 08:55:09.113540 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.113465    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5g9k" event={"ID":"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2","Type":"ContainerStarted","Data":"a8676159a7ce0e9d2e06b347f614a727be254e346139186be1dd7a3390dab59d"}
Jul 16 08:55:09.125035 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.125006    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5bwwx" event={"ID":"dcc43300-1f1f-44a4-8919-b6384063d625","Type":"ContainerStarted","Data":"d3baed9e1e47c4d1405b26632a526108aac20363a3531e2e2d4c150a476b26b2"}
Jul 16 08:55:09.133633 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.133604    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2mpmb" event={"ID":"36d590a8-21ff-4ae1-912c-548319c0559c","Type":"ContainerStarted","Data":"3d2584165408881da87c7d1d7574f3ab9970a367726d4176c5e875a46676f485"}
Jul 16 08:55:09.966091 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:09.966062    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:09.966598 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:09.966195    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:10.154416 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:10.154368    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal" event={"ID":"2e193e431239fbdd2a5f918e7173fd13","Type":"ContainerStarted","Data":"75c82968ef87f6482c043519670ada8ca4822b2a1e1da77bc8a29fb4e6a59432"}
Jul 16 08:55:10.472202 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:10.472166    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7tw\" (UniqueName: \"kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw\") pod \"network-check-target-c4f2k\" (UID: \"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988\") " pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:10.472366 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:10.472229    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:10.472421 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:10.472373    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:10.472465 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:10.472437    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs podName:96702d5b-3be0-4729-9ddb-022b16b20cd1 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:14.472416123 +0000 UTC m=+10.024448841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs") pod "network-metrics-daemon-l78hg" (UID: "96702d5b-3be0-4729-9ddb-022b16b20cd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:10.472689 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:10.472672    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 08:55:10.472778 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:10.472694    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 08:55:10.472778 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:10.472707    2570 projected.go:196] Error preparing data for projected volume kube-api-access-rd7tw for pod openshift-network-diagnostics/network-check-target-c4f2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:10.472778 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:10.472755    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw podName:da8c6ed6-dc5a-48b3-bf03-8b8dccdac988 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:14.472741041 +0000 UTC m=+10.024773746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd7tw" (UniqueName: "kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw") pod "network-check-target-c4f2k" (UID: "da8c6ed6-dc5a-48b3-bf03-8b8dccdac988") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:10.573544 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:10.573489    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:10.573770 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:10.573724    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:10.573844 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:10.573790    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret podName:4bcb10aa-9fbd-4739-9033-498353921729 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:14.573772615 +0000 UTC m=+10.125805325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret") pod "global-pull-secret-syncer-75242" (UID: "4bcb10aa-9fbd-4739-9033-498353921729") : object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:10.970315 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:10.970238    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:10.970783 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:10.970355    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:10.970783 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:10.970729    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:10.970891 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:10.970830    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:11.966121 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:11.966082    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:11.966327 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:11.966215    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:12.966352 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:12.966316    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:12.966895 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:12.966451    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:12.966895 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:12.966851    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:12.967015 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:12.966957    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:13.966067 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:13.966022    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:13.966257 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:13.966181    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:14.509167 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:14.508980    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7tw\" (UniqueName: \"kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw\") pod \"network-check-target-c4f2k\" (UID: \"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988\") " pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:14.509167 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:14.509036    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:14.509167 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:14.509145    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 08:55:14.509741 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:14.509180    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 08:55:14.509741 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:14.509194    2570 projected.go:196] Error preparing data for projected volume kube-api-access-rd7tw for pod openshift-network-diagnostics/network-check-target-c4f2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:14.509741 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:14.509251    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw podName:da8c6ed6-dc5a-48b3-bf03-8b8dccdac988 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:22.509233219 +0000 UTC m=+18.061265926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd7tw" (UniqueName: "kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw") pod "network-check-target-c4f2k" (UID: "da8c6ed6-dc5a-48b3-bf03-8b8dccdac988") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:14.509741 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:14.509148    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:14.509741 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:14.509635    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs podName:96702d5b-3be0-4729-9ddb-022b16b20cd1 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:22.50961853 +0000 UTC m=+18.061651251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs") pod "network-metrics-daemon-l78hg" (UID: "96702d5b-3be0-4729-9ddb-022b16b20cd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:14.609548 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:14.609499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:14.609725 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:14.609654    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:14.609725 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:14.609713    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret podName:4bcb10aa-9fbd-4739-9033-498353921729 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:22.609695598 +0000 UTC m=+18.161728305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret") pod "global-pull-secret-syncer-75242" (UID: "4bcb10aa-9fbd-4739-9033-498353921729") : object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:14.969708 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:14.969583    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:14.969708 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:14.969608    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:14.969941 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:14.969758    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:14.969941 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:14.969914    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:15.965470 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:15.965433    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:15.965897 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:15.965607    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:16.965795 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:16.965761    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:16.966292 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:16.965903    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:16.966292 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:16.966056    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:16.966292 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:16.966143    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:17.965997 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:17.965963    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:17.966387 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:17.966076    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:18.966468 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:18.966430    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:18.966944 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:18.966593    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:18.966944 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:18.966937    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:18.967065 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:18.967044    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:19.966466 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:19.966426    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:19.966654 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:19.966580    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:20.966439 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:20.966396    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:20.966629 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:20.966396    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:20.966629 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:20.966560    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:20.966998 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:20.966650    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:21.966216 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:21.966181    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:21.966386 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:21.966288    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:22.574959 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:22.574867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:22.575344 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:22.575045    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:22.575344 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:22.575109    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs podName:96702d5b-3be0-4729-9ddb-022b16b20cd1 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:38.575093655 +0000 UTC m=+34.127126359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs") pod "network-metrics-daemon-l78hg" (UID: "96702d5b-3be0-4729-9ddb-022b16b20cd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:22.575344 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:22.575049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7tw\" (UniqueName: \"kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw\") pod \"network-check-target-c4f2k\" (UID: \"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988\") " pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:22.575344 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:22.575138    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 08:55:22.575344 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:22.575156    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 08:55:22.575344 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:22.575166    2570 projected.go:196] Error preparing data for projected volume kube-api-access-rd7tw for pod openshift-network-diagnostics/network-check-target-c4f2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:22.575344 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:22.575206    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw podName:da8c6ed6-dc5a-48b3-bf03-8b8dccdac988 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:38.575195284 +0000 UTC m=+34.127227988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd7tw" (UniqueName: "kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw") pod "network-check-target-c4f2k" (UID: "da8c6ed6-dc5a-48b3-bf03-8b8dccdac988") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:22.675754 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:22.675716    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:22.675909 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:22.675847    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:22.675948 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:22.675909    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret podName:4bcb10aa-9fbd-4739-9033-498353921729 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:38.675894388 +0000 UTC m=+34.227927104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret") pod "global-pull-secret-syncer-75242" (UID: "4bcb10aa-9fbd-4739-9033-498353921729") : object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:22.965933 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:22.965847    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:22.966102 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:22.966000    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:22.966102 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:22.966017    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:22.966188 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:22.966128    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:23.965664 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:23.965634    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:23.966132 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:23.965742    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:24.967216 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:24.967179    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:24.967657 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:24.967312    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:24.967724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:24.967695    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:24.967813 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:24.967786    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:25.966254 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:25.966218    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:25.966426 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:25.966330    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:26.965737 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:26.965472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:26.966381 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:26.965482    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:26.966381 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:26.966117    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:26.966495 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:26.966406    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:27.188304 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.188180    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7cl9" event={"ID":"973d613a-c79d-4c0e-9945-0fcb9454fffb","Type":"ContainerStarted","Data":"131891b319731b8a9e18e9325f32aba475ba21141c6e47a88a9658b4e02fbbe3"}
Jul 16 08:55:27.189816 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.189786    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rd722" event={"ID":"86304cd0-9239-4c83-b9af-3c58aab39d97","Type":"ContainerStarted","Data":"9457cd2212db5d90a552b4410cb7440102705eb1ab4b14682379ceac6c6158f8"}
Jul 16 08:55:27.191464 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.191407    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s27fh" event={"ID":"1c804ded-6c2b-48c6-b551-2cdde96f775a","Type":"ContainerStarted","Data":"1c32d41ce06178a38b71096d40abd664d70b62a3d12a891ddac5016f59952dfb"}
Jul 16 08:55:27.193189 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.193160    2570 generic.go:356] "Generic (PLEG): container finished" podID="72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2" containerID="95e909b2181d342d949eff8f208c6e1c70ac15670a6dac0478330eaad7af11fa" exitCode=0
Jul 16 08:55:27.193297 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.193256    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5g9k" event={"ID":"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2","Type":"ContainerDied","Data":"95e909b2181d342d949eff8f208c6e1c70ac15670a6dac0478330eaad7af11fa"}
Jul 16 08:55:27.194927 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.194897    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9" event={"ID":"45d3c2d5-81ed-417a-903b-3697f488fa2d","Type":"ContainerStarted","Data":"29b18183b524badd59df68915e47d650b5bdfb7a6089e13d985a34278d661245"}
Jul 16 08:55:27.196693 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.196641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5bwwx" event={"ID":"dcc43300-1f1f-44a4-8919-b6384063d625","Type":"ContainerStarted","Data":"92d6d221732f83f1b6a80015128ed57bd4d59dc80dd259d6cb272686dfeaef9d"}
Jul 16 08:55:27.198146 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.198127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2mpmb" event={"ID":"36d590a8-21ff-4ae1-912c-548319c0559c","Type":"ContainerStarted","Data":"aa13441f1d24cc9492c82d66d2847e64be8b76566f6756d38f8ec5596baa752e"}
Jul 16 08:55:27.205626 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.205591    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j7cl9" podStartSLOduration=3.867094186 podStartE2EDuration="23.205580049s" totalImagesPullingTime="19.338485863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:27.205416531 +0000 UTC m=+22.757449256" watchObservedRunningTime="2026-07-16 08:55:27.205580049 +0000 UTC m=+22.757612774"
Jul 16 08:55:27.206210 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.206177    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-178.ec2.internal" podStartSLOduration=21.206169264 podStartE2EDuration="21.206169264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:10.173588333 +0000 UTC m=+5.725621057" watchObservedRunningTime="2026-07-16 08:55:27.206169264 +0000 UTC m=+22.758201992"
Jul 16 08:55:27.221397 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.221353    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rd722" podStartSLOduration=4.074285724 podStartE2EDuration="22.221336287s" totalImagesPullingTime="18.147050563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:27.220999048 +0000 UTC m=+22.773031786" watchObservedRunningTime="2026-07-16 08:55:27.221336287 +0000 UTC m=+22.773369015"
Jul 16 08:55:27.238347 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.238293    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5bwwx" podStartSLOduration=5.095747709 podStartE2EDuration="23.238275305s" totalImagesPullingTime="18.142527596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:27.238028221 +0000 UTC m=+22.790060948" watchObservedRunningTime="2026-07-16 08:55:27.238275305 +0000 UTC m=+22.790308031"
Jul 16 08:55:27.280320 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.280280    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2mpmb" podStartSLOduration=5.140040055 podStartE2EDuration="23.28026493s" totalImagesPullingTime="18.140224875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:27.279808263 +0000 UTC m=+22.831840989" watchObservedRunningTime="2026-07-16 08:55:27.28026493 +0000 UTC m=+22.832297655"
Jul 16 08:55:27.297075 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.297032    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s27fh" podStartSLOduration=4.160170008 podStartE2EDuration="22.29702115s" totalImagesPullingTime="18.136851142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:27.296834847 +0000 UTC m=+22.848867687" watchObservedRunningTime="2026-07-16 08:55:27.29702115 +0000 UTC m=+22.849053872"
Jul 16 08:55:27.338005 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.337971    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:27.417187 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.417162    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:27.516637 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.516606    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:27.680339 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.680318    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 08:55:27.900025 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.899908    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T08:55:27.680335534Z","UUID":"883cda1a-4dd5-424f-ad64-8e87ad5fc7ed","Handler":null,"Name":"","Endpoint":""}
Jul 16 08:55:27.901707 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.901684    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 08:55:27.901815 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.901726    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 08:55:27.966101 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:27.966078    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:27.966737 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:27.966199    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:28.202709 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.202637    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fvjmz" event={"ID":"4683ed3c-f68e-4dcd-b1ab-db92a12dac6e","Type":"ContainerStarted","Data":"f14dfeccba77c94329f5b5a1f4950a798e916a4039537c7e7dbacead09bdf1f4"}
Jul 16 08:55:28.206645 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.206615    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 08:55:28.207001 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.206976    2570 generic.go:356] "Generic (PLEG): container finished" podID="c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31" containerID="527fd5f277dcc5c036b15e680255a04255a31d551fafe7ad00bff50d0ef3e382" exitCode=1
Jul 16 08:55:28.207109 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.207055    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" event={"ID":"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31","Type":"ContainerStarted","Data":"52be793f0a443b365a6c59c5f90542a9a0416546be48feed5221077176095b8f"}
Jul 16 08:55:28.207181 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.207126    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" event={"ID":"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31","Type":"ContainerStarted","Data":"6babd21f63f9f6e9e4393b3c031587b17b64831e13b16849c013e673560ee4d5"}
Jul 16 08:55:28.207181 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.207176    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" event={"ID":"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31","Type":"ContainerStarted","Data":"a7eedc5150ed3a45050e8d4dce3828a49abbc80a0dd492620719e5433bd50180"}
Jul 16 08:55:28.207282 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.207224    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" event={"ID":"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31","Type":"ContainerStarted","Data":"f8a15310d2f9f9c45307ac52890a74bb7d4a45cdf817e9f32f09ed7e361ad429"}
Jul 16 08:55:28.207282 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.207271    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" event={"ID":"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31","Type":"ContainerDied","Data":"527fd5f277dcc5c036b15e680255a04255a31d551fafe7ad00bff50d0ef3e382"}
Jul 16 08:55:28.207379 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.207319    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" event={"ID":"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31","Type":"ContainerStarted","Data":"dbbec4857310c304353ace33c7f6c9f7657fb98867e742cca77aa9a9370cd855"}
Jul 16 08:55:28.209483 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.209458    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9" event={"ID":"45d3c2d5-81ed-417a-903b-3697f488fa2d","Type":"ContainerStarted","Data":"809f510681a5aaa2bed8f25c6ce179a2e38953c2f861d3c6cd1f4f9e2f796626"}
Jul 16 08:55:28.217643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.217560    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fvjmz" podStartSLOduration=5.043219457 podStartE2EDuration="24.217522645s" totalImagesPullingTime="19.174303188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:28.21723609 +0000 UTC m=+23.769268818" watchObservedRunningTime="2026-07-16 08:55:28.217522645 +0000 UTC m=+23.769555374"
Jul 16 08:55:28.336830 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.336749    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:28.399737 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.399662    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:28.401477 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.401454    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:28.402075 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.402055    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:28.966459 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.966227    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:28.966909 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:28.966227    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:28.966909 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:28.966603    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:28.966909 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:28.966631    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:29.214789 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:29.214699    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9" event={"ID":"45d3c2d5-81ed-417a-903b-3697f488fa2d","Type":"ContainerStarted","Data":"ddf4846dfcf1f75dd98cc5f6b805b3c1335ea8194aef75c4e95b8b9237fbe143"}
Jul 16 08:55:29.233923 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:29.233878    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-477k9" podStartSLOduration=8.391983024 podStartE2EDuration="25.233861927s" totalImagesPullingTime="16.841878903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:29.233467583 +0000 UTC m=+24.785500309" watchObservedRunningTime="2026-07-16 08:55:29.233861927 +0000 UTC m=+24.785894650"
Jul 16 08:55:29.965660 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:29.965632    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:29.965927 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:29.965745    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:30.217345 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:30.217266    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 16 08:55:30.966275 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:30.966235    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:30.966463 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:30.966242    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:30.966463 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:30.966394    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:30.966607 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:30.966473    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:31.966131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:31.966058    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:31.966731 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:31.966167    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:32.224489 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:32.224418    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 08:55:32.224824 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:32.224802    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" event={"ID":"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31","Type":"ContainerStarted","Data":"7d2037b422735d55cfbb726831ffc175fa4f9260faee2a658be48f7bba373509"}
Jul 16 08:55:32.226350 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:32.226324    2570 generic.go:356] "Generic (PLEG): container finished" podID="72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2" containerID="18fb41051ef268e44409149b339c5805b98a3544d122c43f44f2cbc2ff790bcc" exitCode=0
Jul 16 08:55:32.226421 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:32.226372    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5g9k" event={"ID":"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2","Type":"ContainerDied","Data":"18fb41051ef268e44409149b339c5805b98a3544d122c43f44f2cbc2ff790bcc"}
Jul 16 08:55:32.966503 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:32.966427    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:32.966503 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:32.966457    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:32.966894 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:32.966570    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:32.966894 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:32.966690    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:33.230317 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:33.230286    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5g9k" event={"ID":"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2","Type":"ContainerStarted","Data":"d074530106bbdb536a93cfa22968d0a1360ae8eb56a35bc8417e4a5aa44a5d8d"}
Jul 16 08:55:33.722811 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:33.722617    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:33.824757 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:33.824726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:33.965830 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:33.965802    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:33.965981 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:33.965896    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:34.195386 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.195299    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:34.195836 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.195417    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 16 08:55:34.195949 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.195932    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5bwwx"
Jul 16 08:55:34.235237 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.235211    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 08:55:34.235599 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.235566    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" event={"ID":"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31","Type":"ContainerStarted","Data":"4c7d6f5f41ba3bba3095b598d6ef07e1a335fdf3811363b2836780dac926e181"}
Jul 16 08:55:34.235836 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.235815    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:34.236009 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.235994    2570 scope.go:117] "RemoveContainer" containerID="527fd5f277dcc5c036b15e680255a04255a31d551fafe7ad00bff50d0ef3e382"
Jul 16 08:55:34.237936 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.237918    2570 generic.go:356] "Generic (PLEG): container finished" podID="72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2" containerID="d074530106bbdb536a93cfa22968d0a1360ae8eb56a35bc8417e4a5aa44a5d8d" exitCode=0
Jul 16 08:55:34.238040 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.238000    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5g9k" event={"ID":"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2","Type":"ContainerDied","Data":"d074530106bbdb536a93cfa22968d0a1360ae8eb56a35bc8417e4a5aa44a5d8d"}
Jul 16 08:55:34.252516 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.252494    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:34.255742 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.255705    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:34.967054 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.967019    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:34.967202 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:34.967121    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:34.967260 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:34.967205    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:34.967309 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:34.967289    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:35.244503 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.244272    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 08:55:35.244947 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.244855    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" event={"ID":"c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31","Type":"ContainerStarted","Data":"5e730cdefb1e8a8ffc5dcbd89a196d0903668c87f48fbb4f43dbb66d4e0dc239"}
Jul 16 08:55:35.245046 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.245030    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 16 08:55:35.245359 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.245334    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:35.263193 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.263165    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:35.272564 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.272500    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4" podStartSLOduration=11.118756279 podStartE2EDuration="30.272485181s" totalImagesPullingTime="19.153728902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:35.27212246 +0000 UTC m=+30.824155187" watchObservedRunningTime="2026-07-16 08:55:35.272485181 +0000 UTC m=+30.824517940"
Jul 16 08:55:35.773746 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.773710    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-75242"]
Jul 16 08:55:35.773900 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.773887    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:35.774033 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:35.773999    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:35.777368 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.777339    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l78hg"]
Jul 16 08:55:35.777503 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.777466    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:35.777590 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:35.777574    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:35.777911 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.777887    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c4f2k"]
Jul 16 08:55:35.777992 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:35.777979    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:35.778079 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:35.778062    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:36.250356 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:36.250326    2570 generic.go:356] "Generic (PLEG): container finished" podID="72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2" containerID="e146244a436128e3775834203b215af98ca6e964603cd904c9f986c5c8700a7c" exitCode=0
Jul 16 08:55:36.251110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:36.250410    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5g9k" event={"ID":"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2","Type":"ContainerDied","Data":"e146244a436128e3775834203b215af98ca6e964603cd904c9f986c5c8700a7c"}
Jul 16 08:55:36.251110 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:36.250476    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 16 08:55:36.507857 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:36.507775    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:36.965823 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:36.965790    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:36.965967 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:36.965834    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:36.965967 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:36.965906    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:36.966088 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:36.966065    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:37.966398 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:37.966365    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:37.966783 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:37.966500    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:38.267060 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:38.266978    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lm4"
Jul 16 08:55:38.434485 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:38.434434    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:38.592942 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:38.592906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7tw\" (UniqueName: \"kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw\") pod \"network-check-target-c4f2k\" (UID: \"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988\") " pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:38.593128 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:38.593058    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:38.593128 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:38.593084    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 08:55:38.593128 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:38.593113    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 08:55:38.593128 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:38.593128    2570 projected.go:196] Error preparing data for projected volume kube-api-access-rd7tw for pod openshift-network-diagnostics/network-check-target-c4f2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:38.593336 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:38.593191    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw podName:da8c6ed6-dc5a-48b3-bf03-8b8dccdac988 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:10.593173677 +0000 UTC m=+66.145206383 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rd7tw" (UniqueName: "kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw") pod "network-check-target-c4f2k" (UID: "da8c6ed6-dc5a-48b3-bf03-8b8dccdac988") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 08:55:38.593336 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:38.593208    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:38.593336 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:38.593310    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs podName:96702d5b-3be0-4729-9ddb-022b16b20cd1 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:10.593294411 +0000 UTC m=+66.145327128 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs") pod "network-metrics-daemon-l78hg" (UID: "96702d5b-3be0-4729-9ddb-022b16b20cd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 08:55:38.693615 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:38.693579    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:38.693781 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:38.693747    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:38.693837 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:38.693813    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret podName:4bcb10aa-9fbd-4739-9033-498353921729 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:10.693798535 +0000 UTC m=+66.245831239 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret") pod "global-pull-secret-syncer-75242" (UID: "4bcb10aa-9fbd-4739-9033-498353921729") : object "kube-system"/"original-pull-secret" not registered
Jul 16 08:55:38.892165 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:38.892076    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:38.966341 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:38.966302    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:38.966341 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:38.966345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:38.966918 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:38.966448    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c4f2k" podUID="da8c6ed6-dc5a-48b3-bf03-8b8dccdac988"
Jul 16 08:55:38.966918 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:38.966581    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75242" podUID="4bcb10aa-9fbd-4739-9033-498353921729"
Jul 16 08:55:39.966592 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:39.966396    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:39.967001 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:39.966731    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hg" podUID="96702d5b-3be0-4729-9ddb-022b16b20cd1"
Jul 16 08:55:40.220865 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.220764    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-178.ec2.internal" event="NodeReady"
Jul 16 08:55:40.221097 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.220914    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 08:55:40.289823 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.289789    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jmg7x"]
Jul 16 08:55:40.292492 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.292466    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n6ch9"]
Jul 16 08:55:40.292665 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.292612    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.294226 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.294205    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n6ch9"
Jul 16 08:55:40.295309 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.295149    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wm6pc\""
Jul 16 08:55:40.295309 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.295162    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 08:55:40.295309 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.295149    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 08:55:40.296697 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.296674    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 08:55:40.296812 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.296708    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 08:55:40.296812 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.296802    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 08:55:40.296924 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.296816    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tdqp\""
Jul 16 08:55:40.305389 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.304778    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jmg7x"]
Jul 16 08:55:40.305389 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.305358    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n6ch9"]
Jul 16 08:55:40.409258 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.409220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.409438 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.409270    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-config-volume\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.409438 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.409290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6nwm\" (UniqueName: \"kubernetes.io/projected/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-kube-api-access-k6nwm\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.409438 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.409418    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prkwf\" (UniqueName: \"kubernetes.io/projected/0dae7c84-8ff6-4dc5-9be3-335624c6bec2-kube-api-access-prkwf\") pod \"ingress-canary-n6ch9\" (UID: \"0dae7c84-8ff6-4dc5-9be3-335624c6bec2\") " pod="openshift-ingress-canary/ingress-canary-n6ch9"
Jul 16 08:55:40.409674 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.409459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-tmp-dir\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.409674 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.409489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dae7c84-8ff6-4dc5-9be3-335624c6bec2-cert\") pod \"ingress-canary-n6ch9\" (UID: \"0dae7c84-8ff6-4dc5-9be3-335624c6bec2\") " pod="openshift-ingress-canary/ingress-canary-n6ch9"
Jul 16 08:55:40.416093 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.416050    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:40.498502 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.498413    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:40.510097 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.510056    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prkwf\" (UniqueName: \"kubernetes.io/projected/0dae7c84-8ff6-4dc5-9be3-335624c6bec2-kube-api-access-prkwf\") pod \"ingress-canary-n6ch9\" (UID: \"0dae7c84-8ff6-4dc5-9be3-335624c6bec2\") " pod="openshift-ingress-canary/ingress-canary-n6ch9"
Jul 16 08:55:40.510258 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.510100    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-tmp-dir\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.510258 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.510122    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dae7c84-8ff6-4dc5-9be3-335624c6bec2-cert\") pod \"ingress-canary-n6ch9\" (UID: \"0dae7c84-8ff6-4dc5-9be3-335624c6bec2\") " pod="openshift-ingress-canary/ingress-canary-n6ch9"
Jul 16 08:55:40.510258 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.510169    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.510258 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.510192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-config-volume\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.510258 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.510215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nwm\" (UniqueName: \"kubernetes.io/projected/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-kube-api-access-k6nwm\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.510504 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.510450    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-tmp-dir\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.510504 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:40.510475    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 08:55:40.510622 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:40.510555    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls podName:c70363bf-a2fc-4ea1-8ec5-20fc52e40198 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:41.010515879 +0000 UTC m=+36.562548600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls") pod "dns-default-jmg7x" (UID: "c70363bf-a2fc-4ea1-8ec5-20fc52e40198") : secret "dns-default-metrics-tls" not found
Jul 16 08:55:40.510994 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.510970    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-config-volume\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.515135 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.515106    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dae7c84-8ff6-4dc5-9be3-335624c6bec2-cert\") pod \"ingress-canary-n6ch9\" (UID: \"0dae7c84-8ff6-4dc5-9be3-335624c6bec2\") " pod="openshift-ingress-canary/ingress-canary-n6ch9"
Jul 16 08:55:40.521468 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.521445    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nwm\" (UniqueName: \"kubernetes.io/projected/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-kube-api-access-k6nwm\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:40.521615 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.521466    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prkwf\" (UniqueName: \"kubernetes.io/projected/0dae7c84-8ff6-4dc5-9be3-335624c6bec2-kube-api-access-prkwf\") pod \"ingress-canary-n6ch9\" (UID: \"0dae7c84-8ff6-4dc5-9be3-335624c6bec2\") " pod="openshift-ingress-canary/ingress-canary-n6ch9"
Jul 16 08:55:40.612037 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.612020    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n6ch9"
Jul 16 08:55:40.761633 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.761555    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n6ch9"]
Jul 16 08:55:40.767000 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:40.766973    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dae7c84_8ff6_4dc5_9be3_335624c6bec2.slice/crio-f6210414a89f413d03cdb16c300a08abd0dd53ef4403d98a62b359c63d55abe1 WatchSource:0}: Error finding container f6210414a89f413d03cdb16c300a08abd0dd53ef4403d98a62b359c63d55abe1: Status 404 returned error can't find the container with id f6210414a89f413d03cdb16c300a08abd0dd53ef4403d98a62b359c63d55abe1
Jul 16 08:55:40.965425 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.965384    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:55:40.965425 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.965412    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:55:40.968332 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.968206    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 08:55:40.968332 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.968220    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 08:55:40.968332 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.968236    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 08:55:40.968332 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:40.968283    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rgclf\""
Jul 16 08:55:41.014330 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:41.014251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:41.014473 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:41.014359    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 08:55:41.014473 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:41.014412    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls podName:c70363bf-a2fc-4ea1-8ec5-20fc52e40198 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:42.014397682 +0000 UTC m=+37.566430385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls") pod "dns-default-jmg7x" (UID: "c70363bf-a2fc-4ea1-8ec5-20fc52e40198") : secret "dns-default-metrics-tls" not found
Jul 16 08:55:41.263610 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:41.263574    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n6ch9" event={"ID":"0dae7c84-8ff6-4dc5-9be3-335624c6bec2","Type":"ContainerStarted","Data":"f6210414a89f413d03cdb16c300a08abd0dd53ef4403d98a62b359c63d55abe1"}
Jul 16 08:55:41.266131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:41.266059    2570 generic.go:356] "Generic (PLEG): container finished" podID="72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2" containerID="06c51447aa3c4702ce84e0716a6857cdfd97ff55068babd13b70c9450b5ea545" exitCode=0
Jul 16 08:55:41.266131 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:41.266095    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5g9k" event={"ID":"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2","Type":"ContainerDied","Data":"06c51447aa3c4702ce84e0716a6857cdfd97ff55068babd13b70c9450b5ea545"}
Jul 16 08:55:41.966047 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:41.965847    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:55:41.968621 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:41.968597    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 08:55:41.968621 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:41.968607    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s7ks4\""
Jul 16 08:55:42.021638 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:42.021613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:42.021815 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:42.021733    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 08:55:42.021815 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:42.021784    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls podName:c70363bf-a2fc-4ea1-8ec5-20fc52e40198 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:44.021770533 +0000 UTC m=+39.573803237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls") pod "dns-default-jmg7x" (UID: "c70363bf-a2fc-4ea1-8ec5-20fc52e40198") : secret "dns-default-metrics-tls" not found
Jul 16 08:55:42.271172 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:42.271096    2570 generic.go:356] "Generic (PLEG): container finished" podID="72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2" containerID="58678fde2872c8b9068d01b2961a9aba3e82f1dd0fcdff5e9f2e28919db3ecb6" exitCode=0
Jul 16 08:55:42.271172 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:42.271138    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5g9k" event={"ID":"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2","Type":"ContainerDied","Data":"58678fde2872c8b9068d01b2961a9aba3e82f1dd0fcdff5e9f2e28919db3ecb6"}
Jul 16 08:55:43.277454 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:43.277417    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5g9k" event={"ID":"72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2","Type":"ContainerStarted","Data":"55c5b4a28d458d57b2bfc85264013a7e275503dddc228da272f7e09fc2b39e6f"}
Jul 16 08:55:43.300011 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:43.299966    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p5g9k" podStartSLOduration=10.255278861 podStartE2EDuration="39.299949823s" totalImagesPullingTime="29.044670962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:43.299395944 +0000 UTC m=+38.851428669" watchObservedRunningTime="2026-07-16 08:55:43.299949823 +0000 UTC m=+38.851982548"
Jul 16 08:55:43.423076 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:43.423045    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:43.479424 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:43.479391    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:44.037330 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:44.037296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:44.037499 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:44.037445    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 08:55:44.037558 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:44.037509    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls podName:c70363bf-a2fc-4ea1-8ec5-20fc52e40198 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:48.037493051 +0000 UTC m=+43.589525755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls") pod "dns-default-jmg7x" (UID: "c70363bf-a2fc-4ea1-8ec5-20fc52e40198") : secret "dns-default-metrics-tls" not found
Jul 16 08:55:44.281623 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:44.281590    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n6ch9" event={"ID":"0dae7c84-8ff6-4dc5-9be3-335624c6bec2","Type":"ContainerStarted","Data":"70a528bb77d7ddfbb09fdf3ae81d500abcb81ea554e944f3cc4ab68490abcadf"}
Jul 16 08:55:44.305718 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:44.305627    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n6ch9" podStartSLOduration=1.6785901970000001 podStartE2EDuration="4.305612506s" totalImagesPullingTime="2.627022309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:44.305334248 +0000 UTC m=+39.857366975" watchObservedRunningTime="2026-07-16 08:55:44.305612506 +0000 UTC m=+39.857645232"
Jul 16 08:55:45.190308 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:45.190268    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:45.245345 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:45.245311    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:46.684616 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.684578    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9"]
Jul 16 08:55:46.718068 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.718033    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9"]
Jul 16 08:55:46.718214 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.718147    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9"
Jul 16 08:55:46.720930 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.720903    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 16 08:55:46.721083 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.720955    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 16 08:55:46.721083 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.721025    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6tw9x\""
Jul 16 08:55:46.778215 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.778183    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"]
Jul 16 08:55:46.799909 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.799881    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-84d56f759d-97tbg"]
Jul 16 08:55:46.800069 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.799995    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:55:46.802659 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.802630    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 16 08:55:46.802659 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.802638    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 16 08:55:46.802825 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.802643    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 16 08:55:46.802825 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.802766    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ndb5n\""
Jul 16 08:55:46.826150 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.826124    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"]
Jul 16 08:55:46.826277 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.826160    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84d56f759d-97tbg"]
Jul 16 08:55:46.826277 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.826235    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:46.828851 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.828830    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 08:55:46.828982 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.828866    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xbxfv\""
Jul 16 08:55:46.828982 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.828830    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 16 08:55:46.828982 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.828959    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 08:55:46.829269 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.829253    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 16 08:55:46.829269 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.829264    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 16 08:55:46.829334 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.829252    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 16 08:55:46.859925 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.859896    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ww98\" (UniqueName: \"kubernetes.io/projected/7f683e99-b047-420d-94da-a2657e6ad1be-kube-api-access-4ww98\") pod \"volume-data-source-validator-78495597f6-sfmc9\" (UID: \"7f683e99-b047-420d-94da-a2657e6ad1be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9"
Jul 16 08:55:46.881244 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.881219    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"]
Jul 16 08:55:46.902072 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.902047    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"]
Jul 16 08:55:46.902186 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.902169    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:55:46.904638 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.904621    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 08:55:46.904736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.904623    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 08:55:46.904736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.904696    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cxtgm\""
Jul 16 08:55:46.961157 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.961091    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:46.961157 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.961123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24scd\" (UniqueName: \"kubernetes.io/projected/d5a16205-7466-42d6-9601-f698f14abcc6-kube-api-access-24scd\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:46.961157 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.961151    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:55:46.961341 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.961225    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-default-certificate\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:46.961341 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.961256    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:46.961341 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.961274    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-stats-auth\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:46.961341 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.961295    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt2jz\" (UniqueName: \"kubernetes.io/projected/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-kube-api-access-qt2jz\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:55:46.961341 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.961316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ww98\" (UniqueName: \"kubernetes.io/projected/7f683e99-b047-420d-94da-a2657e6ad1be-kube-api-access-4ww98\") pod \"volume-data-source-validator-78495597f6-sfmc9\" (UID: \"7f683e99-b047-420d-94da-a2657e6ad1be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9"
Jul 16 08:55:46.972422 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:46.972391    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ww98\" (UniqueName: \"kubernetes.io/projected/7f683e99-b047-420d-94da-a2657e6ad1be-kube-api-access-4ww98\") pod \"volume-data-source-validator-78495597f6-sfmc9\" (UID: \"7f683e99-b047-420d-94da-a2657e6ad1be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9"
Jul 16 08:55:47.018235 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.018204    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:47.026996 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.026974    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9"
Jul 16 08:55:47.061833 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.061804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-default-certificate\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:47.061922 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.061873    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:47.061995 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.061977    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-stats-auth\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:47.062054 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.062018    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:47.561994746 +0000 UTC m=+43.114027451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : configmap references non-existent config key: service-ca.crt
Jul 16 08:55:47.062114 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.062051    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt2jz\" (UniqueName: \"kubernetes.io/projected/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-kube-api-access-qt2jz\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:55:47.062114 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.062082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8576da94-49b6-4d18-b03a-686eb7b48903-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:55:47.062203 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.062132    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:47.062203 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.062161    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24scd\" (UniqueName: \"kubernetes.io/projected/d5a16205-7466-42d6-9601-f698f14abcc6-kube-api-access-24scd\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:47.062203 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.062193    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:55:47.062336 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.062232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:55:47.062336 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.062301    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 08:55:47.062426 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.062370    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls podName:8cb9a1ef-68c0-47ed-9ded-2e730d7fb493 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:47.562352107 +0000 UTC m=+43.114384817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls") pod "cluster-samples-operator-65db858894-wgnkg" (UID: "8cb9a1ef-68c0-47ed-9ded-2e730d7fb493") : secret "samples-operator-tls" not found
Jul 16 08:55:47.062493 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.062463    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 08:55:47.062560 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.062520    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:47.562506085 +0000 UTC m=+43.114538789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : secret "router-metrics-certs-default" not found
Jul 16 08:55:47.064578 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.064556    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-stats-auth\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:47.064693 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.064656    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-default-certificate\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:47.073263 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.073232    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24scd\" (UniqueName: \"kubernetes.io/projected/d5a16205-7466-42d6-9601-f698f14abcc6-kube-api-access-24scd\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:47.073361 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.073336    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt2jz\" (UniqueName: \"kubernetes.io/projected/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-kube-api-access-qt2jz\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:55:47.119680 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.119644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:47.163176 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.163147    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8576da94-49b6-4d18-b03a-686eb7b48903-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:55:47.163315 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.163223    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:55:47.163365 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.163344    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 08:55:47.163437 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.163426    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert podName:8576da94-49b6-4d18-b03a-686eb7b48903 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:47.663404353 +0000 UTC m=+43.215437281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4n9v5" (UID: "8576da94-49b6-4d18-b03a-686eb7b48903") : secret "networking-console-plugin-cert" not found
Jul 16 08:55:47.163910 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.163894    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8576da94-49b6-4d18-b03a-686eb7b48903-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:55:47.176952 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.176926    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9"]
Jul 16 08:55:47.180587 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:47.180565    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f683e99_b047_420d_94da_a2657e6ad1be.slice/crio-100c02a387f656367e0231cebbfa70a7bd0b7bcc4db4471fadeda8c76cb866ec WatchSource:0}: Error finding container 100c02a387f656367e0231cebbfa70a7bd0b7bcc4db4471fadeda8c76cb866ec: Status 404 returned error can't find the container with id 100c02a387f656367e0231cebbfa70a7bd0b7bcc4db4471fadeda8c76cb866ec
Jul 16 08:55:47.292917 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.292838    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9" event={"ID":"7f683e99-b047-420d-94da-a2657e6ad1be","Type":"ContainerStarted","Data":"100c02a387f656367e0231cebbfa70a7bd0b7bcc4db4471fadeda8c76cb866ec"}
Jul 16 08:55:47.570679 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.570645    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:47.570826 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.570694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:55:47.570826 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.570778    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:47.570826 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.570789    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 08:55:47.570924 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.570856    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 08:55:47.570924 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.570864    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:48.570845214 +0000 UTC m=+44.122877937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : secret "router-metrics-certs-default" not found
Jul 16 08:55:47.570924 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.570918    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:48.570905588 +0000 UTC m=+44.122938294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : configmap references non-existent config key: service-ca.crt
Jul 16 08:55:47.571025 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.570930    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls podName:8cb9a1ef-68c0-47ed-9ded-2e730d7fb493 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:48.570924256 +0000 UTC m=+44.122956960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls") pod "cluster-samples-operator-65db858894-wgnkg" (UID: "8cb9a1ef-68c0-47ed-9ded-2e730d7fb493") : secret "samples-operator-tls" not found
Jul 16 08:55:47.671715 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:47.671679    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:55:47.671848 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.671831    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 08:55:47.671909 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:47.671899    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert podName:8576da94-49b6-4d18-b03a-686eb7b48903 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:48.671883607 +0000 UTC m=+44.223916321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4n9v5" (UID: "8576da94-49b6-4d18-b03a-686eb7b48903") : secret "networking-console-plugin-cert" not found
Jul 16 08:55:48.074702 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:48.074670    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:48.075052 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:48.074824    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 08:55:48.075052 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:48.074886    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls podName:c70363bf-a2fc-4ea1-8ec5-20fc52e40198 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:56.074872028 +0000 UTC m=+51.626904737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls") pod "dns-default-jmg7x" (UID: "c70363bf-a2fc-4ea1-8ec5-20fc52e40198") : secret "dns-default-metrics-tls" not found
Jul 16 08:55:48.551849 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:48.551752    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:48.578819 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:48.578780    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:48.579014 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:48.578860    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:48.579014 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:48.578894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:55:48.579112 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:48.579026    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 08:55:48.579112 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:48.579051    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:50.579031692 +0000 UTC m=+46.131064402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : configmap references non-existent config key: service-ca.crt
Jul 16 08:55:48.579112 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:48.579076    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:50.579060145 +0000 UTC m=+46.131092850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : secret "router-metrics-certs-default" not found
Jul 16 08:55:48.579112 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:48.579078    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 08:55:48.579289 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:48.579123    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls podName:8cb9a1ef-68c0-47ed-9ded-2e730d7fb493 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:50.57911215 +0000 UTC m=+46.131144853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls") pod "cluster-samples-operator-65db858894-wgnkg" (UID: "8cb9a1ef-68c0-47ed-9ded-2e730d7fb493") : secret "samples-operator-tls" not found
Jul 16 08:55:48.653423 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:48.653371    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:48.679707 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:48.679671    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:55:48.679882 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:48.679818    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 08:55:48.679882 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:48.679880    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert podName:8576da94-49b6-4d18-b03a-686eb7b48903 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:50.679861212 +0000 UTC m=+46.231893917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4n9v5" (UID: "8576da94-49b6-4d18-b03a-686eb7b48903") : secret "networking-console-plugin-cert" not found
Jul 16 08:55:49.299566 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:49.299513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9" event={"ID":"7f683e99-b047-420d-94da-a2657e6ad1be","Type":"ContainerStarted","Data":"c67062101c0a97da1af12ff5640079b4c947b60895acac1fef317d651277aab0"}
Jul 16 08:55:49.315172 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:49.315122    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sfmc9" podStartSLOduration=1.41209088 podStartE2EDuration="3.315108139s" totalImagesPullingTime="1.903017259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:49.314458445 +0000 UTC m=+44.866491170" watchObservedRunningTime="2026-07-16 08:55:49.315108139 +0000 UTC m=+44.867140865"
Jul 16 08:55:49.458271 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:49.458185    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:49.554365 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:49.554330    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:50.592912 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:50.592872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:50.593310 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:50.592927    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:50.593310 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:50.592950    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:55:50.593310 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:50.593041    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:54.593018563 +0000 UTC m=+50.145051273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : configmap references non-existent config key: service-ca.crt
Jul 16 08:55:50.593310 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:50.593089    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 08:55:50.593310 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:50.593131    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:54.593118117 +0000 UTC m=+50.145150833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : secret "router-metrics-certs-default" not found
Jul 16 08:55:50.593310 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:50.593090    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 08:55:50.593310 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:50.593173    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls podName:8cb9a1ef-68c0-47ed-9ded-2e730d7fb493 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:54.593163917 +0000 UTC m=+50.145196624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls") pod "cluster-samples-operator-65db858894-wgnkg" (UID: "8cb9a1ef-68c0-47ed-9ded-2e730d7fb493") : secret "samples-operator-tls" not found
Jul 16 08:55:50.693332 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:50.693293    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:55:50.693503 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:50.693431    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 08:55:50.693503 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:50.693491    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert podName:8576da94-49b6-4d18-b03a-686eb7b48903 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:54.693476632 +0000 UTC m=+50.245509335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4n9v5" (UID: "8576da94-49b6-4d18-b03a-686eb7b48903") : secret "networking-console-plugin-cert" not found
Jul 16 08:55:51.760364 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.760333    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:51.875122 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.875088    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jvc28"]
Jul 16 08:55:51.889123 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.889052    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:51.919231 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.919204    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jvc28"]
Jul 16 08:55:51.919355 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.919298    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:51.921951 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.921928    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 08:55:51.922090 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.921928    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 08:55:51.922090 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.921932    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 08:55:51.922090 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.921975    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b8kz8\""
Jul 16 08:55:51.922090 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.921988    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 08:55:51.964329 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:51.964276    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:52.003597 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.003566    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.003722 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.003636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da173879-80bb-4c14-bfa5-a87e770ebaee-data-volume\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.003722 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.003682    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da173879-80bb-4c14-bfa5-a87e770ebaee-crio-socket\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.003722 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.003709    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.003821 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.003734    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8szz\" (UniqueName: \"kubernetes.io/projected/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-api-access-l8szz\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.037573 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.037477    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:52.104518 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.104486    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.104651 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.104569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da173879-80bb-4c14-bfa5-a87e770ebaee-data-volume\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.104651 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.104610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da173879-80bb-4c14-bfa5-a87e770ebaee-crio-socket\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.104651 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.104630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.104651 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:52.104630    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 08:55:52.104840 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:52.104685    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:55:52.60467273 +0000 UTC m=+48.156705435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : secret "insights-runtime-extractor-tls" not found
Jul 16 08:55:52.104840 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:52.104737    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 08:55:52.104840 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.104778    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8szz\" (UniqueName: \"kubernetes.io/projected/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-api-access-l8szz\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.104840 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:52.104805    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:55:52.604785424 +0000 UTC m=+48.156818143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : configmap "kube-rbac-proxy" not found
Jul 16 08:55:52.104840 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.104786    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da173879-80bb-4c14-bfa5-a87e770ebaee-crio-socket\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.105075 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.104883    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da173879-80bb-4c14-bfa5-a87e770ebaee-data-volume\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.115290 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.115272    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8szz\" (UniqueName: \"kubernetes.io/projected/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-api-access-l8szz\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.454520 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.454480    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:52.510544 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.510507    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:52.607684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.607646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.607853 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.607748    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:52.607853 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:52.607804    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 08:55:52.607853 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:52.607814    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 08:55:52.607951 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:52.607871    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:55:53.607852513 +0000 UTC m=+49.159885431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : configmap "kube-rbac-proxy" not found
Jul 16 08:55:52.607951 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:52.607884    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:55:53.607878776 +0000 UTC m=+49.159911479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : secret "insights-runtime-extractor-tls" not found
Jul 16 08:55:52.727063 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.726981    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:52.825750 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.825722    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:52.918204 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:52.918167    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:53.616203 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:53.616167    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:53.616398 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:53.616249    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:53.616398 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:53.616297    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 08:55:53.616398 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:53.616361    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:55:55.616346099 +0000 UTC m=+51.168378805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : configmap "kube-rbac-proxy" not found
Jul 16 08:55:53.616590 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:53.616413    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 08:55:53.616590 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:53.616484    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:55:55.616466614 +0000 UTC m=+51.168499337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : secret "insights-runtime-extractor-tls" not found
Jul 16 08:55:54.055560 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.055466    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s27fh_1c804ded-6c2b-48c6-b551-2cdde96f775a/dns-node-resolver/0.log"
Jul 16 08:55:54.623643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.623602    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:54.623643 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.623643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:55:54.623904 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.623718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:55:54.623904 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:54.623778    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 08:55:54.623904 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:54.623815    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 08:55:54.623904 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:54.623825    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:02.623812372 +0000 UTC m=+58.175845076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : configmap references non-existent config key: service-ca.crt
Jul 16 08:55:54.623904 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:54.623840    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:02.623832957 +0000 UTC m=+58.175865661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : secret "router-metrics-certs-default" not found
Jul 16 08:55:54.623904 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:54.623849    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls podName:8cb9a1ef-68c0-47ed-9ded-2e730d7fb493 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:02.623844543 +0000 UTC m=+58.175877246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls") pod "cluster-samples-operator-65db858894-wgnkg" (UID: "8cb9a1ef-68c0-47ed-9ded-2e730d7fb493") : secret "samples-operator-tls" not found
Jul 16 08:55:54.659275 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.659242    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2mpmb_36d590a8-21ff-4ae1-912c-548319c0559c/node-ca/0.log"
Jul 16 08:55:54.724464 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.724432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:55:54.724623 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:54.724588    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 08:55:54.724666 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:54.724649    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert podName:8576da94-49b6-4d18-b03a-686eb7b48903 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:02.724634366 +0000 UTC m=+58.276667070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4n9v5" (UID: "8576da94-49b6-4d18-b03a-686eb7b48903") : secret "networking-console-plugin-cert" not found
Jul 16 08:55:54.727085 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.727064    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kn29l"]
Jul 16 08:55:54.744036 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.744016    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:54.747025 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.747006    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 16 08:55:54.747995 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.747965    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 16 08:55:54.748116 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.748040    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2dptz\""
Jul 16 08:55:54.748215 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.748185    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 16 08:55:54.748449 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.748433    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 16 08:55:54.749514 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.749495    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kn29l"]
Jul 16 08:55:54.824739 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.824704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4044915a-92be-4409-a3d5-cd92e73c6fcf-signing-cabundle\") pod \"service-ca-79f68b9f4f-kn29l\" (UID: \"4044915a-92be-4409-a3d5-cd92e73c6fcf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:54.824879 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.824828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4044915a-92be-4409-a3d5-cd92e73c6fcf-signing-key\") pod \"service-ca-79f68b9f4f-kn29l\" (UID: \"4044915a-92be-4409-a3d5-cd92e73c6fcf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:54.824953 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.824884    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzbmm\" (UniqueName: \"kubernetes.io/projected/4044915a-92be-4409-a3d5-cd92e73c6fcf-kube-api-access-mzbmm\") pod \"service-ca-79f68b9f4f-kn29l\" (UID: \"4044915a-92be-4409-a3d5-cd92e73c6fcf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:54.847560 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.847508    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:54.917121 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.917033    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:54.925609 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.925588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4044915a-92be-4409-a3d5-cd92e73c6fcf-signing-cabundle\") pod \"service-ca-79f68b9f4f-kn29l\" (UID: \"4044915a-92be-4409-a3d5-cd92e73c6fcf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:54.925732 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.925654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4044915a-92be-4409-a3d5-cd92e73c6fcf-signing-key\") pod \"service-ca-79f68b9f4f-kn29l\" (UID: \"4044915a-92be-4409-a3d5-cd92e73c6fcf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:54.925732 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.925698    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzbmm\" (UniqueName: \"kubernetes.io/projected/4044915a-92be-4409-a3d5-cd92e73c6fcf-kube-api-access-mzbmm\") pod \"service-ca-79f68b9f4f-kn29l\" (UID: \"4044915a-92be-4409-a3d5-cd92e73c6fcf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:54.926285 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.926265    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4044915a-92be-4409-a3d5-cd92e73c6fcf-signing-cabundle\") pod \"service-ca-79f68b9f4f-kn29l\" (UID: \"4044915a-92be-4409-a3d5-cd92e73c6fcf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:54.927901 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.927884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4044915a-92be-4409-a3d5-cd92e73c6fcf-signing-key\") pod \"service-ca-79f68b9f4f-kn29l\" (UID: \"4044915a-92be-4409-a3d5-cd92e73c6fcf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:54.936216 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:54.936194    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzbmm\" (UniqueName: \"kubernetes.io/projected/4044915a-92be-4409-a3d5-cd92e73c6fcf-kube-api-access-mzbmm\") pod \"service-ca-79f68b9f4f-kn29l\" (UID: \"4044915a-92be-4409-a3d5-cd92e73c6fcf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:55.024365 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:55.024336    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:55.054323 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:55.054296    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l"
Jul 16 08:55:55.127225 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:55.127185    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:55.184673 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:55.184619    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-kn29l"]
Jul 16 08:55:55.187052 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:55:55.187025    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4044915a_92be_4409_a3d5_cd92e73c6fcf.slice/crio-322d418801b12354130fc0508f11f960b15d121aa06988a1d8157d9a159e97ea WatchSource:0}: Error finding container 322d418801b12354130fc0508f11f960b15d121aa06988a1d8157d9a159e97ea: Status 404 returned error can't find the container with id 322d418801b12354130fc0508f11f960b15d121aa06988a1d8157d9a159e97ea
Jul 16 08:55:55.315238 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:55.315203    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l" event={"ID":"4044915a-92be-4409-a3d5-cd92e73c6fcf","Type":"ContainerStarted","Data":"322d418801b12354130fc0508f11f960b15d121aa06988a1d8157d9a159e97ea"}
Jul 16 08:55:55.631380 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:55.631347    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:55.631614 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:55.631442    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:55.631614 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:55.631510    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 08:55:55.631614 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:55.631528    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 08:55:55.631614 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:55.631589    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:55:59.631575341 +0000 UTC m=+55.183608045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : configmap "kube-rbac-proxy" not found
Jul 16 08:55:55.631614 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:55.631615    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:55:59.63159529 +0000 UTC m=+55.183628008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : secret "insights-runtime-extractor-tls" not found
Jul 16 08:55:55.843721 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:55.843681    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:55.856394 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:55.856366    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n6ch9_0dae7c84-8ff6-4dc5-9be3-335624c6bec2/serve-healthcheck-canary/0.log"
Jul 16 08:55:56.135078 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:56.135039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:55:56.135557 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:56.135200    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 08:55:56.135557 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:56.135265    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls podName:c70363bf-a2fc-4ea1-8ec5-20fc52e40198 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:12.13524857 +0000 UTC m=+67.687281274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls") pod "dns-default-jmg7x" (UID: "c70363bf-a2fc-4ea1-8ec5-20fc52e40198") : secret "dns-default-metrics-tls" not found
Jul 16 08:55:58.561137 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:58.561100    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:55:59.326398 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:59.326356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l" event={"ID":"4044915a-92be-4409-a3d5-cd92e73c6fcf","Type":"ContainerStarted","Data":"5a177437f6d32f82ec8718776898b563559559123fa51faca741db6a65bb4c97"}
Jul 16 08:55:59.355794 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:59.355739    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-kn29l" podStartSLOduration=1.895797139 podStartE2EDuration="5.35571906s" totalImagesPullingTime="3.459921921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:59.355326831 +0000 UTC m=+54.907359558" watchObservedRunningTime="2026-07-16 08:55:59.35571906 +0000 UTC m=+54.907751787"
Jul 16 08:55:59.664144 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:59.664060    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:59.664144 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:55:59.664127    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:55:59.664510 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:59.664203    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 08:55:59.664510 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:59.664246    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 08:55:59.664510 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:59.664284    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:56:07.664263273 +0000 UTC m=+63.216295980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : configmap "kube-rbac-proxy" not found
Jul 16 08:55:59.664510 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:55:59.664303    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:56:07.664293631 +0000 UTC m=+63.216326338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : secret "insights-runtime-extractor-tls" not found
Jul 16 08:56:00.193179 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:00.193131    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:00.403083 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:00.403042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:00.598886 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:00.598848    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:00.697717 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:00.697684    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:00.797297 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:00.797241    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:00.900756 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:00.900657    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:01.923152 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:01.923116    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:02.289151 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.289059    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:02.498218 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.498173    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:02.690168 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.690129    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:02.690346 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.690219    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:02.690346 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.690256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:56:02.690346 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:02.690306    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:18.690281544 +0000 UTC m=+74.242314248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : configmap references non-existent config key: service-ca.crt
Jul 16 08:56:02.690482 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:02.690355    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 08:56:02.690482 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:02.690424    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs podName:d5a16205-7466-42d6-9601-f698f14abcc6 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:18.690408685 +0000 UTC m=+74.242441406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs") pod "router-default-84d56f759d-97tbg" (UID: "d5a16205-7466-42d6-9601-f698f14abcc6") : secret "router-metrics-certs-default" not found
Jul 16 08:56:02.692708 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.692685    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb9a1ef-68c0-47ed-9ded-2e730d7fb493-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wgnkg\" (UID: \"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:56:02.704681 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.704652    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:02.709493 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.709472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"
Jul 16 08:56:02.791255 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.791131    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:56:02.791386 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:02.791312    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 08:56:02.791447 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:02.791392    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert podName:8576da94-49b6-4d18-b03a-686eb7b48903 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:18.791371555 +0000 UTC m=+74.343404274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4n9v5" (UID: "8576da94-49b6-4d18-b03a-686eb7b48903") : secret "networking-console-plugin-cert" not found
Jul 16 08:56:02.831138 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.831110    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg"]
Jul 16 08:56:02.888105 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:02.888065    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:03.337221 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:03.337186    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg" event={"ID":"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493","Type":"ContainerStarted","Data":"d00a1c674e83b542c4a0b0039d620f2066ea4e0a6f8e4af9e206b43f91bfec3e"}
Jul 16 08:56:03.880676 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:03.880639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:03.980869 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:03.980829    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:04.088761 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:04.088726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:04.290093 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:04.289969    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:04.488781 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:04.488747    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:05.346139 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:05.346107    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg" event={"ID":"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493","Type":"ContainerStarted","Data":"355da1aa58a3a9ac8d6b39417044048af7181712037f8100e8913f3ac4a89d30"}
Jul 16 08:56:05.346286 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:05.346157    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg" event={"ID":"8cb9a1ef-68c0-47ed-9ded-2e730d7fb493","Type":"ContainerStarted","Data":"53a886d476fe0dbfc4bb58a472db170b8f581fb4a638e7ffbddeeb0c682261bc"}
Jul 16 08:56:05.362109 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:05.362057    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wgnkg" podStartSLOduration=17.206430104 podStartE2EDuration="19.362042948s" totalImagesPullingTime="2.155612844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:05.361699338 +0000 UTC m=+60.913732065" watchObservedRunningTime="2026-07-16 08:56:05.362042948 +0000 UTC m=+60.914075674"
Jul 16 08:56:05.557004 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:05.556967    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:05.617325 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:05.617235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:06.092600 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:06.092567    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:06.286865 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:06.286816    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:06.435644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:06.435560    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:06.535058 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:06.535014    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:06.684427 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:06.684387    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:06.887280 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:06.887241    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:07.700325 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:07.700291    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:07.731261 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:07.731230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:56:07.731435 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:07.731289    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:56:07.731435 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:07.731382    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 08:56:07.731435 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:07.731432    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls podName:da173879-80bb-4c14-bfa5-a87e770ebaee nodeName:}" failed. No retries permitted until 2026-07-16 08:56:23.731418525 +0000 UTC m=+79.283451228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jvc28" (UID: "da173879-80bb-4c14-bfa5-a87e770ebaee") : secret "insights-runtime-extractor-tls" not found
Jul 16 08:56:07.731868 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:07.731843    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da173879-80bb-4c14-bfa5-a87e770ebaee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:56:08.102594 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:08.102557    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:08.495559 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:08.495452    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:08.691972 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:08.691935    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:08.998956 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:08.998918    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:09.100727 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:09.100688    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:09.699065 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:09.699029    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:10.288098 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.288069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:10.490520 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.490487    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:10.652388 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.652357    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7tw\" (UniqueName: \"kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw\") pod \"network-check-target-c4f2k\" (UID: \"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988\") " pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:56:10.652622 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.652409    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:56:10.654745 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.654728    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 08:56:10.654891 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.654877    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 08:56:10.665140 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.665115    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96702d5b-3be0-4729-9ddb-022b16b20cd1-metrics-certs\") pod \"network-metrics-daemon-l78hg\" (UID: \"96702d5b-3be0-4729-9ddb-022b16b20cd1\") " pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:56:10.665268 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.665252    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 08:56:10.675446 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.675421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd7tw\" (UniqueName: \"kubernetes.io/projected/da8c6ed6-dc5a-48b3-bf03-8b8dccdac988-kube-api-access-rd7tw\") pod \"network-check-target-c4f2k\" (UID: \"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988\") " pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:56:10.682017 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.682002    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rgclf\""
Jul 16 08:56:10.690758 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.690746    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:56:10.694706 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.694681    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:10.752835 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.752804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:56:10.755395 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.755379    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 08:56:10.765637 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.765606    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bcb10aa-9fbd-4739-9033-498353921729-original-pull-secret\") pod \"global-pull-secret-syncer-75242\" (UID: \"4bcb10aa-9fbd-4739-9033-498353921729\") " pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:56:10.777852 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.777830    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s7ks4\""
Jul 16 08:56:10.786725 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.786703    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hg"
Jul 16 08:56:10.844808 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.844768    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c4f2k"]
Jul 16 08:56:10.847565 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:56:10.847509    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8c6ed6_dc5a_48b3_bf03_8b8dccdac988.slice/crio-3983d60088c8d55b8d108b0ebc78fb044e9f2bf2950f52ea349ee2516c0d8637 WatchSource:0}: Error finding container 3983d60088c8d55b8d108b0ebc78fb044e9f2bf2950f52ea349ee2516c0d8637: Status 404 returned error can't find the container with id 3983d60088c8d55b8d108b0ebc78fb044e9f2bf2950f52ea349ee2516c0d8637
Jul 16 08:56:10.884815 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.884783    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:10.940120 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.940046    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l78hg"]
Jul 16 08:56:10.942969 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:56:10.942944    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96702d5b_3be0_4729_9ddb_022b16b20cd1.slice/crio-23453f8922def9a73b98483c6ca3417b765b0feae1407dafb603fdda281192ce WatchSource:0}: Error finding container 23453f8922def9a73b98483c6ca3417b765b0feae1407dafb603fdda281192ce: Status 404 returned error can't find the container with id 23453f8922def9a73b98483c6ca3417b765b0feae1407dafb603fdda281192ce
Jul 16 08:56:10.974939 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:10.974910    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75242"
Jul 16 08:56:11.117247 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:11.117222    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-75242"]
Jul 16 08:56:11.119443 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:56:11.119419    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bcb10aa_9fbd_4739_9033_498353921729.slice/crio-3722d34eba463b21e97d34aab04946a2704a53eca5d0dcde3ca30fc9e7dbee5f WatchSource:0}: Error finding container 3722d34eba463b21e97d34aab04946a2704a53eca5d0dcde3ca30fc9e7dbee5f: Status 404 returned error can't find the container with id 3722d34eba463b21e97d34aab04946a2704a53eca5d0dcde3ca30fc9e7dbee5f
Jul 16 08:56:11.365236 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:11.365193    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-75242" event={"ID":"4bcb10aa-9fbd-4739-9033-498353921729","Type":"ContainerStarted","Data":"3722d34eba463b21e97d34aab04946a2704a53eca5d0dcde3ca30fc9e7dbee5f"}
Jul 16 08:56:11.366518 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:11.366487    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l78hg" event={"ID":"96702d5b-3be0-4729-9ddb-022b16b20cd1","Type":"ContainerStarted","Data":"23453f8922def9a73b98483c6ca3417b765b0feae1407dafb603fdda281192ce"}
Jul 16 08:56:11.367688 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:11.367634    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c4f2k" event={"ID":"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988","Type":"ContainerStarted","Data":"3983d60088c8d55b8d108b0ebc78fb044e9f2bf2950f52ea349ee2516c0d8637"}
Jul 16 08:56:12.165449 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:12.165413    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:56:12.168070 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:12.168043    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70363bf-a2fc-4ea1-8ec5-20fc52e40198-metrics-tls\") pod \"dns-default-jmg7x\" (UID: \"c70363bf-a2fc-4ea1-8ec5-20fc52e40198\") " pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:56:12.409438 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:12.409410    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wm6pc\""
Jul 16 08:56:12.417062 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:12.417002    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:56:12.584650 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:12.584553    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jmg7x"]
Jul 16 08:56:12.587272 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:56:12.587225    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70363bf_a2fc_4ea1_8ec5_20fc52e40198.slice/crio-68ceb4ecfaef7098eb156533adaa8134f12c3f117a4a8130d0c018e063c4b383 WatchSource:0}: Error finding container 68ceb4ecfaef7098eb156533adaa8134f12c3f117a4a8130d0c018e063c4b383: Status 404 returned error can't find the container with id 68ceb4ecfaef7098eb156533adaa8134f12c3f117a4a8130d0c018e063c4b383
Jul 16 08:56:12.991570 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:12.991472    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:13.046125 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:13.046091    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:13.377811 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:13.377471    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l78hg" event={"ID":"96702d5b-3be0-4729-9ddb-022b16b20cd1","Type":"ContainerStarted","Data":"c99b9cc13d07c04b54d92b24127c207965d6f59028715d44eb09f318e93a86df"}
Jul 16 08:56:13.377811 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:13.377602    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l78hg" event={"ID":"96702d5b-3be0-4729-9ddb-022b16b20cd1","Type":"ContainerStarted","Data":"3fdd610bac056413c85327b3f29a17e9f0b51fdfe88338820a7e9e0ac87e5a2c"}
Jul 16 08:56:13.378772 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:13.378731    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jmg7x" event={"ID":"c70363bf-a2fc-4ea1-8ec5-20fc52e40198","Type":"ContainerStarted","Data":"68ceb4ecfaef7098eb156533adaa8134f12c3f117a4a8130d0c018e063c4b383"}
Jul 16 08:56:13.396565 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:13.396456    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l78hg" podStartSLOduration=67.977788388 podStartE2EDuration="1m9.396440712s" totalImagesPullingTime="1.418652324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:13.395368994 +0000 UTC m=+68.947401722" watchObservedRunningTime="2026-07-16 08:56:13.396440712 +0000 UTC m=+68.948473437"
Jul 16 08:56:14.384602 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:14.384489    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c4f2k" event={"ID":"da8c6ed6-dc5a-48b3-bf03-8b8dccdac988","Type":"ContainerStarted","Data":"a89bbebc1ac8df60e28596f454710d3e54c8709fdf52a831c0ec17461fca06aa"}
Jul 16 08:56:14.403743 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:14.403698    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c4f2k" podStartSLOduration=67.400363773 podStartE2EDuration="1m10.403681946s" totalImagesPullingTime="3.003318173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:14.403336667 +0000 UTC m=+69.955369393" watchObservedRunningTime="2026-07-16 08:56:14.403681946 +0000 UTC m=+69.955714671"
Jul 16 08:56:15.389813 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.389781    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:56:15.653081 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.653000    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"]
Jul 16 08:56:15.655068 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.655039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:15.658371 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.658346    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 08:56:15.658547 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.658512    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 16 08:56:15.659770 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.659752    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 08:56:15.659859 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.659794    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 08:56:15.668815 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.668750    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"]
Jul 16 08:56:15.689915 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.689886    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-774bcc56cf-k7mmz"]
Jul 16 08:56:15.691909 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.691887    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.695691 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.695671    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 08:56:15.695810 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.695792    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zggx9\""
Jul 16 08:56:15.696435 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.696417    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 08:56:15.697056 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.697036    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 08:56:15.701725 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.701702    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 08:56:15.710884 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.710862    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-774bcc56cf-k7mmz"]
Jul 16 08:56:15.796307 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796277    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/28644155-198d-4b53-93d4-d27ceeba1619-ca-trust-extracted\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.796566 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796316    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/28644155-198d-4b53-93d4-d27ceeba1619-image-registry-private-configuration\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.796566 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/28644155-198d-4b53-93d4-d27ceeba1619-installation-pull-secrets\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.796566 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796458    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/254715b9-d2eb-4a32-9903-64b40f0952e3-tmp\") pod \"klusterlet-addon-workmgr-5b848cd94b-qp99p\" (UID: \"254715b9-d2eb-4a32-9903-64b40f0952e3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:15.796773 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796590    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl8cj\" (UniqueName: \"kubernetes.io/projected/28644155-198d-4b53-93d4-d27ceeba1619-kube-api-access-zl8cj\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.796773 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/28644155-198d-4b53-93d4-d27ceeba1619-registry-certificates\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.796773 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796659    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28644155-198d-4b53-93d4-d27ceeba1619-bound-sa-token\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.796773 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796687    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9454\" (UniqueName: \"kubernetes.io/projected/254715b9-d2eb-4a32-9903-64b40f0952e3-kube-api-access-w9454\") pod \"klusterlet-addon-workmgr-5b848cd94b-qp99p\" (UID: \"254715b9-d2eb-4a32-9903-64b40f0952e3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:15.796773 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796715    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28644155-198d-4b53-93d4-d27ceeba1619-registry-tls\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.796986 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796823    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28644155-198d-4b53-93d4-d27ceeba1619-trusted-ca\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.796986 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.796935    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/254715b9-d2eb-4a32-9903-64b40f0952e3-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b848cd94b-qp99p\" (UID: \"254715b9-d2eb-4a32-9903-64b40f0952e3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:15.803312 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.803201    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:15.898054 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.897998    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/254715b9-d2eb-4a32-9903-64b40f0952e3-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b848cd94b-qp99p\" (UID: \"254715b9-d2eb-4a32-9903-64b40f0952e3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:15.898239 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/28644155-198d-4b53-93d4-d27ceeba1619-ca-trust-extracted\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.898239 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898116    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/28644155-198d-4b53-93d4-d27ceeba1619-image-registry-private-configuration\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.898239 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/28644155-198d-4b53-93d4-d27ceeba1619-installation-pull-secrets\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.898239 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898172    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/254715b9-d2eb-4a32-9903-64b40f0952e3-tmp\") pod \"klusterlet-addon-workmgr-5b848cd94b-qp99p\" (UID: \"254715b9-d2eb-4a32-9903-64b40f0952e3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:15.898239 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898203    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl8cj\" (UniqueName: \"kubernetes.io/projected/28644155-198d-4b53-93d4-d27ceeba1619-kube-api-access-zl8cj\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.898239 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/28644155-198d-4b53-93d4-d27ceeba1619-registry-certificates\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.898574 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28644155-198d-4b53-93d4-d27ceeba1619-bound-sa-token\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.898574 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898285    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9454\" (UniqueName: \"kubernetes.io/projected/254715b9-d2eb-4a32-9903-64b40f0952e3-kube-api-access-w9454\") pod \"klusterlet-addon-workmgr-5b848cd94b-qp99p\" (UID: \"254715b9-d2eb-4a32-9903-64b40f0952e3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:15.898574 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898308    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28644155-198d-4b53-93d4-d27ceeba1619-registry-tls\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.898574 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28644155-198d-4b53-93d4-d27ceeba1619-trusted-ca\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.898779 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898575    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/28644155-198d-4b53-93d4-d27ceeba1619-ca-trust-extracted\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.900035 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.899998    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/28644155-198d-4b53-93d4-d27ceeba1619-registry-certificates\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.900158 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.898585    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/254715b9-d2eb-4a32-9903-64b40f0952e3-tmp\") pod \"klusterlet-addon-workmgr-5b848cd94b-qp99p\" (UID: \"254715b9-d2eb-4a32-9903-64b40f0952e3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:15.900678 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.900517    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28644155-198d-4b53-93d4-d27ceeba1619-trusted-ca\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.901591 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.901348    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/28644155-198d-4b53-93d4-d27ceeba1619-installation-pull-secrets\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.901591 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.901439    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/254715b9-d2eb-4a32-9903-64b40f0952e3-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b848cd94b-qp99p\" (UID: \"254715b9-d2eb-4a32-9903-64b40f0952e3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:15.904560 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.901988    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/28644155-198d-4b53-93d4-d27ceeba1619-image-registry-private-configuration\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.904560 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.903008    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28644155-198d-4b53-93d4-d27ceeba1619-registry-tls\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.905835 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.905806    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:15.910525 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.910503    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28644155-198d-4b53-93d4-d27ceeba1619-bound-sa-token\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.910962 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.910927    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl8cj\" (UniqueName: \"kubernetes.io/projected/28644155-198d-4b53-93d4-d27ceeba1619-kube-api-access-zl8cj\") pod \"image-registry-774bcc56cf-k7mmz\" (UID: \"28644155-198d-4b53-93d4-d27ceeba1619\") " pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:15.911519 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.911499    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9454\" (UniqueName: \"kubernetes.io/projected/254715b9-d2eb-4a32-9903-64b40f0952e3-kube-api-access-w9454\") pod \"klusterlet-addon-workmgr-5b848cd94b-qp99p\" (UID: \"254715b9-d2eb-4a32-9903-64b40f0952e3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:15.966087 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:15.966024    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:16.002700 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:16.002668    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:16.005778 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:16.005715    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:16.563552 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:16.563435    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-774bcc56cf-k7mmz"]
Jul 16 08:56:16.567101 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:56:16.567071    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28644155_198d_4b53_93d4_d27ceeba1619.slice/crio-146f15a8eeadb50af0159c1ee0ae4b2e2df3a9f04f3ca90391f4d3cb80f8e35a WatchSource:0}: Error finding container 146f15a8eeadb50af0159c1ee0ae4b2e2df3a9f04f3ca90391f4d3cb80f8e35a: Status 404 returned error can't find the container with id 146f15a8eeadb50af0159c1ee0ae4b2e2df3a9f04f3ca90391f4d3cb80f8e35a
Jul 16 08:56:16.585906 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:16.585801    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"]
Jul 16 08:56:17.398098 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.398048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-75242" event={"ID":"4bcb10aa-9fbd-4739-9033-498353921729","Type":"ContainerStarted","Data":"ea316e0ceee35f7f24ea1e00781219913de51ba23a1b8912f3a8d661eb036b86"}
Jul 16 08:56:17.399174 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.399148    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p" event={"ID":"254715b9-d2eb-4a32-9903-64b40f0952e3","Type":"ContainerStarted","Data":"d4ec4e725f3cad354cbbe297548dc5e26284e45a50c273f8439388e61d929a54"}
Jul 16 08:56:17.400744 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.400720    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jmg7x" event={"ID":"c70363bf-a2fc-4ea1-8ec5-20fc52e40198","Type":"ContainerStarted","Data":"5093e244ae01884335162173ab95288b7bcc229027e8c234f447c5b41c62e003"}
Jul 16 08:56:17.400863 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.400764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jmg7x" event={"ID":"c70363bf-a2fc-4ea1-8ec5-20fc52e40198","Type":"ContainerStarted","Data":"ae99435940649a6577ffb244f5723f71b866d0eb1dad2efc25569fa1eea1b226"}
Jul 16 08:56:17.400863 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.400796    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:56:17.402064 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.402034    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz" event={"ID":"28644155-198d-4b53-93d4-d27ceeba1619","Type":"ContainerStarted","Data":"c1981b43ef1b7e0a9291de7a4bc40bd9b7f20c2739eceef25b368bd32b16848e"}
Jul 16 08:56:17.402173 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.402081    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz" event={"ID":"28644155-198d-4b53-93d4-d27ceeba1619","Type":"ContainerStarted","Data":"146f15a8eeadb50af0159c1ee0ae4b2e2df3a9f04f3ca90391f4d3cb80f8e35a"}
Jul 16 08:56:17.402173 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.402108    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:17.415492 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.415450    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-75242" podStartSLOduration=67.102366454 podStartE2EDuration="1m12.4154388s" totalImagesPullingTime="5.313072346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:17.414577106 +0000 UTC m=+72.966609831" watchObservedRunningTime="2026-07-16 08:56:17.4154388 +0000 UTC m=+72.967471504"
Jul 16 08:56:17.434106 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.434061    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz" podStartSLOduration=2.434040372 podStartE2EDuration="2.434040372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:17.433391752 +0000 UTC m=+72.985424502" watchObservedRunningTime="2026-07-16 08:56:17.434040372 +0000 UTC m=+72.986073098"
Jul 16 08:56:17.451039 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:17.450995    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jmg7x" podStartSLOduration=33.623852062 podStartE2EDuration="37.450980677s" totalImagesPullingTime="3.827128615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:17.450557771 +0000 UTC m=+73.002590498" watchObservedRunningTime="2026-07-16 08:56:17.450980677 +0000 UTC m=+73.003013402"
Jul 16 08:56:18.728115 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:18.728064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:18.728568 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:18.728226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:18.728993 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:18.728947    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a16205-7466-42d6-9601-f698f14abcc6-service-ca-bundle\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:18.731166 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:18.731140    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5a16205-7466-42d6-9601-f698f14abcc6-metrics-certs\") pod \"router-default-84d56f759d-97tbg\" (UID: \"d5a16205-7466-42d6-9601-f698f14abcc6\") " pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:18.829246 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:18.829209    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:56:18.832168 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:18.832138    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8576da94-49b6-4d18-b03a-686eb7b48903-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4n9v5\" (UID: \"8576da94-49b6-4d18-b03a-686eb7b48903\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:56:18.937264 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:18.937225    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xbxfv\""
Jul 16 08:56:18.945354 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:18.945322    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:19.012684 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:19.012603    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cxtgm\""
Jul 16 08:56:19.020772 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:19.020739    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"
Jul 16 08:56:19.234010 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:19.233895    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4n9v5"]
Jul 16 08:56:19.259783 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:19.259736    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84d56f759d-97tbg"]
Jul 16 08:56:19.262450 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:56:19.262421    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a16205_7466_42d6_9601_f698f14abcc6.slice/crio-b01aa6da29f33e41b51a23ad1292ef244e88a33f7c6006e4ac31ba7520ac8dbb WatchSource:0}: Error finding container b01aa6da29f33e41b51a23ad1292ef244e88a33f7c6006e4ac31ba7520ac8dbb: Status 404 returned error can't find the container with id b01aa6da29f33e41b51a23ad1292ef244e88a33f7c6006e4ac31ba7520ac8dbb
Jul 16 08:56:19.411360 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:19.411310    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5" event={"ID":"8576da94-49b6-4d18-b03a-686eb7b48903","Type":"ContainerStarted","Data":"f4e9cec0287ab445e7be3b648397bf38a25e73b9bbef032f2a5ea1f2ada71a51"}
Jul 16 08:56:19.413145 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:19.413110    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84d56f759d-97tbg" event={"ID":"d5a16205-7466-42d6-9601-f698f14abcc6","Type":"ContainerStarted","Data":"c6d7141bb1992474cfd08cc227c232fcf96c49ee50c2acd4e5b55b398aada055"}
Jul 16 08:56:19.413264 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:19.413162    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84d56f759d-97tbg" event={"ID":"d5a16205-7466-42d6-9601-f698f14abcc6","Type":"ContainerStarted","Data":"b01aa6da29f33e41b51a23ad1292ef244e88a33f7c6006e4ac31ba7520ac8dbb"}
Jul 16 08:56:19.432396 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:19.432349    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-84d56f759d-97tbg" podStartSLOduration=33.432329494 podStartE2EDuration="33.432329494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:19.431052094 +0000 UTC m=+74.983084822" watchObservedRunningTime="2026-07-16 08:56:19.432329494 +0000 UTC m=+74.984362219"
Jul 16 08:56:19.945809 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:19.945762    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:19.948655 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:19.948630    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:20.416637 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:20.416583    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:20.418130 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:20.418105    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-84d56f759d-97tbg"
Jul 16 08:56:21.421900 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:21.421801    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p" event={"ID":"254715b9-d2eb-4a32-9903-64b40f0952e3","Type":"ContainerStarted","Data":"636a4829a876351384d928f8ac91ff99feabfc4ca1e9f3d280290a9838d7ebf8"}
Jul 16 08:56:21.422294 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:21.421989    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:21.423623 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:21.423595    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5" event={"ID":"8576da94-49b6-4d18-b03a-686eb7b48903","Type":"ContainerStarted","Data":"db5d1a7ecf0c26b20765abd47c2e0d1420ef27ac0b6039e50f48701760533b03"}
Jul 16 08:56:21.423904 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:21.423884    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p"
Jul 16 08:56:21.439450 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:21.439401    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b848cd94b-qp99p" podStartSLOduration=1.927349703 podStartE2EDuration="6.439387767s" totalImagesPullingTime="4.512038064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:21.437549391 +0000 UTC m=+76.989582116" watchObservedRunningTime="2026-07-16 08:56:21.439387767 +0000 UTC m=+76.991420492"
Jul 16 08:56:21.472714 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:21.472668    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-4n9v5" podStartSLOduration=33.599014784 podStartE2EDuration="35.472650251s" totalImagesPullingTime="1.873635467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:21.47245526 +0000 UTC m=+77.024487987" watchObservedRunningTime="2026-07-16 08:56:21.472650251 +0000 UTC m=+77.024682974"
Jul 16 08:56:21.595907 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:21.595870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:21.657644 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:21.657619    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:22.974079 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:22.974036    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:23.076957 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:23.076923    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:23.149929 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:23.149890    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:23.310809 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:23.310720    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:23.769922 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:23.769874    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:56:23.772190 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:23.772168    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da173879-80bb-4c14-bfa5-a87e770ebaee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jvc28\" (UID: \"da173879-80bb-4c14-bfa5-a87e770ebaee\") " pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:56:24.031475 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:24.031392    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b8kz8\""
Jul 16 08:56:24.039284 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:24.039260    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jvc28"
Jul 16 08:56:24.166420 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:24.166397    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jvc28"]
Jul 16 08:56:24.168632 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:56:24.168604    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda173879_80bb_4c14_bfa5_a87e770ebaee.slice/crio-b4b297a16e4fef043c45c92647adad44fbef1e4cf428959c54e5c12047d200b6 WatchSource:0}: Error finding container b4b297a16e4fef043c45c92647adad44fbef1e4cf428959c54e5c12047d200b6: Status 404 returned error can't find the container with id b4b297a16e4fef043c45c92647adad44fbef1e4cf428959c54e5c12047d200b6
Jul 16 08:56:24.434159 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:24.434125    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvc28" event={"ID":"da173879-80bb-4c14-bfa5-a87e770ebaee","Type":"ContainerStarted","Data":"b4b297a16e4fef043c45c92647adad44fbef1e4cf428959c54e5c12047d200b6"}
Jul 16 08:56:25.169351 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.169272    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:25.218155 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.218120    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xx5bh"]
Jul 16 08:56:25.221548 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.221507    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.225454 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.225430    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cgxkv\""
Jul 16 08:56:25.225613 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.225454    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 16 08:56:25.225613 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.225526    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 08:56:25.225613 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.225606    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 16 08:56:25.225780 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.225430    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 08:56:25.225836 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.225792    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 08:56:25.231349 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.231051    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xx5bh"]
Jul 16 08:56:25.242140 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.242110    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:25.382345 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.382309    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.382521 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.382376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.382521 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.382436    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.382521 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.382463    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqnb8\" (UniqueName: \"kubernetes.io/projected/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-kube-api-access-xqnb8\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.483431 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.483334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.483624 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.483456    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.483624 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.483502    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqnb8\" (UniqueName: \"kubernetes.io/projected/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-kube-api-access-xqnb8\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.483624 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.483582    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.483917 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:25.483886    2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 16 08:56:25.484048 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:25.483970    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-prometheus-operator-tls podName:0dddeb8d-42fa-4d2d-9174-f625fd5585b0 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:25.983948604 +0000 UTC m=+81.535981309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-prometheus-operator-tls") pod "prometheus-operator-64785b6675-xx5bh" (UID: "0dddeb8d-42fa-4d2d-9174-f625fd5585b0") : secret "prometheus-operator-tls" not found
Jul 16 08:56:25.484546 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.484505    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.486329 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.486294    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.493626 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.493597    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqnb8\" (UniqueName: \"kubernetes.io/projected/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-kube-api-access-xqnb8\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.547197 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.547154    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:25.988311 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.988279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:25.991126 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:25.991100    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0dddeb8d-42fa-4d2d-9174-f625fd5585b0-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xx5bh\" (UID: \"0dddeb8d-42fa-4d2d-9174-f625fd5585b0\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:26.137325 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:26.137288    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh"
Jul 16 08:56:26.285420 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:26.285337    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xx5bh"]
Jul 16 08:56:26.442456 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:26.442414    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh" event={"ID":"0dddeb8d-42fa-4d2d-9174-f625fd5585b0","Type":"ContainerStarted","Data":"6dce3d687e9608b6a41840639988d79ba0b554cffcbf82228f9676378e07de34"}
Jul 16 08:56:27.409373 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:27.409234    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jmg7x"
Jul 16 08:56:28.452062 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:28.452025    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:28.512343 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:28.512308    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:29.764377 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:29.764288    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:30.459777 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:30.459692    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvc28" event={"ID":"da173879-80bb-4c14-bfa5-a87e770ebaee","Type":"ContainerStarted","Data":"d26a17735236d86c98d88cc3bfa9b7c48e3182afa8a768b887585923e555e14e"}
Jul 16 08:56:30.461997 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:30.461892    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh" event={"ID":"0dddeb8d-42fa-4d2d-9174-f625fd5585b0","Type":"ContainerStarted","Data":"7451bf5a829e9a44fcfb33a862b66be3d518829dcebec2e36d7035a57abc8250"}
Jul 16 08:56:30.461997 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:30.461946    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh" event={"ID":"0dddeb8d-42fa-4d2d-9174-f625fd5585b0","Type":"ContainerStarted","Data":"fe151f84c832904e60114af564d2f1c9303d5b52a100a3f3aa2092daa918c14e"}
Jul 16 08:56:30.479777 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:30.479723    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-xx5bh" podStartSLOduration=2.27526957 podStartE2EDuration="5.479700061s" totalImagesPullingTime="3.204430491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:30.47820382 +0000 UTC m=+86.030236545" watchObservedRunningTime="2026-07-16 08:56:30.479700061 +0000 UTC m=+86.031732791"
Jul 16 08:56:31.433811 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:31.433767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:31.535047 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:31.535005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:31.635933 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:31.635894    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:32.333731 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.333691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:32.554518 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.554453    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:32.609686 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.609335    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"]
Jul 16 08:56:32.623561 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.623145    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v2nvf"]
Jul 16 08:56:32.623717 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.623654    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.627885 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.627633    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 16 08:56:32.627885 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.627657    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6zsns\""
Jul 16 08:56:32.630722 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.628292    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 16 08:56:32.630722 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.628472    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 16 08:56:32.646300 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.644999    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"]
Jul 16 08:56:32.646300 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.645132    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.648896 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.648184    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 08:56:32.648896 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.648399    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 08:56:32.648896 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.648577    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6fx9n\""
Jul 16 08:56:32.648896 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.648774    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 08:56:32.653024 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.652998    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:32.748632 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748593    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-tls\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.748791 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748639    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.748791 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748674    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.748791 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748696    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d9a4bf-42b0-49c3-9891-57115ef96bda-metrics-client-ca\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.748791 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748715    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56d9a4bf-42b0-49c3-9891-57115ef96bda-root\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.748791 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-wtmp\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.748791 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748763    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-textfile\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.749089 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89wr9\" (UniqueName: \"kubernetes.io/projected/56d9a4bf-42b0-49c3-9891-57115ef96bda-kube-api-access-89wr9\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.749089 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748818    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f6fr\" (UniqueName: \"kubernetes.io/projected/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-api-access-2f6fr\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.749089 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748848    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f4fb791a-58d8-4a95-bdf9-d015d3666354-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.749089 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748888    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.749089 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748920    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4fb791a-58d8-4a95-bdf9-d015d3666354-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.749089 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.749089 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.748996    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56d9a4bf-42b0-49c3-9891-57115ef96bda-sys\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.749089 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.749041    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.751937 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.751899    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:32.849449 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.849416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-tls\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.849653 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.849464    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.849653 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.849499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.849653 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.849525    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d9a4bf-42b0-49c3-9891-57115ef96bda-metrics-client-ca\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.849653 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.849563    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56d9a4bf-42b0-49c3-9891-57115ef96bda-root\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.849653 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.849589    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-wtmp\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.849653 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:32.849611    2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 08:56:32.849947 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:56:32.849697    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-tls podName:56d9a4bf-42b0-49c3-9891-57115ef96bda nodeName:}" failed. No retries permitted until 2026-07-16 08:56:33.349674534 +0000 UTC m=+88.901707241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-tls") pod "node-exporter-v2nvf" (UID: "56d9a4bf-42b0-49c3-9891-57115ef96bda") : secret "node-exporter-tls" not found
Jul 16 08:56:32.849947 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.849935    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-textfile\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.849947 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.849617    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-textfile\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.850103 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.849994    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89wr9\" (UniqueName: \"kubernetes.io/projected/56d9a4bf-42b0-49c3-9891-57115ef96bda-kube-api-access-89wr9\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.850103 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.850025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f6fr\" (UniqueName: \"kubernetes.io/projected/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-api-access-2f6fr\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.850103 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.850055    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f4fb791a-58d8-4a95-bdf9-d015d3666354-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.850275 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.850105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.850275 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.850136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4fb791a-58d8-4a95-bdf9-d015d3666354-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.850275 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.850181    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.850275 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.850210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56d9a4bf-42b0-49c3-9891-57115ef96bda-sys\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.850275 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.850252    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.850566 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.850408    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.850678 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.850612    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f4fb791a-58d8-4a95-bdf9-d015d3666354-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.850990 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.850955    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56d9a4bf-42b0-49c3-9891-57115ef96bda-root\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.851243 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.851226    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-wtmp\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.851478 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.851393    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d9a4bf-42b0-49c3-9891-57115ef96bda-metrics-client-ca\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.852252 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.852193    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56d9a4bf-42b0-49c3-9891-57115ef96bda-sys\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.853450 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.852928    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4fb791a-58d8-4a95-bdf9-d015d3666354-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.853450 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.853393    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:32.853629 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.853572    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.854254 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.854214    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.854775 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.854736    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.859646 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.859621    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.864331 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.864182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f6fr\" (UniqueName: \"kubernetes.io/projected/f4fb791a-58d8-4a95-bdf9-d015d3666354-kube-api-access-2f6fr\") pod \"kube-state-metrics-785778ff74-4zzwv\" (UID: \"f4fb791a-58d8-4a95-bdf9-d015d3666354\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.865429 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.865405    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89wr9\" (UniqueName: \"kubernetes.io/projected/56d9a4bf-42b0-49c3-9891-57115ef96bda-kube-api-access-89wr9\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:32.941055 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.941013    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"
Jul 16 08:56:32.953409 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:32.953354    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:33.248468 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.248442    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-4zzwv"]
Jul 16 08:56:33.251228 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:56:33.251202    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fb791a_58d8_4a95_bdf9_d015d3666354.slice/crio-8283bef1c7ed3280d2ab8f28f2e0920610084ae5477268102b9586e2c7859831 WatchSource:0}: Error finding container 8283bef1c7ed3280d2ab8f28f2e0920610084ae5477268102b9586e2c7859831: Status 404 returned error can't find the container with id 8283bef1c7ed3280d2ab8f28f2e0920610084ae5477268102b9586e2c7859831
Jul 16 08:56:33.327857 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.327814    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:33.354802 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.354763    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-tls\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:33.357011 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.356990    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56d9a4bf-42b0-49c3-9891-57115ef96bda-node-exporter-tls\") pod \"node-exporter-v2nvf\" (UID: \"56d9a4bf-42b0-49c3-9891-57115ef96bda\") " pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:33.436628 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.436495    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:33.476778 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.476744    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv" event={"ID":"f4fb791a-58d8-4a95-bdf9-d015d3666354","Type":"ContainerStarted","Data":"8283bef1c7ed3280d2ab8f28f2e0920610084ae5477268102b9586e2c7859831"}
Jul 16 08:56:33.478342 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.478318    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvc28" event={"ID":"da173879-80bb-4c14-bfa5-a87e770ebaee","Type":"ContainerStarted","Data":"8f048ce5e43c6eb78b5d12c4bee6e055728dcf37961c6ab1671cbcca8528d4e1"}
Jul 16 08:56:33.562027 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.561991    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v2nvf"
Jul 16 08:56:33.573568 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:56:33.573524    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d9a4bf_42b0_49c3_9891_57115ef96bda.slice/crio-75e38ff014c08ba245998213705d812f2fb1e5f440044e9c8633a3ed1837cb4e WatchSource:0}: Error finding container 75e38ff014c08ba245998213705d812f2fb1e5f440044e9c8633a3ed1837cb4e: Status 404 returned error can't find the container with id 75e38ff014c08ba245998213705d812f2fb1e5f440044e9c8633a3ed1837cb4e
Jul 16 08:56:33.575718 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.575622    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:33.681545 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.681467    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:33.776146 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.775924    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:33.908605 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:33.908454    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:34.070464 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:34.070343    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:34.175878 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:34.175838    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:34.271282 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:34.271217    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:34.434797 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:34.434698    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:34.485664 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:34.485625    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2nvf" event={"ID":"56d9a4bf-42b0-49c3-9891-57115ef96bda","Type":"ContainerStarted","Data":"75e38ff014c08ba245998213705d812f2fb1e5f440044e9c8633a3ed1837cb4e"}
Jul 16 08:56:34.532947 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:34.532844    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:34.637888 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:34.637837    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:34.738724 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:34.738543    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:35.494063 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.493670    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv" event={"ID":"f4fb791a-58d8-4a95-bdf9-d015d3666354","Type":"ContainerStarted","Data":"be855505d17666e02d6d1033fc5867b09b5af22eb671d3e06f490bc0e218a9ed"}
Jul 16 08:56:35.494063 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.493759    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv" event={"ID":"f4fb791a-58d8-4a95-bdf9-d015d3666354","Type":"ContainerStarted","Data":"fdaa8a3a813b9fbd88db872428c0a08942e3674c98b25ec3ed27e062686b1d05"}
Jul 16 08:56:35.494063 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.493790    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv" event={"ID":"f4fb791a-58d8-4a95-bdf9-d015d3666354","Type":"ContainerStarted","Data":"0d5e26097ec10435091cd9d7ed37da5d24515a511e5ea5da713f6589672f1508"}
Jul 16 08:56:35.495620 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.495589    2570 generic.go:356] "Generic (PLEG): container finished" podID="56d9a4bf-42b0-49c3-9891-57115ef96bda" containerID="bf9d075910f397974056eca3f8c4ad8ae048c04f3e97b92208d0cbe7a5a22fcf" exitCode=0
Jul 16 08:56:35.495756 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.495630    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2nvf" event={"ID":"56d9a4bf-42b0-49c3-9891-57115ef96bda","Type":"ContainerDied","Data":"bf9d075910f397974056eca3f8c4ad8ae048c04f3e97b92208d0cbe7a5a22fcf"}
Jul 16 08:56:35.514471 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.514410    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-4zzwv" podStartSLOduration=1.8733853919999999 podStartE2EDuration="3.51438949s" totalImagesPullingTime="1.641004098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:35.512821344 +0000 UTC m=+91.064854071" watchObservedRunningTime="2026-07-16 08:56:35.51438949 +0000 UTC m=+91.066422241"
Jul 16 08:56:35.581719 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.581668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:35.686939 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.686761    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:35.829942 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.829908    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:35.916591 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.916554    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:35.972463 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:35.972416    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:37.335823 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:37.335776    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:37.421017 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:37.420906    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:37.506980 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:37.506933    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jvc28" event={"ID":"da173879-80bb-4c14-bfa5-a87e770ebaee","Type":"ContainerStarted","Data":"ac841ea10409c2cc521654ac3cc3c140d963689c24b2d5062d0f45488a587b7e"}
Jul 16 08:56:37.509337 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:37.509305    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2nvf" event={"ID":"56d9a4bf-42b0-49c3-9891-57115ef96bda","Type":"ContainerStarted","Data":"ddac28daf772d571b8b15b140218a6bbbc346037545ff66fac28f865d72f57b4"}
Jul 16 08:56:37.509467 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:37.509362    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2nvf" event={"ID":"56d9a4bf-42b0-49c3-9891-57115ef96bda","Type":"ContainerStarted","Data":"f54092f750345349e85e4228d58a769273768739f5f70cb88a91160a3d2d9642"}
Jul 16 08:56:37.525616 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:37.525515    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jvc28" podStartSLOduration=33.672405269 podStartE2EDuration="46.525495743s" totalImagesPullingTime="12.853090474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:37.524752024 +0000 UTC m=+93.076784750" watchObservedRunningTime="2026-07-16 08:56:37.525495743 +0000 UTC m=+93.077528471"
Jul 16 08:56:37.530425 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:37.530378    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:37.543421 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:37.543375    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v2nvf" podStartSLOduration=4.106668323 podStartE2EDuration="5.543359356s" totalImagesPullingTime="1.321136954s" totalInitContainerRuntime="115.554079ms" isStatefulPod=true podCreationTimestamp="2026-07-16 08:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:37.542807499 +0000 UTC m=+93.094840250" watchObservedRunningTime="2026-07-16 08:56:37.543359356 +0000 UTC m=+93.095392085"
Jul 16 08:56:37.630792 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:37.630751    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:37.723816 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:37.723707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:38.411007 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:38.410978    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-774bcc56cf-k7mmz"
Jul 16 08:56:38.551946 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:38.551906    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:38.674974 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:38.674878    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:38.882251 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:38.882215    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:42.935792 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:42.935755    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:43.036848 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:43.036814    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:44.070063 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:44.070029    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:44.173749 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:44.173714    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:46.395784 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:46.395752    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c4f2k"
Jul 16 08:56:47.838664 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:47.838624    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:47.891548 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:47.891491    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:50.188970 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:50.188939    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:50.248768 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:50.248736    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:51.651736 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:51.651703    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:52.644813 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.644775    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f8c9dd88d-wb4cr"]
Jul 16 08:56:52.707699 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.707663    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8c9dd88d-wb4cr"]
Jul 16 08:56:52.708144 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.707774    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.710767 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.710747    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 08:56:52.710901 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.710800    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 08:56:52.710979 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.710902    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 08:56:52.711956 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.711936    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fs8z9\""
Jul 16 08:56:52.712069 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.711940    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 08:56:52.712069 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.712039    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 08:56:52.712176 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.712070    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 08:56:52.712329 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.712314    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 08:56:52.718623 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.718598    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 08:56:52.801623 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.801591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-trusted-ca-bundle\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.801776 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.801633    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-oauth-config\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.801776 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.801657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vbzl\" (UniqueName: \"kubernetes.io/projected/3d49ba59-ea5c-498e-a060-f09de21b1a62-kube-api-access-4vbzl\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.801776 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.801714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-serving-cert\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.801776 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.801767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-oauth-serving-cert\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.801945 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.801795    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-service-ca\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.801945 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.801814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-config\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.903016 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.902929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-trusted-ca-bundle\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.903016 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.902980    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-oauth-config\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.903016 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.903007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vbzl\" (UniqueName: \"kubernetes.io/projected/3d49ba59-ea5c-498e-a060-f09de21b1a62-kube-api-access-4vbzl\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.903298 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.903043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-serving-cert\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.903298 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.903072    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-oauth-serving-cert\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.903298 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.903094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-service-ca\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.903298 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.903120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-config\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.903903 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.903875    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-service-ca\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.904007 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.903921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-trusted-ca-bundle\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.904046 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.904005    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-config\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.904046 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.904018    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-oauth-serving-cert\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.905630 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.905609    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-oauth-config\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.905678 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.905653    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-serving-cert\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:52.911777 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:52.911744    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vbzl\" (UniqueName: \"kubernetes.io/projected/3d49ba59-ea5c-498e-a060-f09de21b1a62-kube-api-access-4vbzl\") pod \"console-7f8c9dd88d-wb4cr\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") " pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:53.021945 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:53.021912    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:56:53.218045 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:53.218011    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8c9dd88d-wb4cr"]
Jul 16 08:56:53.221184 ip-10-0-135-178 kubenswrapper[2570]: W0716 08:56:53.221157    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d49ba59_ea5c_498e_a060_f09de21b1a62.slice/crio-e3b1f11e18e11ad91280202a659cd649bb35468b47ddf99ef2fb0256c11ee698 WatchSource:0}: Error finding container e3b1f11e18e11ad91280202a659cd649bb35468b47ddf99ef2fb0256c11ee698: Status 404 returned error can't find the container with id e3b1f11e18e11ad91280202a659cd649bb35468b47ddf99ef2fb0256c11ee698
Jul 16 08:56:53.565573 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:53.565472    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8c9dd88d-wb4cr" event={"ID":"3d49ba59-ea5c-498e-a060-f09de21b1a62","Type":"ContainerStarted","Data":"e3b1f11e18e11ad91280202a659cd649bb35468b47ddf99ef2fb0256c11ee698"}
Jul 16 08:56:56.164195 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:56.164154    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:56.219192 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:56.219090    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:56.579129 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:56.579091    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8c9dd88d-wb4cr" event={"ID":"3d49ba59-ea5c-498e-a060-f09de21b1a62","Type":"ContainerStarted","Data":"7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6"}
Jul 16 08:56:56.598330 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:56.598274    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f8c9dd88d-wb4cr" podStartSLOduration=1.8772481349999999 podStartE2EDuration="4.598255829s" totalImagesPullingTime="2.721007694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:56.59734836 +0000 UTC m=+112.149381088" watchObservedRunningTime="2026-07-16 08:56:56.598255829 +0000 UTC m=+112.150288554"
Jul 16 08:56:57.645952 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:57.645914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:57.745262 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:57.745223    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:58.078323 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:58.078283    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:58.133193 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:58.133162    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:58.449900 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:58.449803    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:58.961455 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:58.961421    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:56:59.020382 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:56:59.020348    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:57:03.022943 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:03.022901    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:57:03.023419 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:03.022973    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:57:03.027604 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:03.027583    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:57:03.607025 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:03.606991    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:57:03.775887 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:03.775829    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:57:04.593863 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:04.593813    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:57:04.654158 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:04.654112    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:57:13.074028 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:13.073990    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:57:13.334390 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:13.334298    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:57:24.090830 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:24.090787    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:57:28.244739 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:28.244691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:57:51.874364 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:51.874327    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:57:52.716792 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:57:52.716751    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:58:01.154636 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:01.154509    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:58:12.379741 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:12.379703    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8c9dd88d-wb4cr"]
Jul 16 08:58:12.477039 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:12.477005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:58:12.580292 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:12.580252    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:58:12.679464 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:12.679379    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:58:37.401510 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.401460    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f8c9dd88d-wb4cr" podUID="3d49ba59-ea5c-498e-a060-f09de21b1a62" containerName="console" containerID="cri-o://7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6" gracePeriod=15
Jul 16 08:58:37.646952 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.646927    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:58:37.750880 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.750787    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-serving-cert\") pod \"3d49ba59-ea5c-498e-a060-f09de21b1a62\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") "
Jul 16 08:58:37.750880 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.750836    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vbzl\" (UniqueName: \"kubernetes.io/projected/3d49ba59-ea5c-498e-a060-f09de21b1a62-kube-api-access-4vbzl\") pod \"3d49ba59-ea5c-498e-a060-f09de21b1a62\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") "
Jul 16 08:58:37.750880 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.750857    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-oauth-serving-cert\") pod \"3d49ba59-ea5c-498e-a060-f09de21b1a62\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") "
Jul 16 08:58:37.750880 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.750878    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-trusted-ca-bundle\") pod \"3d49ba59-ea5c-498e-a060-f09de21b1a62\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") "
Jul 16 08:58:37.751212 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.750895    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-config\") pod \"3d49ba59-ea5c-498e-a060-f09de21b1a62\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") "
Jul 16 08:58:37.751212 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.751064    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-oauth-config\") pod \"3d49ba59-ea5c-498e-a060-f09de21b1a62\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") "
Jul 16 08:58:37.751212 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.751130    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-service-ca\") pod \"3d49ba59-ea5c-498e-a060-f09de21b1a62\" (UID: \"3d49ba59-ea5c-498e-a060-f09de21b1a62\") "
Jul 16 08:58:37.751368 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.751290    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-config" (OuterVolumeSpecName: "console-config") pod "3d49ba59-ea5c-498e-a060-f09de21b1a62" (UID: "3d49ba59-ea5c-498e-a060-f09de21b1a62"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 08:58:37.751368 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.751287    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d49ba59-ea5c-498e-a060-f09de21b1a62" (UID: "3d49ba59-ea5c-498e-a060-f09de21b1a62"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 08:58:37.751578 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.751517    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d49ba59-ea5c-498e-a060-f09de21b1a62" (UID: "3d49ba59-ea5c-498e-a060-f09de21b1a62"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 08:58:37.751704 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.751648    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d49ba59-ea5c-498e-a060-f09de21b1a62" (UID: "3d49ba59-ea5c-498e-a060-f09de21b1a62"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 08:58:37.753174 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.753150    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d49ba59-ea5c-498e-a060-f09de21b1a62-kube-api-access-4vbzl" (OuterVolumeSpecName: "kube-api-access-4vbzl") pod "3d49ba59-ea5c-498e-a060-f09de21b1a62" (UID: "3d49ba59-ea5c-498e-a060-f09de21b1a62"). InnerVolumeSpecName "kube-api-access-4vbzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 08:58:37.753274 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.753199    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d49ba59-ea5c-498e-a060-f09de21b1a62" (UID: "3d49ba59-ea5c-498e-a060-f09de21b1a62"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 08:58:37.753274 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.753229    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d49ba59-ea5c-498e-a060-f09de21b1a62" (UID: "3d49ba59-ea5c-498e-a060-f09de21b1a62"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 08:58:37.851836 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.851788    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vbzl\" (UniqueName: \"kubernetes.io/projected/3d49ba59-ea5c-498e-a060-f09de21b1a62-kube-api-access-4vbzl\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 08:58:37.851836 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.851830    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-oauth-serving-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 08:58:37.851836 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.851841    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-trusted-ca-bundle\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 08:58:37.851836 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.851851    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-config\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 08:58:37.851836 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.851859    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-oauth-config\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 08:58:37.852121 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.851868    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d49ba59-ea5c-498e-a060-f09de21b1a62-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 08:58:37.852121 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.851876    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d49ba59-ea5c-498e-a060-f09de21b1a62-console-serving-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 08:58:37.933437 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.933400    2570 generic.go:356] "Generic (PLEG): container finished" podID="3d49ba59-ea5c-498e-a060-f09de21b1a62" containerID="7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6" exitCode=0
Jul 16 08:58:37.933604 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.933442    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8c9dd88d-wb4cr"
Jul 16 08:58:37.933604 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.933479    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8c9dd88d-wb4cr" event={"ID":"3d49ba59-ea5c-498e-a060-f09de21b1a62","Type":"ContainerDied","Data":"7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6"}
Jul 16 08:58:37.933604 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.933548    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8c9dd88d-wb4cr" event={"ID":"3d49ba59-ea5c-498e-a060-f09de21b1a62","Type":"ContainerDied","Data":"e3b1f11e18e11ad91280202a659cd649bb35468b47ddf99ef2fb0256c11ee698"}
Jul 16 08:58:37.933604 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.933574    2570 scope.go:117] "RemoveContainer" containerID="7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6"
Jul 16 08:58:37.942442 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.942422    2570 scope.go:117] "RemoveContainer" containerID="7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6"
Jul 16 08:58:37.942731 ip-10-0-135-178 kubenswrapper[2570]: E0716 08:58:37.942711    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6\": container with ID starting with 7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6 not found: ID does not exist" containerID="7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6"
Jul 16 08:58:37.942803 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.942744    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6"} err="failed to get container status \"7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6\": rpc error: code = NotFound desc = could not find container \"7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6\": container with ID starting with 7a035b37aa4fa85ed64a66177b8fae18034ebb9628ecfc0f81fdb1cca708eec6 not found: ID does not exist"
Jul 16 08:58:37.957495 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.957469    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8c9dd88d-wb4cr"]
Jul 16 08:58:37.960194 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:37.960172    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f8c9dd88d-wb4cr"]
Jul 16 08:58:38.970648 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:38.970612    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d49ba59-ea5c-498e-a060-f09de21b1a62" path="/var/lib/kubelet/pods/3d49ba59-ea5c-498e-a060-f09de21b1a62/volumes"
Jul 16 08:58:40.372105 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:40.372066    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:58:47.763655 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:47.763596    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:58:47.823638 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:58:47.823596    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:07.124216 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:07.124173    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:07.224400 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:07.224361    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:19.132355 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:19.132316    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:19.232452 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:19.232407    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:28.098552 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:28.098436    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:28.197962 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:28.197921    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:33.377743 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:33.377708    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:33.435584 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:33.435525    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:43.831467 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:43.831429    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:43.884119 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:43.884087    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 08:59:43.940743 ip-10-0-135-178 kubenswrapper[2570]: I0716 08:59:43.940688    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:04.824808 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:04.824772    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:00:04.831088 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:04.831050    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 09:00:04.831402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:04.831385    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:00:17.784711 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:17.784678    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:21.488485 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:21.488448    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:27.219876 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:27.219842    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:27.269924 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:27.269886    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:44.286293 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:44.286259    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:45.669425 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:45.669374    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:47.915791 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:47.915759    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:48.016382 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:48.016331    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:49.208197 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:49.208161    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:49.324118 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:49.324084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:49.450554 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:49.450494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:49.568484 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:49.568452    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:51.614048 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:51.614006    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:51.828489 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:51.828450    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:52.006306 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.006227    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"]
Jul 16 09:00:52.006498 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.006486    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d49ba59-ea5c-498e-a060-f09de21b1a62" containerName="console"
Jul 16 09:00:52.006576 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.006499    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d49ba59-ea5c-498e-a060-f09de21b1a62" containerName="console"
Jul 16 09:00:52.006576 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.006561    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d49ba59-ea5c-498e-a060-f09de21b1a62" containerName="console"
Jul 16 09:00:52.009172 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.009155    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"
Jul 16 09:00:52.011332 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.011303    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 09:00:52.011474 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.011457    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kjrg5\""
Jul 16 09:00:52.011522 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.011489    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 09:00:52.020044 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.020022    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"]
Jul 16 09:00:52.158232 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.158192    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83146594-0c5e-4f25-98d2-a1f2f13d2369-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vjm2t\" (UID: \"83146594-0c5e-4f25-98d2-a1f2f13d2369\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"
Jul 16 09:00:52.158409 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.158310    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzhms\" (UniqueName: \"kubernetes.io/projected/83146594-0c5e-4f25-98d2-a1f2f13d2369-kube-api-access-xzhms\") pod \"cert-manager-cainjector-559cdd8c87-vjm2t\" (UID: \"83146594-0c5e-4f25-98d2-a1f2f13d2369\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"
Jul 16 09:00:52.259602 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.259503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzhms\" (UniqueName: \"kubernetes.io/projected/83146594-0c5e-4f25-98d2-a1f2f13d2369-kube-api-access-xzhms\") pod \"cert-manager-cainjector-559cdd8c87-vjm2t\" (UID: \"83146594-0c5e-4f25-98d2-a1f2f13d2369\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"
Jul 16 09:00:52.259602 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.259566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83146594-0c5e-4f25-98d2-a1f2f13d2369-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vjm2t\" (UID: \"83146594-0c5e-4f25-98d2-a1f2f13d2369\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"
Jul 16 09:00:52.268667 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.268642    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83146594-0c5e-4f25-98d2-a1f2f13d2369-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vjm2t\" (UID: \"83146594-0c5e-4f25-98d2-a1f2f13d2369\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"
Jul 16 09:00:52.268796 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.268747    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzhms\" (UniqueName: \"kubernetes.io/projected/83146594-0c5e-4f25-98d2-a1f2f13d2369-kube-api-access-xzhms\") pod \"cert-manager-cainjector-559cdd8c87-vjm2t\" (UID: \"83146594-0c5e-4f25-98d2-a1f2f13d2369\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"
Jul 16 09:00:52.335681 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.335651    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"
Jul 16 09:00:52.465720 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.465660    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t"]
Jul 16 09:00:52.467818 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:00:52.467785    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83146594_0c5e_4f25_98d2_a1f2f13d2369.slice/crio-e060d2329d8e862b5573544d21c6cc913efa8102d20de5898bfb656c84bbaae6 WatchSource:0}: Error finding container e060d2329d8e862b5573544d21c6cc913efa8102d20de5898bfb656c84bbaae6: Status 404 returned error can't find the container with id e060d2329d8e862b5573544d21c6cc913efa8102d20de5898bfb656c84bbaae6
Jul 16 09:00:52.469724 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:52.469707    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:00:53.395691 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:53.395654    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t" event={"ID":"83146594-0c5e-4f25-98d2-a1f2f13d2369","Type":"ContainerStarted","Data":"e060d2329d8e862b5573544d21c6cc913efa8102d20de5898bfb656c84bbaae6"}
Jul 16 09:00:54.688183 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:54.688120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:54.790588 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:54.790546    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:57.413909 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:57.413870    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t" event={"ID":"83146594-0c5e-4f25-98d2-a1f2f13d2369","Type":"ContainerStarted","Data":"8ec158f0291a4a7a7e61418f138f769bb7d0c534b1c7880cfb51e29cc960d700"}
Jul 16 09:00:57.430679 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:57.430628    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vjm2t" podStartSLOduration=2.215216821 podStartE2EDuration="6.43061087s" totalImagesPullingTime="4.215394049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:00:57.429164178 +0000 UTC m=+352.981196898" watchObservedRunningTime="2026-07-16 09:00:57.43061087 +0000 UTC m=+352.982643593"
Jul 16 09:00:57.454391 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:57.454354    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:00:57.801336 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:00:57.801242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:00.644565 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:00.644503    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:02.885825 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:02.885788    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:02.942275 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:02.942230    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:08.781691 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:08.781657    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:08.884855 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:08.884825    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:10.931673 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:10.931638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:26.771579 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:26.771500    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:26.872377 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:26.872336    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:27.537909 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.537860    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:27.872898 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.872860    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:27.932940 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.932909    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"]
Jul 16 09:01:27.936732 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.936701    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:27.942264 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.942241    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 09:01:27.942441 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.942425    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 09:01:27.942685 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.942668    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 09:01:27.942773 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.942729    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 09:01:27.942773 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.942762    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hgv5l\""
Jul 16 09:01:27.957732 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.957708    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"]
Jul 16 09:01:27.965268 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:27.965242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:28.031188 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.031147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.031371 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.031198    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-tmp\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.031371 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.031270    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-manifests\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.031371 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.031288    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.031371 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.031349    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6gl4\" (UniqueName: \"kubernetes.io/projected/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-kube-api-access-t6gl4\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.091760 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.091726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:28.132785 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.132718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6gl4\" (UniqueName: \"kubernetes.io/projected/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-kube-api-access-t6gl4\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.132785 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.132760    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.132956 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.132803    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-tmp\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.132956 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.132836    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-manifests\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.132956 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.132850    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.133291 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.133255    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-manifests\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.135167 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.135135    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-tmp\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.135271 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.135197    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.135271 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.135246    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.146524 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.146500    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6gl4\" (UniqueName: \"kubernetes.io/projected/17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab-kube-api-access-t6gl4\") pod \"opendatahub-operator-controller-manager-5b875787f8-cnl6g\" (UID: \"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.188600 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.188571    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:28.248448 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.248417    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:28.288522 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.288480    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:28.386895 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.386718    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"]
Jul 16 09:01:28.389636 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:01:28.389612    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a9fae7_0dab_4cc0_a0be_e0ea9f4e5bab.slice/crio-09c01243e3ba5b1d214477481216e1d325c53c6ac837d4af435c7c2240bdb4d5 WatchSource:0}: Error finding container 09c01243e3ba5b1d214477481216e1d325c53c6ac837d4af435c7c2240bdb4d5: Status 404 returned error can't find the container with id 09c01243e3ba5b1d214477481216e1d325c53c6ac837d4af435c7c2240bdb4d5
Jul 16 09:01:28.519116 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.519081    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g" event={"ID":"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab","Type":"ContainerStarted","Data":"09c01243e3ba5b1d214477481216e1d325c53c6ac837d4af435c7c2240bdb4d5"}
Jul 16 09:01:28.550354 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.550318    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:28.650960 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:28.650860    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:31.533377 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:31.533342    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g" event={"ID":"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab","Type":"ContainerStarted","Data":"cc861e399938d69cc39e2c4e59da88294a16e919db5da596aaa35140b94735ec"}
Jul 16 09:01:32.539071 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:32.539037    2570 generic.go:356] "Generic (PLEG): container finished" podID="17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab" containerID="cc861e399938d69cc39e2c4e59da88294a16e919db5da596aaa35140b94735ec" exitCode=0
Jul 16 09:01:32.539425 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:32.539114    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g" event={"ID":"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab","Type":"ContainerDied","Data":"cc861e399938d69cc39e2c4e59da88294a16e919db5da596aaa35140b94735ec"}
Jul 16 09:01:34.549178 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:34.549079    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g" event={"ID":"17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab","Type":"ContainerStarted","Data":"6de699c42c1cbb59291b6a1be017e14444061d84dff20339eeac4bee34d4c014"}
Jul 16 09:01:34.549178 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:34.549174    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:34.576820 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:34.576768    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g" podStartSLOduration=1.915597056 podStartE2EDuration="7.576749289s" totalImagesPullingTime="4.569735758s" totalInitContainerRuntime="1.091416475s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:01:34.574619055 +0000 UTC m=+390.126651781" watchObservedRunningTime="2026-07-16 09:01:34.576749289 +0000 UTC m=+390.128782097"
Jul 16 09:01:36.724559 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:36.724491    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:36.824237 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:36.824197    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:39.940857 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:39.940808    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:40.029467 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:40.029423    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:45.554978 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:45.554942    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-cnl6g"
Jul 16 09:01:48.225216 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.225179    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:48.336245 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.336205    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:48.566211 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.566115    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lzrvl"]
Jul 16 09:01:48.575507 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.575482    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:01:48.578287 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.578264    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 16 09:01:48.578483 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.578264    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qxzdq\""
Jul 16 09:01:48.581192 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.581167    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lzrvl"]
Jul 16 09:01:48.695834 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.695797    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3ebba46-0c51-4cd2-960d-a18daff31aa2-cert\") pod \"odh-model-controller-7998c67dc4-lzrvl\" (UID: \"a3ebba46-0c51-4cd2-960d-a18daff31aa2\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:01:48.696047 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.695853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc456\" (UniqueName: \"kubernetes.io/projected/a3ebba46-0c51-4cd2-960d-a18daff31aa2-kube-api-access-sc456\") pod \"odh-model-controller-7998c67dc4-lzrvl\" (UID: \"a3ebba46-0c51-4cd2-960d-a18daff31aa2\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:01:48.796903 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.796865    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3ebba46-0c51-4cd2-960d-a18daff31aa2-cert\") pod \"odh-model-controller-7998c67dc4-lzrvl\" (UID: \"a3ebba46-0c51-4cd2-960d-a18daff31aa2\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:01:48.797105 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.796911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc456\" (UniqueName: \"kubernetes.io/projected/a3ebba46-0c51-4cd2-960d-a18daff31aa2-kube-api-access-sc456\") pod \"odh-model-controller-7998c67dc4-lzrvl\" (UID: \"a3ebba46-0c51-4cd2-960d-a18daff31aa2\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:01:48.797105 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:01:48.797039    2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 16 09:01:48.797198 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:01:48.797127    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3ebba46-0c51-4cd2-960d-a18daff31aa2-cert podName:a3ebba46-0c51-4cd2-960d-a18daff31aa2 nodeName:}" failed. No retries permitted until 2026-07-16 09:01:49.297106586 +0000 UTC m=+404.849139294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a3ebba46-0c51-4cd2-960d-a18daff31aa2-cert") pod "odh-model-controller-7998c67dc4-lzrvl" (UID: "a3ebba46-0c51-4cd2-960d-a18daff31aa2") : secret "odh-model-controller-webhook-cert" not found
Jul 16 09:01:48.805907 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:48.805862    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc456\" (UniqueName: \"kubernetes.io/projected/a3ebba46-0c51-4cd2-960d-a18daff31aa2-kube-api-access-sc456\") pod \"odh-model-controller-7998c67dc4-lzrvl\" (UID: \"a3ebba46-0c51-4cd2-960d-a18daff31aa2\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:01:49.093352 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.093318    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-85qgr"]
Jul 16 09:01:49.095647 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.095621    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:01:49.098407 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.098378    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 09:01:49.098525 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.098462    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6vvjj\""
Jul 16 09:01:49.110120 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.110093    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-85qgr"]
Jul 16 09:01:49.200491 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.200459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/932442fd-1c9b-4fd4-9630-e2ddd1099d81-tls-certs\") pod \"model-serving-api-54d89bd5fc-85qgr\" (UID: \"932442fd-1c9b-4fd4-9630-e2ddd1099d81\") " pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:01:49.200719 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.200521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfsnz\" (UniqueName: \"kubernetes.io/projected/932442fd-1c9b-4fd4-9630-e2ddd1099d81-kube-api-access-bfsnz\") pod \"model-serving-api-54d89bd5fc-85qgr\" (UID: \"932442fd-1c9b-4fd4-9630-e2ddd1099d81\") " pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:01:49.301683 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.301647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfsnz\" (UniqueName: \"kubernetes.io/projected/932442fd-1c9b-4fd4-9630-e2ddd1099d81-kube-api-access-bfsnz\") pod \"model-serving-api-54d89bd5fc-85qgr\" (UID: \"932442fd-1c9b-4fd4-9630-e2ddd1099d81\") " pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:01:49.302176 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.301734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/932442fd-1c9b-4fd4-9630-e2ddd1099d81-tls-certs\") pod \"model-serving-api-54d89bd5fc-85qgr\" (UID: \"932442fd-1c9b-4fd4-9630-e2ddd1099d81\") " pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:01:49.302176 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.301767    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3ebba46-0c51-4cd2-960d-a18daff31aa2-cert\") pod \"odh-model-controller-7998c67dc4-lzrvl\" (UID: \"a3ebba46-0c51-4cd2-960d-a18daff31aa2\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:01:49.302176 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:01:49.301890    2570 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 16 09:01:49.302176 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:01:49.301961    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/932442fd-1c9b-4fd4-9630-e2ddd1099d81-tls-certs podName:932442fd-1c9b-4fd4-9630-e2ddd1099d81 nodeName:}" failed. No retries permitted until 2026-07-16 09:01:49.801940981 +0000 UTC m=+405.353973686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/932442fd-1c9b-4fd4-9630-e2ddd1099d81-tls-certs") pod "model-serving-api-54d89bd5fc-85qgr" (UID: "932442fd-1c9b-4fd4-9630-e2ddd1099d81") : secret "model-serving-api-tls" not found
Jul 16 09:01:49.304278 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.304253    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3ebba46-0c51-4cd2-960d-a18daff31aa2-cert\") pod \"odh-model-controller-7998c67dc4-lzrvl\" (UID: \"a3ebba46-0c51-4cd2-960d-a18daff31aa2\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:01:49.318571 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.318521    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfsnz\" (UniqueName: \"kubernetes.io/projected/932442fd-1c9b-4fd4-9630-e2ddd1099d81-kube-api-access-bfsnz\") pod \"model-serving-api-54d89bd5fc-85qgr\" (UID: \"932442fd-1c9b-4fd4-9630-e2ddd1099d81\") " pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:01:49.488011 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.487922    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:01:49.574177 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.574140    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"]
Jul 16 09:01:49.577907 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.577882    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:49.580312 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.580147    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 09:01:49.580312 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.580246    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 09:01:49.580495 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.580342    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4xhvr\""
Jul 16 09:01:49.589259 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.589194    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"]
Jul 16 09:01:49.670292 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.670264    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lzrvl"]
Jul 16 09:01:49.710136 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.710097    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-tmp\") pod \"kube-auth-proxy-856d68f954-nvhqr\" (UID: \"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0\") " pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:49.710297 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.710148    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9bf7\" (UniqueName: \"kubernetes.io/projected/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-kube-api-access-g9bf7\") pod \"kube-auth-proxy-856d68f954-nvhqr\" (UID: \"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0\") " pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:49.710297 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.710266    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-tls-certs\") pod \"kube-auth-proxy-856d68f954-nvhqr\" (UID: \"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0\") " pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:49.728317 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.728280    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:49.784309 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.784113    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:49.810960 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.810925    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-tls-certs\") pod \"kube-auth-proxy-856d68f954-nvhqr\" (UID: \"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0\") " pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:49.811138 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:01:49.811107    2570 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 16 09:01:49.811205 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:01:49.811194    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-tls-certs podName:3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0 nodeName:}" failed. No retries permitted until 2026-07-16 09:01:50.311171164 +0000 UTC m=+405.863203874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-tls-certs") pod "kube-auth-proxy-856d68f954-nvhqr" (UID: "3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0") : secret "kube-auth-proxy-tls" not found
Jul 16 09:01:49.811411 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.811382    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/932442fd-1c9b-4fd4-9630-e2ddd1099d81-tls-certs\") pod \"model-serving-api-54d89bd5fc-85qgr\" (UID: \"932442fd-1c9b-4fd4-9630-e2ddd1099d81\") " pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:01:49.811411 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.811419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-tmp\") pod \"kube-auth-proxy-856d68f954-nvhqr\" (UID: \"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0\") " pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:49.811613 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.811445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9bf7\" (UniqueName: \"kubernetes.io/projected/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-kube-api-access-g9bf7\") pod \"kube-auth-proxy-856d68f954-nvhqr\" (UID: \"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0\") " pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:49.813911 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.813884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-tmp\") pod \"kube-auth-proxy-856d68f954-nvhqr\" (UID: \"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0\") " pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:49.814096 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.814074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/932442fd-1c9b-4fd4-9630-e2ddd1099d81-tls-certs\") pod \"model-serving-api-54d89bd5fc-85qgr\" (UID: \"932442fd-1c9b-4fd4-9630-e2ddd1099d81\") " pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:01:49.822863 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.822830    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9bf7\" (UniqueName: \"kubernetes.io/projected/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-kube-api-access-g9bf7\") pod \"kube-auth-proxy-856d68f954-nvhqr\" (UID: \"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0\") " pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:49.847560 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:49.847521    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:50.006973 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.006931    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:01:50.205987 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.205944    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-85qgr"]
Jul 16 09:01:50.209652 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:01:50.209620    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932442fd_1c9b_4fd4_9630_e2ddd1099d81.slice/crio-0e9bb253734b48f51a024948917d66a762686e8d2148ebb16ba03480e642f649 WatchSource:0}: Error finding container 0e9bb253734b48f51a024948917d66a762686e8d2148ebb16ba03480e642f649: Status 404 returned error can't find the container with id 0e9bb253734b48f51a024948917d66a762686e8d2148ebb16ba03480e642f649
Jul 16 09:01:50.269025 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.268954    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:50.315147 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.315109    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-tls-certs\") pod \"kube-auth-proxy-856d68f954-nvhqr\" (UID: \"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0\") " pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:50.317656 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.317626    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0-tls-certs\") pod \"kube-auth-proxy-856d68f954-nvhqr\" (UID: \"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0\") " pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:50.489867 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.489778    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"
Jul 16 09:01:50.556663 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.556635    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"]
Jul 16 09:01:50.559306 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.559285    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.559654 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.559623    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:50.561527 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.561499    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 09:01:50.561725 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.561674    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 09:01:50.561725 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.561721    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 09:01:50.561849 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.561804    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 09:01:50.561849 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.561826    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hjknr\""
Jul 16 09:01:50.574683 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.574657    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"]
Jul 16 09:01:50.613901 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.613864    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-85qgr" event={"ID":"932442fd-1c9b-4fd4-9630-e2ddd1099d81","Type":"ContainerStarted","Data":"0e9bb253734b48f51a024948917d66a762686e8d2148ebb16ba03480e642f649"}
Jul 16 09:01:50.615109 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.615086    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl" event={"ID":"a3ebba46-0c51-4cd2-960d-a18daff31aa2","Type":"ContainerStarted","Data":"0c6233c36ccb231c626572361f1b6b13f90f2cf8f91a3cd345821d0abaefe2c9"}
Jul 16 09:01:50.617589 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.617563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.617655 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.617607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.617688 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.617664    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bmvr\" (UniqueName: \"kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-kube-api-access-9bmvr\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.617721 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.617707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce0dee9-79ef-4215-805b-769c370f4d87-local-certs\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.617753 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.617738    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-cacerts\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.617861 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.617840    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-token\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.617967 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.617933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.625640 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.625606    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:50.633407 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.633376    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-856d68f954-nvhqr"]
Jul 16 09:01:50.638384 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:01:50.638362    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3798e25c_5a83_4cc4_9bc2_b5bd496fb2a0.slice/crio-76a1f986c4f085f87edf1e30c7831bb9550d055b6ca95db19e6d27a76be7c416 WatchSource:0}: Error finding container 76a1f986c4f085f87edf1e30c7831bb9550d055b6ca95db19e6d27a76be7c416: Status 404 returned error can't find the container with id 76a1f986c4f085f87edf1e30c7831bb9550d055b6ca95db19e6d27a76be7c416
Jul 16 09:01:50.719381 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.719347    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.719381 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.719383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.719658 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.719406    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bmvr\" (UniqueName: \"kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-kube-api-access-9bmvr\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.719658 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.719425    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce0dee9-79ef-4215-805b-769c370f4d87-local-certs\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.719658 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.719444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-cacerts\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.719658 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.719478    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-token\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.719862 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.719527    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.720303 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.720276    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.722019 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.721999    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-cacerts\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.722233 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.722213    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce0dee9-79ef-4215-805b-769c370f4d87-local-certs\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.722386 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.722368    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.722460 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.722369    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.728915 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.728891    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-token\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.729047 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.729025    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bmvr\" (UniqueName: \"kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-kube-api-access-9bmvr\") pod \"istiod-openshift-gateway-7574459656-jp2np\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:50.869583 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:50.869520    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:51.004065 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:51.004037    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"]
Jul 16 09:01:51.006692 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:01:51.006653    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce0dee9_79ef_4215_805b_769c370f4d87.slice/crio-db11b0b03fea67f6bd13735cfc6d9d427b69d3a42515d123a9109fc7ec4e0f49 WatchSource:0}: Error finding container db11b0b03fea67f6bd13735cfc6d9d427b69d3a42515d123a9109fc7ec4e0f49: Status 404 returned error can't find the container with id db11b0b03fea67f6bd13735cfc6d9d427b69d3a42515d123a9109fc7ec4e0f49
Jul 16 09:01:51.621639 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:51.621603    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np" event={"ID":"0ce0dee9-79ef-4215-805b-769c370f4d87","Type":"ContainerStarted","Data":"db11b0b03fea67f6bd13735cfc6d9d427b69d3a42515d123a9109fc7ec4e0f49"}
Jul 16 09:01:51.622793 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:51.622759    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr" event={"ID":"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0","Type":"ContainerStarted","Data":"76a1f986c4f085f87edf1e30c7831bb9550d055b6ca95db19e6d27a76be7c416"}
Jul 16 09:01:51.864820 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:51.864784    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:56.651572 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:56.651509    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr" event={"ID":"3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0","Type":"ContainerStarted","Data":"d886be9005b6d0696d476e1ace1098e5147f89a56ab8450c5659a14f695dbd83"}
Jul 16 09:01:56.653461 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:56.653428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl" event={"ID":"a3ebba46-0c51-4cd2-960d-a18daff31aa2","Type":"ContainerStarted","Data":"6a4a35cce79280a30748798ec4e551445e1210cba54dabc7d9a76bf1880eb40c"}
Jul 16 09:01:56.653634 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:56.653522    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:01:56.655095 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:56.655068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-85qgr" event={"ID":"932442fd-1c9b-4fd4-9630-e2ddd1099d81","Type":"ContainerStarted","Data":"c0b3afc24546d3333395c30896f81c996b29a0b1d413795bbd6fd13b45e1f304"}
Jul 16 09:01:56.655251 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:56.655229    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:01:56.677158 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:56.677098    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-856d68f954-nvhqr" podStartSLOduration=2.665596806 podStartE2EDuration="7.677079528s" totalImagesPullingTime="5.011482722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:01:56.676356556 +0000 UTC m=+412.228389283" watchObservedRunningTime="2026-07-16 09:01:56.677079528 +0000 UTC m=+412.229112254"
Jul 16 09:01:56.699175 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:56.699101    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl" podStartSLOduration=2.721503203 podStartE2EDuration="8.699077671s" totalImagesPullingTime="5.977574468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:01:56.696615789 +0000 UTC m=+412.248648516" watchObservedRunningTime="2026-07-16 09:01:56.699077671 +0000 UTC m=+412.251110401"
Jul 16 09:01:56.715684 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:56.715625    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-85qgr" podStartSLOduration=2.276147327 podStartE2EDuration="7.715603912s" totalImagesPullingTime="5.439456585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:01:56.713142204 +0000 UTC m=+412.265174933" watchObservedRunningTime="2026-07-16 09:01:56.715603912 +0000 UTC m=+412.267636639"
Jul 16 09:01:57.084123 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:57.084086    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:01:57.084227 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:57.084163    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:01:57.661523 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:57.661475    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np" event={"ID":"0ce0dee9-79ef-4215-805b-769c370f4d87","Type":"ContainerStarted","Data":"4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102"}
Jul 16 09:01:57.684067 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:57.684002    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np" podStartSLOduration=1.609577443 podStartE2EDuration="7.683982126s" totalImagesPullingTime="6.074404683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:01:57.682194265 +0000 UTC m=+413.234227018" watchObservedRunningTime="2026-07-16 09:01:57.683982126 +0000 UTC m=+413.236014854"
Jul 16 09:01:57.855141 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:57.855099    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:58.041363 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:58.041262    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:58.665728 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:58.665687    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:58.667275 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:58.667253    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:01:58.888341 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:58.888297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:59.084442 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:59.084401    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:59.705838 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:59.705803    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:59.908631 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:59.908597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:01:59.971022 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:59.970942    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"]
Jul 16 09:01:59.974655 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:59.974632    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"
Jul 16 09:01:59.980356 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:59.980326    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-45cvk\""
Jul 16 09:01:59.980815 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:59.980794    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 09:01:59.990662 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:01:59.990615    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"]
Jul 16 09:02:00.001854 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.001826    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"]
Jul 16 09:02:00.010210 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.010187    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:00.013438 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.013413    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-g57lr\""
Jul 16 09:02:00.014183 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.014074    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 09:02:00.023916 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.023891    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"]
Jul 16 09:02:00.098308 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.098267    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-9bbqn\" (UID: \"88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"
Jul 16 09:02:00.098308 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.098305    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7c390ef-809d-40ba-a6ef-885c6a040045-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xj8nt\" (UID: \"c7c390ef-809d-40ba-a6ef-885c6a040045\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:00.098608 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.098356    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4xbp\" (UniqueName: \"kubernetes.io/projected/c7c390ef-809d-40ba-a6ef-885c6a040045-kube-api-access-l4xbp\") pod \"llmisvc-controller-manager-777c6bd7d5-xj8nt\" (UID: \"c7c390ef-809d-40ba-a6ef-885c6a040045\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:00.098608 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.098394    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpnnl\" (UniqueName: \"kubernetes.io/projected/88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb-kube-api-access-hpnnl\") pod \"kserve-controller-manager-d6f4b65b8-9bbqn\" (UID: \"88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"
Jul 16 09:02:00.199653 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.199614    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-9bbqn\" (UID: \"88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"
Jul 16 09:02:00.199653 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.199659    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7c390ef-809d-40ba-a6ef-885c6a040045-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xj8nt\" (UID: \"c7c390ef-809d-40ba-a6ef-885c6a040045\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:00.199915 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.199719    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4xbp\" (UniqueName: \"kubernetes.io/projected/c7c390ef-809d-40ba-a6ef-885c6a040045-kube-api-access-l4xbp\") pod \"llmisvc-controller-manager-777c6bd7d5-xj8nt\" (UID: \"c7c390ef-809d-40ba-a6ef-885c6a040045\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:00.199915 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.199752    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpnnl\" (UniqueName: \"kubernetes.io/projected/88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb-kube-api-access-hpnnl\") pod \"kserve-controller-manager-d6f4b65b8-9bbqn\" (UID: \"88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"
Jul 16 09:02:00.199915 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:02:00.199800    2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 16 09:02:00.199915 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:02:00.199870    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c390ef-809d-40ba-a6ef-885c6a040045-cert podName:c7c390ef-809d-40ba-a6ef-885c6a040045 nodeName:}" failed. No retries permitted until 2026-07-16 09:02:00.699852904 +0000 UTC m=+416.251885607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c7c390ef-809d-40ba-a6ef-885c6a040045-cert") pod "llmisvc-controller-manager-777c6bd7d5-xj8nt" (UID: "c7c390ef-809d-40ba-a6ef-885c6a040045") : secret "llmisvc-webhook-server-cert" not found
Jul 16 09:02:00.202126 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.202101    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-9bbqn\" (UID: \"88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"
Jul 16 09:02:00.211981 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.211950    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpnnl\" (UniqueName: \"kubernetes.io/projected/88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb-kube-api-access-hpnnl\") pod \"kserve-controller-manager-d6f4b65b8-9bbqn\" (UID: \"88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"
Jul 16 09:02:00.212080 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.212050    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4xbp\" (UniqueName: \"kubernetes.io/projected/c7c390ef-809d-40ba-a6ef-885c6a040045-kube-api-access-l4xbp\") pod \"llmisvc-controller-manager-777c6bd7d5-xj8nt\" (UID: \"c7c390ef-809d-40ba-a6ef-885c6a040045\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:00.246624 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.246522    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:00.290458 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.290431    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"
Jul 16 09:02:00.365270 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.365168    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:00.446613 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.446576    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"]
Jul 16 09:02:00.449412 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:02:00.449380    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88710f4c_7d20_4da4_8dc8_c6cc5e37a9bb.slice/crio-ef6a21801c2cefa16544ff8a1b55f0cc598c35a21d7aa21162e61f4243c19a6f WatchSource:0}: Error finding container ef6a21801c2cefa16544ff8a1b55f0cc598c35a21d7aa21162e61f4243c19a6f: Status 404 returned error can't find the container with id ef6a21801c2cefa16544ff8a1b55f0cc598c35a21d7aa21162e61f4243c19a6f
Jul 16 09:02:00.675188 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.675147    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn" event={"ID":"88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb","Type":"ContainerStarted","Data":"ef6a21801c2cefa16544ff8a1b55f0cc598c35a21d7aa21162e61f4243c19a6f"}
Jul 16 09:02:00.704809 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.704778    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7c390ef-809d-40ba-a6ef-885c6a040045-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xj8nt\" (UID: \"c7c390ef-809d-40ba-a6ef-885c6a040045\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:00.707257 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.707237    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7c390ef-809d-40ba-a6ef-885c6a040045-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xj8nt\" (UID: \"c7c390ef-809d-40ba-a6ef-885c6a040045\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:00.927160 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:00.927074    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:01.069977 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:01.069954    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"]
Jul 16 09:02:01.072416 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:02:01.072390    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc7c390ef_809d_40ba_a6ef_885c6a040045.slice/crio-8360126ab9436bb95784dd2bfc2f5d4b0ffd5f282b21544128b83d0e531e99f6 WatchSource:0}: Error finding container 8360126ab9436bb95784dd2bfc2f5d4b0ffd5f282b21544128b83d0e531e99f6: Status 404 returned error can't find the container with id 8360126ab9436bb95784dd2bfc2f5d4b0ffd5f282b21544128b83d0e531e99f6
Jul 16 09:02:01.411912 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:01.411881    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"]
Jul 16 09:02:01.680752 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:01.680676    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt" event={"ID":"c7c390ef-809d-40ba-a6ef-885c6a040045","Type":"ContainerStarted","Data":"8360126ab9436bb95784dd2bfc2f5d4b0ffd5f282b21544128b83d0e531e99f6"}
Jul 16 09:02:01.680882 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:01.680786    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np" podUID="0ce0dee9-79ef-4215-805b-769c370f4d87" containerName="discovery" containerID="cri-o://4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102" gracePeriod=30
Jul 16 09:02:01.932133 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:01.932060    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:01.950495 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:01.950465    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:02:02.018402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.017685    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-cacerts\") pod \"0ce0dee9-79ef-4215-805b-769c370f4d87\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") "
Jul 16 09:02:02.018402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.017751    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-ca-configmap\") pod \"0ce0dee9-79ef-4215-805b-769c370f4d87\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") "
Jul 16 09:02:02.018402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.017806    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-dns-cert\") pod \"0ce0dee9-79ef-4215-805b-769c370f4d87\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") "
Jul 16 09:02:02.018402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.017839    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-token\") pod \"0ce0dee9-79ef-4215-805b-769c370f4d87\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") "
Jul 16 09:02:02.018402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.017872    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-kubeconfig\") pod \"0ce0dee9-79ef-4215-805b-769c370f4d87\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") "
Jul 16 09:02:02.018402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.017898    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bmvr\" (UniqueName: \"kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-kube-api-access-9bmvr\") pod \"0ce0dee9-79ef-4215-805b-769c370f4d87\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") "
Jul 16 09:02:02.018402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.017943    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce0dee9-79ef-4215-805b-769c370f4d87-local-certs\") pod \"0ce0dee9-79ef-4215-805b-769c370f4d87\" (UID: \"0ce0dee9-79ef-4215-805b-769c370f4d87\") "
Jul 16 09:02:02.019744 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.019373    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0ce0dee9-79ef-4215-805b-769c370f4d87" (UID: "0ce0dee9-79ef-4215-805b-769c370f4d87"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:02:02.021875 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.021793    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ce0dee9-79ef-4215-805b-769c370f4d87-local-certs" (OuterVolumeSpecName: "local-certs") pod "0ce0dee9-79ef-4215-805b-769c370f4d87" (UID: "0ce0dee9-79ef-4215-805b-769c370f4d87"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:02:02.022158 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.021904    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0ce0dee9-79ef-4215-805b-769c370f4d87" (UID: "0ce0dee9-79ef-4215-805b-769c370f4d87"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:02:02.022242 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.022200    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ce0dee9-79ef-4215-805b-769c370f4d87" (UID: "0ce0dee9-79ef-4215-805b-769c370f4d87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:02:02.022789 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.022763    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-kube-api-access-9bmvr" (OuterVolumeSpecName: "kube-api-access-9bmvr") pod "0ce0dee9-79ef-4215-805b-769c370f4d87" (UID: "0ce0dee9-79ef-4215-805b-769c370f4d87"). InnerVolumeSpecName "kube-api-access-9bmvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:02:02.023091 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.023064    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0ce0dee9-79ef-4215-805b-769c370f4d87" (UID: "0ce0dee9-79ef-4215-805b-769c370f4d87"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:02:02.023267 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.023241    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-cacerts" (OuterVolumeSpecName: "cacerts") pod "0ce0dee9-79ef-4215-805b-769c370f4d87" (UID: "0ce0dee9-79ef-4215-805b-769c370f4d87"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:02:02.052399 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.052286    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:02.120179 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.119802    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-ca-configmap\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:02:02.120179 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.119840    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-csr-dns-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:02:02.120179 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.119855    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:02:02.120179 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.119870    2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-istio-kubeconfig\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:02:02.120179 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.119884    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bmvr\" (UniqueName: \"kubernetes.io/projected/0ce0dee9-79ef-4215-805b-769c370f4d87-kube-api-access-9bmvr\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:02:02.120179 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.119897    2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ce0dee9-79ef-4215-805b-769c370f4d87-local-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:02:02.120179 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.119912    2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ce0dee9-79ef-4215-805b-769c370f4d87-cacerts\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:02:02.686518 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.686481    2570 generic.go:356] "Generic (PLEG): container finished" podID="0ce0dee9-79ef-4215-805b-769c370f4d87" containerID="4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102" exitCode=0
Jul 16 09:02:02.686703 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.686549    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"
Jul 16 09:02:02.686703 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.686569    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np" event={"ID":"0ce0dee9-79ef-4215-805b-769c370f4d87","Type":"ContainerDied","Data":"4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102"}
Jul 16 09:02:02.686703 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.686627    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jp2np" event={"ID":"0ce0dee9-79ef-4215-805b-769c370f4d87","Type":"ContainerDied","Data":"db11b0b03fea67f6bd13735cfc6d9d427b69d3a42515d123a9109fc7ec4e0f49"}
Jul 16 09:02:02.686703 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.686647    2570 scope.go:117] "RemoveContainer" containerID="4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102"
Jul 16 09:02:02.697115 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.697093    2570 scope.go:117] "RemoveContainer" containerID="4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102"
Jul 16 09:02:02.697392 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:02:02.697375    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102\": container with ID starting with 4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102 not found: ID does not exist" containerID="4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102"
Jul 16 09:02:02.697463 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.697415    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102"} err="failed to get container status \"4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102\": rpc error: code = NotFound desc = could not find container \"4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102\": container with ID starting with 4539cc038c351733c4564ced6269cb3bbd921f3b991422cae064aae66e4e5102 not found: ID does not exist"
Jul 16 09:02:02.711917 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.711894    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"]
Jul 16 09:02:02.718934 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.718907    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jp2np"]
Jul 16 09:02:02.976508 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:02.976424    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ce0dee9-79ef-4215-805b-769c370f4d87" path="/var/lib/kubelet/pods/0ce0dee9-79ef-4215-805b-769c370f4d87/volumes"
Jul 16 09:02:04.699703 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:04.699614    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn" event={"ID":"88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb","Type":"ContainerStarted","Data":"783308765c6c8b5b6571d98b7e0407a29509b88ab5d64440fb1944c2e4ddaeec"}
Jul 16 09:02:04.700139 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:04.699706    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"
Jul 16 09:02:04.719821 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:04.719767    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn" podStartSLOduration=1.815126626 podStartE2EDuration="5.719750431s" totalImagesPullingTime="3.904623805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:02:04.718507111 +0000 UTC m=+420.270539840" watchObservedRunningTime="2026-07-16 09:02:04.719750431 +0000 UTC m=+420.271783157"
Jul 16 09:02:05.705761 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:05.705728    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt" event={"ID":"c7c390ef-809d-40ba-a6ef-885c6a040045","Type":"ContainerStarted","Data":"29c80a16333f14f78fdd55598667acf0f9f103c7dce6c777e44c0658763e2f9a"}
Jul 16 09:02:05.724725 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:05.724675    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt" podStartSLOduration=2.736368723 podStartE2EDuration="6.7246587s" totalImagesPullingTime="3.988289977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:02:05.722913965 +0000 UTC m=+421.274946690" watchObservedRunningTime="2026-07-16 09:02:05.7246587 +0000 UTC m=+421.276691425"
Jul 16 09:02:06.710684 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:06.710643    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:07.663894 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:07.663863    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lzrvl"
Jul 16 09:02:07.666207 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:07.666181    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-85qgr"
Jul 16 09:02:34.907858 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:34.907824    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:35.711062 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:35.711025    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9bbqn"
Jul 16 09:02:37.718517 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:37.718485    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xj8nt"
Jul 16 09:02:45.185932 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:45.185895    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:45.240290 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:45.240254    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:49.795110 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.795059    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:49.898101 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.898052    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:49.954446 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.954414    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4cslt"]
Jul 16 09:02:49.954744 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.954733    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce0dee9-79ef-4215-805b-769c370f4d87" containerName="discovery"
Jul 16 09:02:49.954789 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.954746    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce0dee9-79ef-4215-805b-769c370f4d87" containerName="discovery"
Jul 16 09:02:49.954822 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.954810    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ce0dee9-79ef-4215-805b-769c370f4d87" containerName="discovery"
Jul 16 09:02:49.956746 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.956726    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4cslt"
Jul 16 09:02:49.959575 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.959549    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 09:02:49.960408 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.960384    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zzcn7\""
Jul 16 09:02:49.960522 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.960417    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 09:02:49.966189 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:49.966164    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4cslt"]
Jul 16 09:02:50.003211 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.003178    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82tdr\" (UniqueName: \"kubernetes.io/projected/b6e4c241-c548-4d5d-98d6-e730931226ce-kube-api-access-82tdr\") pod \"kuadrant-operator-catalog-4cslt\" (UID: \"b6e4c241-c548-4d5d-98d6-e730931226ce\") " pod="kuadrant-system/kuadrant-operator-catalog-4cslt"
Jul 16 09:02:50.008682 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.008647    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:50.104600 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.104567    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82tdr\" (UniqueName: \"kubernetes.io/projected/b6e4c241-c548-4d5d-98d6-e730931226ce-kube-api-access-82tdr\") pod \"kuadrant-operator-catalog-4cslt\" (UID: \"b6e4c241-c548-4d5d-98d6-e730931226ce\") " pod="kuadrant-system/kuadrant-operator-catalog-4cslt"
Jul 16 09:02:50.112801 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.112779    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82tdr\" (UniqueName: \"kubernetes.io/projected/b6e4c241-c548-4d5d-98d6-e730931226ce-kube-api-access-82tdr\") pod \"kuadrant-operator-catalog-4cslt\" (UID: \"b6e4c241-c548-4d5d-98d6-e730931226ce\") " pod="kuadrant-system/kuadrant-operator-catalog-4cslt"
Jul 16 09:02:50.269166 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.269128    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4cslt"
Jul 16 09:02:50.310219 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.310184    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4cslt"]
Jul 16 09:02:50.395960 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.395934    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4cslt"]
Jul 16 09:02:50.398137 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:02:50.398108    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e4c241_c548_4d5d_98d6_e730931226ce.slice/crio-b5fb31e745c451664d4e826a63690a95cad4d01ecf6abebadae452b5a778b95e WatchSource:0}: Error finding container b5fb31e745c451664d4e826a63690a95cad4d01ecf6abebadae452b5a778b95e: Status 404 returned error can't find the container with id b5fb31e745c451664d4e826a63690a95cad4d01ecf6abebadae452b5a778b95e
Jul 16 09:02:50.527306 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.527264    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sfnzl"]
Jul 16 09:02:50.530271 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.530245    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sfnzl"
Jul 16 09:02:50.539487 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.539463    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sfnzl"]
Jul 16 09:02:50.609262 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.609218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqfzc\" (UniqueName: \"kubernetes.io/projected/42a6c65f-1eb3-4b18-acd5-475f92f1e1d1-kube-api-access-hqfzc\") pod \"kuadrant-operator-catalog-sfnzl\" (UID: \"42a6c65f-1eb3-4b18-acd5-475f92f1e1d1\") " pod="kuadrant-system/kuadrant-operator-catalog-sfnzl"
Jul 16 09:02:50.710229 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.710125    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqfzc\" (UniqueName: \"kubernetes.io/projected/42a6c65f-1eb3-4b18-acd5-475f92f1e1d1-kube-api-access-hqfzc\") pod \"kuadrant-operator-catalog-sfnzl\" (UID: \"42a6c65f-1eb3-4b18-acd5-475f92f1e1d1\") " pod="kuadrant-system/kuadrant-operator-catalog-sfnzl"
Jul 16 09:02:50.720411 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.720382    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqfzc\" (UniqueName: \"kubernetes.io/projected/42a6c65f-1eb3-4b18-acd5-475f92f1e1d1-kube-api-access-hqfzc\") pod \"kuadrant-operator-catalog-sfnzl\" (UID: \"42a6c65f-1eb3-4b18-acd5-475f92f1e1d1\") " pod="kuadrant-system/kuadrant-operator-catalog-sfnzl"
Jul 16 09:02:50.756385 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.756343    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:50.840212 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.840173    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sfnzl"
Jul 16 09:02:50.904774 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.904722    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4cslt" event={"ID":"b6e4c241-c548-4d5d-98d6-e730931226ce","Type":"ContainerStarted","Data":"b5fb31e745c451664d4e826a63690a95cad4d01ecf6abebadae452b5a778b95e"}
Jul 16 09:02:50.954194 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.954146    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:02:50.979848 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:50.979781    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sfnzl"]
Jul 16 09:02:50.981874 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:02:50.981849    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a6c65f_1eb3_4b18_acd5_475f92f1e1d1.slice/crio-92e33d65fa6ffef3274b9c1fd4951ff26ea614f28e5aba5c081d73caf9d5084b WatchSource:0}: Error finding container 92e33d65fa6ffef3274b9c1fd4951ff26ea614f28e5aba5c081d73caf9d5084b: Status 404 returned error can't find the container with id 92e33d65fa6ffef3274b9c1fd4951ff26ea614f28e5aba5c081d73caf9d5084b
Jul 16 09:02:51.913033 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:51.912971    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sfnzl" event={"ID":"42a6c65f-1eb3-4b18-acd5-475f92f1e1d1","Type":"ContainerStarted","Data":"92e33d65fa6ffef3274b9c1fd4951ff26ea614f28e5aba5c081d73caf9d5084b"}
Jul 16 09:02:52.918461 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:52.918364    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4cslt" event={"ID":"b6e4c241-c548-4d5d-98d6-e730931226ce","Type":"ContainerStarted","Data":"6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e"}
Jul 16 09:02:52.918461 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:52.918445    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4cslt" podUID="b6e4c241-c548-4d5d-98d6-e730931226ce" containerName="registry-server" containerID="cri-o://6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e" gracePeriod=2
Jul 16 09:02:52.919897 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:52.919871    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sfnzl" event={"ID":"42a6c65f-1eb3-4b18-acd5-475f92f1e1d1","Type":"ContainerStarted","Data":"bd4e33a139280d312eaf8dc5b9379f79b95deaa98148b83355f8661a0ba246db"}
Jul 16 09:02:52.933435 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:52.933386    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4cslt" podStartSLOduration=1.6504012110000001 podStartE2EDuration="3.933368037s" totalImagesPullingTime="2.282966826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:02:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:02:52.933356047 +0000 UTC m=+468.485388775" watchObservedRunningTime="2026-07-16 09:02:52.933368037 +0000 UTC m=+468.485400766"
Jul 16 09:02:52.949362 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:52.949325    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sfnzl" podStartSLOduration=1.253605683 podStartE2EDuration="2.949288743s" totalImagesPullingTime="1.69568306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:02:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:02:52.948427836 +0000 UTC m=+468.500460562" watchObservedRunningTime="2026-07-16 09:02:52.949288743 +0000 UTC m=+468.501321469"
Jul 16 09:02:53.151619 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.151593    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4cslt"
Jul 16 09:02:53.235110 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.235009    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82tdr\" (UniqueName: \"kubernetes.io/projected/b6e4c241-c548-4d5d-98d6-e730931226ce-kube-api-access-82tdr\") pod \"b6e4c241-c548-4d5d-98d6-e730931226ce\" (UID: \"b6e4c241-c548-4d5d-98d6-e730931226ce\") "
Jul 16 09:02:53.237157 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.237133    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e4c241-c548-4d5d-98d6-e730931226ce-kube-api-access-82tdr" (OuterVolumeSpecName: "kube-api-access-82tdr") pod "b6e4c241-c548-4d5d-98d6-e730931226ce" (UID: "b6e4c241-c548-4d5d-98d6-e730931226ce"). InnerVolumeSpecName "kube-api-access-82tdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:02:53.335946 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.335913    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82tdr\" (UniqueName: \"kubernetes.io/projected/b6e4c241-c548-4d5d-98d6-e730931226ce-kube-api-access-82tdr\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:02:53.924813 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.924773    2570 generic.go:356] "Generic (PLEG): container finished" podID="b6e4c241-c548-4d5d-98d6-e730931226ce" containerID="6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e" exitCode=0
Jul 16 09:02:53.924813 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.924815    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4cslt"
Jul 16 09:02:53.925290 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.924851    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4cslt" event={"ID":"b6e4c241-c548-4d5d-98d6-e730931226ce","Type":"ContainerDied","Data":"6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e"}
Jul 16 09:02:53.925290 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.924905    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4cslt" event={"ID":"b6e4c241-c548-4d5d-98d6-e730931226ce","Type":"ContainerDied","Data":"b5fb31e745c451664d4e826a63690a95cad4d01ecf6abebadae452b5a778b95e"}
Jul 16 09:02:53.925290 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.924925    2570 scope.go:117] "RemoveContainer" containerID="6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e"
Jul 16 09:02:53.934689 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.934677    2570 scope.go:117] "RemoveContainer" containerID="6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e"
Jul 16 09:02:53.934951 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:02:53.934934    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e\": container with ID starting with 6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e not found: ID does not exist" containerID="6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e"
Jul 16 09:02:53.934991 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.934960    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e"} err="failed to get container status \"6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e\": rpc error: code = NotFound desc = could not find container \"6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e\": container with ID starting with 6e331160eb56e76bcb4c47f47f477f569a9be1f8fc97d29b0639680cc702b17e not found: ID does not exist"
Jul 16 09:02:53.946398 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.946375    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4cslt"]
Jul 16 09:02:53.950562 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:53.950497    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4cslt"]
Jul 16 09:02:54.970776 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:02:54.970742    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6e4c241-c548-4d5d-98d6-e730931226ce" path="/var/lib/kubelet/pods/b6e4c241-c548-4d5d-98d6-e730931226ce/volumes"
Jul 16 09:03:00.840478 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:00.840449    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sfnzl"
Jul 16 09:03:00.845928 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:00.845907    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sfnzl"
Jul 16 09:03:00.862777 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:00.862754    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sfnzl"
Jul 16 09:03:00.981274 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:00.981242    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sfnzl"
Jul 16 09:03:06.388126 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.388089    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-849c9464f9-tcqw6"]
Jul 16 09:03:06.388790 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.388629    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e4c241-c548-4d5d-98d6-e730931226ce" containerName="registry-server"
Jul 16 09:03:06.388790 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.388652    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e4c241-c548-4d5d-98d6-e730931226ce" containerName="registry-server"
Jul 16 09:03:06.388790 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.388742    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e4c241-c548-4d5d-98d6-e730931226ce" containerName="registry-server"
Jul 16 09:03:06.393055 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.393032    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.395492 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.395465    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 09:03:06.395699 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.395681    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 09:03:06.396496 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.396475    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 09:03:06.396642 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.396475    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fs8z9\""
Jul 16 09:03:06.396642 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.396478    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 09:03:06.396642 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.396483    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 09:03:06.396642 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.396521    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 09:03:06.396642 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.396638    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 09:03:06.401348 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.401328    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 09:03:06.403999 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.403977    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849c9464f9-tcqw6"]
Jul 16 09:03:06.440472 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.440428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:06.495619 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.495587    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:06.549102 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.549062    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-trusted-ca-bundle\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.549245 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.549122    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srkc8\" (UniqueName: \"kubernetes.io/projected/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-kube-api-access-srkc8\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.549245 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.549191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-console-serving-cert\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.549245 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.549227    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-console-oauth-config\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.549341 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.549249    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-oauth-serving-cert\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.549341 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.549317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-console-config\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.549405 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.549340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-service-ca\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.649973 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.649892    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srkc8\" (UniqueName: \"kubernetes.io/projected/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-kube-api-access-srkc8\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.649973 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.649963    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-console-serving-cert\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.650190 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.650003    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-console-oauth-config\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.650190 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.650135    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-oauth-serving-cert\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.650309 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.650208    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-console-config\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.650309 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.650250    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-service-ca\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.650309 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.650291    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-trusted-ca-bundle\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.650933 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.650908    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-console-config\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.651069 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.650908    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-oauth-serving-cert\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.651069 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.651057    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-service-ca\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.651274 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.651251    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-trusted-ca-bundle\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.652706 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.652679    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-console-serving-cert\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.652849 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.652832    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-console-oauth-config\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.659630 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.659611    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srkc8\" (UniqueName: \"kubernetes.io/projected/d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b-kube-api-access-srkc8\") pod \"console-849c9464f9-tcqw6\" (UID: \"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b\") " pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.703251 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.703214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:06.850005 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.849931    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849c9464f9-tcqw6"]
Jul 16 09:03:06.852206 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:03:06.852173    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f535bb_27de_4d4d_8e55_dbcd6cc1a43b.slice/crio-78c3ca66ab526a95f3643ec94610f87d4b35b904b7ec640bca7f25d100381d13 WatchSource:0}: Error finding container 78c3ca66ab526a95f3643ec94610f87d4b35b904b7ec640bca7f25d100381d13: Status 404 returned error can't find the container with id 78c3ca66ab526a95f3643ec94610f87d4b35b904b7ec640bca7f25d100381d13
Jul 16 09:03:06.989146 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.989112    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849c9464f9-tcqw6" event={"ID":"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b","Type":"ContainerStarted","Data":"f5b15bd146e13322b0a1a0e6b7465aacb780ad4e7388629b22c75cb83627768d"}
Jul 16 09:03:06.989306 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:06.989160    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849c9464f9-tcqw6" event={"ID":"d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b","Type":"ContainerStarted","Data":"78c3ca66ab526a95f3643ec94610f87d4b35b904b7ec640bca7f25d100381d13"}
Jul 16 09:03:07.007510 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:07.007454    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-849c9464f9-tcqw6" podStartSLOduration=1.007434653 podStartE2EDuration="1.007434653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:03:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:03:07.006795988 +0000 UTC m=+482.558828715" watchObservedRunningTime="2026-07-16 09:03:07.007434653 +0000 UTC m=+482.559467379"
Jul 16 09:03:16.703767 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:16.703724    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:16.704166 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:16.703823    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:16.708738 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:16.708709    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:17.035658 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:17.035574    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-849c9464f9-tcqw6"
Jul 16 09:03:17.270288 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:17.270251    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:17.378718 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:17.378685    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:17.471540 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:17.471490    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:19.184591 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:19.184554    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:21.409987 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:21.409954    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"]
Jul 16 09:03:21.414070 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:21.414040    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:03:21.416978 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:21.416960    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tkfwh\""
Jul 16 09:03:21.424578 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:21.424555    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"]
Jul 16 09:03:21.577640 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:21.577601    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpxt5\" (UniqueName: \"kubernetes.io/projected/9c96b597-4172-463c-a63b-6cb0f4d7212c-kube-api-access-dpxt5\") pod \"limitador-operator-controller-manager-859d7b78bd-chxm8\" (UID: \"9c96b597-4172-463c-a63b-6cb0f4d7212c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:03:21.678601 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:21.678481    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpxt5\" (UniqueName: \"kubernetes.io/projected/9c96b597-4172-463c-a63b-6cb0f4d7212c-kube-api-access-dpxt5\") pod \"limitador-operator-controller-manager-859d7b78bd-chxm8\" (UID: \"9c96b597-4172-463c-a63b-6cb0f4d7212c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:03:21.689779 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:21.689746    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpxt5\" (UniqueName: \"kubernetes.io/projected/9c96b597-4172-463c-a63b-6cb0f4d7212c-kube-api-access-dpxt5\") pod \"limitador-operator-controller-manager-859d7b78bd-chxm8\" (UID: \"9c96b597-4172-463c-a63b-6cb0f4d7212c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:03:21.726105 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:21.726060    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:03:21.859691 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:21.859666    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"]
Jul 16 09:03:21.861553 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:03:21.861505    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c96b597_4172_463c_a63b_6cb0f4d7212c.slice/crio-26309950b190d3975ef469682e2bea0798187b03201ee07b75faa7243b22d449 WatchSource:0}: Error finding container 26309950b190d3975ef469682e2bea0798187b03201ee07b75faa7243b22d449: Status 404 returned error can't find the container with id 26309950b190d3975ef469682e2bea0798187b03201ee07b75faa7243b22d449
Jul 16 09:03:22.054671 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:22.054578    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8" event={"ID":"9c96b597-4172-463c-a63b-6cb0f4d7212c","Type":"ContainerStarted","Data":"26309950b190d3975ef469682e2bea0798187b03201ee07b75faa7243b22d449"}
Jul 16 09:03:23.001059 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:23.001014    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:25.137454 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.137419    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9"]
Jul 16 09:03:25.140742 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.140722    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9"
Jul 16 09:03:25.143359 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.143341    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xz6mg\""
Jul 16 09:03:25.143589 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.143571    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 09:03:25.150933 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.150910    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9"]
Jul 16 09:03:25.309421 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.309338    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tddt\" (UniqueName: \"kubernetes.io/projected/25b62c62-a888-49df-bf48-b50b6a6acaeb-kube-api-access-5tddt\") pod \"dns-operator-controller-manager-864dd78c4c-tlgz9\" (UID: \"25b62c62-a888-49df-bf48-b50b6a6acaeb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9"
Jul 16 09:03:25.410689 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.410645    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tddt\" (UniqueName: \"kubernetes.io/projected/25b62c62-a888-49df-bf48-b50b6a6acaeb-kube-api-access-5tddt\") pod \"dns-operator-controller-manager-864dd78c4c-tlgz9\" (UID: \"25b62c62-a888-49df-bf48-b50b6a6acaeb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9"
Jul 16 09:03:25.419399 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.419367    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tddt\" (UniqueName: \"kubernetes.io/projected/25b62c62-a888-49df-bf48-b50b6a6acaeb-kube-api-access-5tddt\") pod \"dns-operator-controller-manager-864dd78c4c-tlgz9\" (UID: \"25b62c62-a888-49df-bf48-b50b6a6acaeb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9"
Jul 16 09:03:25.452034 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.452006    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9"
Jul 16 09:03:25.593454 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.593429    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9"]
Jul 16 09:03:25.595887 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:03:25.595857    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b62c62_a888_49df_bf48_b50b6a6acaeb.slice/crio-b75e08a28f0a03755c333c00a1a5916cc22a04e821bf8f04643e08ec0060d3a8 WatchSource:0}: Error finding container b75e08a28f0a03755c333c00a1a5916cc22a04e821bf8f04643e08ec0060d3a8: Status 404 returned error can't find the container with id b75e08a28f0a03755c333c00a1a5916cc22a04e821bf8f04643e08ec0060d3a8
Jul 16 09:03:25.926838 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:25.926750    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:26.079243 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:26.079206    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8" event={"ID":"9c96b597-4172-463c-a63b-6cb0f4d7212c","Type":"ContainerStarted","Data":"f6d0742aaf740ef15796bd4451663fc29fcf80ae7b516fd0e33dd06d902ce7d8"}
Jul 16 09:03:26.079435 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:26.079327    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:03:26.080558 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:26.080519    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9" event={"ID":"25b62c62-a888-49df-bf48-b50b6a6acaeb","Type":"ContainerStarted","Data":"b75e08a28f0a03755c333c00a1a5916cc22a04e821bf8f04643e08ec0060d3a8"}
Jul 16 09:03:26.102259 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:26.102211    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8" podStartSLOduration=1.91919926 podStartE2EDuration="5.102195199s" totalImagesPullingTime="3.182995939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:03:26.100496105 +0000 UTC m=+501.652528844" watchObservedRunningTime="2026-07-16 09:03:26.102195199 +0000 UTC m=+501.654227925"
Jul 16 09:03:26.187899 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:26.187807    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:26.617652 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:26.617612    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:28.092449 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.092414    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9" event={"ID":"25b62c62-a888-49df-bf48-b50b6a6acaeb","Type":"ContainerStarted","Data":"9db597a277183735623c319b2616f4b184dbd445aa70661afbeee85bb08ce5ff"}
Jul 16 09:03:28.092864 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.092680    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9"
Jul 16 09:03:28.109597 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.109550    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9" podStartSLOduration=1.104180847 podStartE2EDuration="3.109512689s" totalImagesPullingTime="2.005331842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:03:28.10925664 +0000 UTC m=+503.661289358" watchObservedRunningTime="2026-07-16 09:03:28.109512689 +0000 UTC m=+503.661545416"
Jul 16 09:03:28.399341 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.399217    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:28.774702 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.774627    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp"]
Jul 16 09:03:28.777896 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.777875    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp"
Jul 16 09:03:28.780371 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.780352    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4sqmd\""
Jul 16 09:03:28.787937 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.787902    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp"]
Jul 16 09:03:28.838191 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.838160    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhqjn\" (UniqueName: \"kubernetes.io/projected/58ab0f98-4196-4a30-a505-14b07cfc233d-kube-api-access-mhqjn\") pod \"authorino-operator-75cc8d5cb7-xnrcp\" (UID: \"58ab0f98-4196-4a30-a505-14b07cfc233d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp"
Jul 16 09:03:28.939153 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.939122    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhqjn\" (UniqueName: \"kubernetes.io/projected/58ab0f98-4196-4a30-a505-14b07cfc233d-kube-api-access-mhqjn\") pod \"authorino-operator-75cc8d5cb7-xnrcp\" (UID: \"58ab0f98-4196-4a30-a505-14b07cfc233d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp"
Jul 16 09:03:28.949965 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:28.949943    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhqjn\" (UniqueName: \"kubernetes.io/projected/58ab0f98-4196-4a30-a505-14b07cfc233d-kube-api-access-mhqjn\") pod \"authorino-operator-75cc8d5cb7-xnrcp\" (UID: \"58ab0f98-4196-4a30-a505-14b07cfc233d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp"
Jul 16 09:03:29.089875 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:29.089839    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp"
Jul 16 09:03:29.261548 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:29.261493    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp"]
Jul 16 09:03:29.265957 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:03:29.265904    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ab0f98_4196_4a30_a505_14b07cfc233d.slice/crio-a927d16fda06ade4d636ae776a811e8cf34e6d7a2e0605a98cd5daf9d3c1ab88 WatchSource:0}: Error finding container a927d16fda06ade4d636ae776a811e8cf34e6d7a2e0605a98cd5daf9d3c1ab88: Status 404 returned error can't find the container with id a927d16fda06ade4d636ae776a811e8cf34e6d7a2e0605a98cd5daf9d3c1ab88
Jul 16 09:03:29.576504 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:29.576464    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:29.863435 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:29.863352    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:30.107466 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:30.107426    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp" event={"ID":"58ab0f98-4196-4a30-a505-14b07cfc233d","Type":"ContainerStarted","Data":"a927d16fda06ade4d636ae776a811e8cf34e6d7a2e0605a98cd5daf9d3c1ab88"}
Jul 16 09:03:31.614774 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:31.614726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:33.123214 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.123173    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp" event={"ID":"58ab0f98-4196-4a30-a505-14b07cfc233d","Type":"ContainerStarted","Data":"c1df8dc3d7e7949bab8e4d09bf6d3dd10b6da95064f72be3e8406fd6efeebab1"}
Jul 16 09:03:33.123642 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.123319    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp"
Jul 16 09:03:33.143316 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.143263    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp" podStartSLOduration=1.492330186 podStartE2EDuration="5.143247297s" totalImagesPullingTime="3.650917111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:03:33.141519084 +0000 UTC m=+508.693551837" watchObservedRunningTime="2026-07-16 09:03:33.143247297 +0000 UTC m=+508.695280023"
Jul 16 09:03:33.683908 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.683871    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"]
Jul 16 09:03:33.687612 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.687589    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:33.689873 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.689854    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wxqz8\""
Jul 16 09:03:33.702876 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.702847    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"]
Jul 16 09:03:33.777988 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.777952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/369062fd-68de-4417-853c-6444fc0a0ee8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" (UID: \"369062fd-68de-4417-853c-6444fc0a0ee8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:33.778165 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.778026    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4k6\" (UniqueName: \"kubernetes.io/projected/369062fd-68de-4417-853c-6444fc0a0ee8-kube-api-access-rf4k6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" (UID: \"369062fd-68de-4417-853c-6444fc0a0ee8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:33.879244 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.879210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4k6\" (UniqueName: \"kubernetes.io/projected/369062fd-68de-4417-853c-6444fc0a0ee8-kube-api-access-rf4k6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" (UID: \"369062fd-68de-4417-853c-6444fc0a0ee8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:33.879360 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.879270    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/369062fd-68de-4417-853c-6444fc0a0ee8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" (UID: \"369062fd-68de-4417-853c-6444fc0a0ee8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:33.879695 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.879678    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/369062fd-68de-4417-853c-6444fc0a0ee8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" (UID: \"369062fd-68de-4417-853c-6444fc0a0ee8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:33.899224 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.899200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4k6\" (UniqueName: \"kubernetes.io/projected/369062fd-68de-4417-853c-6444fc0a0ee8-kube-api-access-rf4k6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" (UID: \"369062fd-68de-4417-853c-6444fc0a0ee8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:33.998693 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:33.998615    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:34.137021 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:34.136991    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"]
Jul 16 09:03:34.140572 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:03:34.140545    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369062fd_68de_4417_853c_6444fc0a0ee8.slice/crio-e4283b92eba4b70889e3c1459eb043986d466c305507319f34983dc4196c868e WatchSource:0}: Error finding container e4283b92eba4b70889e3c1459eb043986d466c305507319f34983dc4196c868e: Status 404 returned error can't find the container with id e4283b92eba4b70889e3c1459eb043986d466c305507319f34983dc4196c868e
Jul 16 09:03:35.133057 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:35.133021    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s" event={"ID":"369062fd-68de-4417-853c-6444fc0a0ee8","Type":"ContainerStarted","Data":"e4283b92eba4b70889e3c1459eb043986d466c305507319f34983dc4196c868e"}
Jul 16 09:03:35.257088 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:35.257003    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:35.358771 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:35.358739    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:37.089698 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:37.089665    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:03:38.574052 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:38.574018    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:38.642224 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:38.642186    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:39.102679 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:39.102649    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tlgz9"
Jul 16 09:03:41.165475 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:41.165438    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s" event={"ID":"369062fd-68de-4417-853c-6444fc0a0ee8","Type":"ContainerStarted","Data":"e4698ae6f27e3da9d62480d49ced36ebade84779e828f7e92076a0a1da4f701c"}
Jul 16 09:03:41.165872 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:41.165505    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:41.191442 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:41.191395    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s" podStartSLOduration=1.893131007 podStartE2EDuration="8.191378775s" totalImagesPullingTime="6.298247768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:03:41.189314963 +0000 UTC m=+516.741347693" watchObservedRunningTime="2026-07-16 09:03:41.191378775 +0000 UTC m=+516.743411568"
Jul 16 09:03:43.170451 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.170412    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"]
Jul 16 09:03:43.174229 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.174206    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.176628 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.176606    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 09:03:43.176827 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.176809    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6dz8w\""
Jul 16 09:03:43.176909 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.176846    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 09:03:43.187591 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.187565    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"]
Jul 16 09:03:43.192265 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.192237    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:43.261924 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.261874    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/35e510b8-1f33-47d0-8752-2354f457dfc5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4n6r5\" (UID: \"35e510b8-1f33-47d0-8752-2354f457dfc5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.262110 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.261939    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5x9\" (UniqueName: \"kubernetes.io/projected/35e510b8-1f33-47d0-8752-2354f457dfc5-kube-api-access-gm5x9\") pod \"kuadrant-console-plugin-66b5774985-4n6r5\" (UID: \"35e510b8-1f33-47d0-8752-2354f457dfc5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.262110 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.261972    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/35e510b8-1f33-47d0-8752-2354f457dfc5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4n6r5\" (UID: \"35e510b8-1f33-47d0-8752-2354f457dfc5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.363362 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.363324    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/35e510b8-1f33-47d0-8752-2354f457dfc5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4n6r5\" (UID: \"35e510b8-1f33-47d0-8752-2354f457dfc5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.363362 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.363370    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5x9\" (UniqueName: \"kubernetes.io/projected/35e510b8-1f33-47d0-8752-2354f457dfc5-kube-api-access-gm5x9\") pod \"kuadrant-console-plugin-66b5774985-4n6r5\" (UID: \"35e510b8-1f33-47d0-8752-2354f457dfc5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.363599 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.363488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/35e510b8-1f33-47d0-8752-2354f457dfc5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4n6r5\" (UID: \"35e510b8-1f33-47d0-8752-2354f457dfc5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.363671 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:03:43.363648    2570 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 16 09:03:43.363743 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:03:43.363730    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e510b8-1f33-47d0-8752-2354f457dfc5-plugin-serving-cert podName:35e510b8-1f33-47d0-8752-2354f457dfc5 nodeName:}" failed. No retries permitted until 2026-07-16 09:03:43.863707814 +0000 UTC m=+519.415740532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/35e510b8-1f33-47d0-8752-2354f457dfc5-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-4n6r5" (UID: "35e510b8-1f33-47d0-8752-2354f457dfc5") : secret "plugin-serving-cert" not found
Jul 16 09:03:43.364139 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.364121    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/35e510b8-1f33-47d0-8752-2354f457dfc5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4n6r5\" (UID: \"35e510b8-1f33-47d0-8752-2354f457dfc5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.374118 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.374077    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5x9\" (UniqueName: \"kubernetes.io/projected/35e510b8-1f33-47d0-8752-2354f457dfc5-kube-api-access-gm5x9\") pod \"kuadrant-console-plugin-66b5774985-4n6r5\" (UID: \"35e510b8-1f33-47d0-8752-2354f457dfc5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.504271 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.504177    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:43.869337 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.869303    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/35e510b8-1f33-47d0-8752-2354f457dfc5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4n6r5\" (UID: \"35e510b8-1f33-47d0-8752-2354f457dfc5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.871858 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.871831    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/35e510b8-1f33-47d0-8752-2354f457dfc5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4n6r5\" (UID: \"35e510b8-1f33-47d0-8752-2354f457dfc5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:43.972569 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:43.972517    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:44.074785 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:44.074742    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:44.084301 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:44.084279    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"
Jul 16 09:03:44.130424 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:44.130327    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xnrcp"
Jul 16 09:03:44.181993 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:44.181953    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:44.225870 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:44.225844    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5"]
Jul 16 09:03:44.227966 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:03:44.227930    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35e510b8_1f33_47d0_8752_2354f457dfc5.slice/crio-567e785b302f0fee1479659ba74f90e01a603225948d992337b59666c023db45 WatchSource:0}: Error finding container 567e785b302f0fee1479659ba74f90e01a603225948d992337b59666c023db45: Status 404 returned error can't find the container with id 567e785b302f0fee1479659ba74f90e01a603225948d992337b59666c023db45
Jul 16 09:03:44.289272 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:44.289238    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:45.187437 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:45.187402    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5" event={"ID":"35e510b8-1f33-47d0-8752-2354f457dfc5","Type":"ContainerStarted","Data":"567e785b302f0fee1479659ba74f90e01a603225948d992337b59666c023db45"}
Jul 16 09:03:47.377216 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:47.377085    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:47.484948 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:47.484905    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:52.172581 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:52.172522    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:53.234283 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.234248    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"]
Jul 16 09:03:53.241406 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.241380    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:03:53.250219 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.250187    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"]
Jul 16 09:03:53.357428 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.357389    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44lz9\" (UniqueName: \"kubernetes.io/projected/b26fae29-0a9c-406c-9ebe-820df579ebbd-kube-api-access-44lz9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" (UID: \"b26fae29-0a9c-406c-9ebe-820df579ebbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:03:53.357635 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.357457    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b26fae29-0a9c-406c-9ebe-820df579ebbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" (UID: \"b26fae29-0a9c-406c-9ebe-820df579ebbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:03:53.458604 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.458560    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b26fae29-0a9c-406c-9ebe-820df579ebbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" (UID: \"b26fae29-0a9c-406c-9ebe-820df579ebbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:03:53.458862 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.458689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44lz9\" (UniqueName: \"kubernetes.io/projected/b26fae29-0a9c-406c-9ebe-820df579ebbd-kube-api-access-44lz9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" (UID: \"b26fae29-0a9c-406c-9ebe-820df579ebbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:03:53.459056 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.459026    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b26fae29-0a9c-406c-9ebe-820df579ebbd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" (UID: \"b26fae29-0a9c-406c-9ebe-820df579ebbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:03:53.468878 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.468842    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44lz9\" (UniqueName: \"kubernetes.io/projected/b26fae29-0a9c-406c-9ebe-820df579ebbd-kube-api-access-44lz9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" (UID: \"b26fae29-0a9c-406c-9ebe-820df579ebbd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:03:53.556860 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.556770    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:03:53.984964 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.984920    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"]
Jul 16 09:03:53.991325 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:53.991298    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"]
Jul 16 09:03:54.004239 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.004203    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"]
Jul 16 09:03:54.004481 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.004422    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" containerName="manager" containerID="cri-o://e4698ae6f27e3da9d62480d49ced36ebade84779e828f7e92076a0a1da4f701c" gracePeriod=2
Jul 16 09:03:54.011700 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.011672    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"]
Jul 16 09:03:54.036433 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.036161    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"]
Jul 16 09:03:54.036822 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.036418    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" containerName="manager" containerID="cri-o://f6d0742aaf740ef15796bd4451663fc29fcf80ae7b516fd0e33dd06d902ce7d8" gracePeriod=2
Jul 16 09:03:54.040173 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.040148    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"]
Jul 16 09:03:54.040778 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.040753    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" containerName="manager"
Jul 16 09:03:54.040778 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.040780    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" containerName="manager"
Jul 16 09:03:54.040931 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.040881    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" containerName="manager"
Jul 16 09:03:54.044340 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.044318    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:03:54.056393 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.055405    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"]
Jul 16 09:03:54.059833 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.059115    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"]
Jul 16 09:03:54.063352 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.063326    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4"]
Jul 16 09:03:54.064085 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.064063    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" containerName="manager"
Jul 16 09:03:54.064233 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.064221    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" containerName="manager"
Jul 16 09:03:54.064432 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.064417    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" containerName="manager"
Jul 16 09:03:54.066919 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:03:54.066659    2570 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c96b597-4172-463c-a63b-6cb0f4d7212c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-chxm8\": pods \"limitador-operator-controller-manager-859d7b78bd-chxm8\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:03:54.068485 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.068422    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4"
Jul 16 09:03:54.069266 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:03:54.069223    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:54.079239 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.079174    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4"]
Jul 16 09:03:54.103391 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:03:54.103350    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-chxm8\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:03:54.105693 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:03:54.105657    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:54.121756 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.121717    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:54.165650 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.165609    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxv7l\" (UniqueName: \"kubernetes.io/projected/f63a2982-ac62-411f-b937-7b0801ef3548-kube-api-access-lxv7l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j5kz\" (UID: \"f63a2982-ac62-411f-b937-7b0801ef3548\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:03:54.165838 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.165679    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f63a2982-ac62-411f-b937-7b0801ef3548-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j5kz\" (UID: \"f63a2982-ac62-411f-b937-7b0801ef3548\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:03:54.165838 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.165735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9bmw\" (UniqueName: \"kubernetes.io/projected/5dbb0aca-bd30-40aa-98d4-d452fdb50e4c-kube-api-access-l9bmw\") pod \"limitador-operator-controller-manager-859d7b78bd-lxsv4\" (UID: \"5dbb0aca-bd30-40aa-98d4-d452fdb50e4c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4"
Jul 16 09:03:54.219724 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.219681    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:54.266603 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.266489    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9bmw\" (UniqueName: \"kubernetes.io/projected/5dbb0aca-bd30-40aa-98d4-d452fdb50e4c-kube-api-access-l9bmw\") pod \"limitador-operator-controller-manager-859d7b78bd-lxsv4\" (UID: \"5dbb0aca-bd30-40aa-98d4-d452fdb50e4c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4"
Jul 16 09:03:54.267053 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.266615    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxv7l\" (UniqueName: \"kubernetes.io/projected/f63a2982-ac62-411f-b937-7b0801ef3548-kube-api-access-lxv7l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j5kz\" (UID: \"f63a2982-ac62-411f-b937-7b0801ef3548\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:03:54.267053 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.266654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f63a2982-ac62-411f-b937-7b0801ef3548-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j5kz\" (UID: \"f63a2982-ac62-411f-b937-7b0801ef3548\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:03:54.267165 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.267055    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f63a2982-ac62-411f-b937-7b0801ef3548-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j5kz\" (UID: \"f63a2982-ac62-411f-b937-7b0801ef3548\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:03:54.279654 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.279623    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxv7l\" (UniqueName: \"kubernetes.io/projected/f63a2982-ac62-411f-b937-7b0801ef3548-kube-api-access-lxv7l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j5kz\" (UID: \"f63a2982-ac62-411f-b937-7b0801ef3548\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:03:54.279809 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.279736    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9bmw\" (UniqueName: \"kubernetes.io/projected/5dbb0aca-bd30-40aa-98d4-d452fdb50e4c-kube-api-access-l9bmw\") pod \"limitador-operator-controller-manager-859d7b78bd-lxsv4\" (UID: \"5dbb0aca-bd30-40aa-98d4-d452fdb50e4c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4"
Jul 16 09:03:54.420931 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.420884    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:03:54.428308 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:54.428284    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4"
Jul 16 09:03:54.970226 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:03:54.970183    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-chxm8\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:03:54.972097 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:03:54.972068    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:03:56.964322 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:56.964216    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:03:57.066968 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:03:57.066920    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:01.782120 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:01.782071    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:01.884250 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:01.884209    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:01.993526 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:01.993485    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:02.084062 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:02.084008    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:06.956814 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:06.956779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:07.022876 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.022837    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:07.325934 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.325859    2570 generic.go:356] "Generic (PLEG): container finished" podID="369062fd-68de-4417-853c-6444fc0a0ee8" containerID="e4698ae6f27e3da9d62480d49ced36ebade84779e828f7e92076a0a1da4f701c" exitCode=0
Jul 16 09:04:07.328064 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.328029    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c96b597-4172-463c-a63b-6cb0f4d7212c" containerID="f6d0742aaf740ef15796bd4451663fc29fcf80ae7b516fd0e33dd06d902ce7d8" exitCode=0
Jul 16 09:04:07.354937 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.354831    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:04:07.357137 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:07.357094    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:04:07.373266 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.373241    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:04:07.375650 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:07.375507    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:04:07.377360 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:07.377333    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-chxm8\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:04:07.382382 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.382362    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4"]
Jul 16 09:04:07.384310 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:04:07.384280    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbb0aca_bd30_40aa_98d4_d452fdb50e4c.slice/crio-cd3ecd28d5b217185f3c22367b6b9547feab8a8ef1fcefad23ea5c9e9978bb8b WatchSource:0}: Error finding container cd3ecd28d5b217185f3c22367b6b9547feab8a8ef1fcefad23ea5c9e9978bb8b: Status 404 returned error can't find the container with id cd3ecd28d5b217185f3c22367b6b9547feab8a8ef1fcefad23ea5c9e9978bb8b
Jul 16 09:04:07.415963 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.415862    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"]
Jul 16 09:04:07.418402 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:04:07.418375    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63a2982_ac62_411f_b937_7b0801ef3548.slice/crio-bf6449f7a41a09fab5315d80017704fb5c3f4f699e6e9dec989d421aa5b0b474 WatchSource:0}: Error finding container bf6449f7a41a09fab5315d80017704fb5c3f4f699e6e9dec989d421aa5b0b474: Status 404 returned error can't find the container with id bf6449f7a41a09fab5315d80017704fb5c3f4f699e6e9dec989d421aa5b0b474
Jul 16 09:04:07.500753 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.500726    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/369062fd-68de-4417-853c-6444fc0a0ee8-extensions-socket-volume\") pod \"369062fd-68de-4417-853c-6444fc0a0ee8\" (UID: \"369062fd-68de-4417-853c-6444fc0a0ee8\") "
Jul 16 09:04:07.500927 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.500787    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf4k6\" (UniqueName: \"kubernetes.io/projected/369062fd-68de-4417-853c-6444fc0a0ee8-kube-api-access-rf4k6\") pod \"369062fd-68de-4417-853c-6444fc0a0ee8\" (UID: \"369062fd-68de-4417-853c-6444fc0a0ee8\") "
Jul 16 09:04:07.500927 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.500873    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpxt5\" (UniqueName: \"kubernetes.io/projected/9c96b597-4172-463c-a63b-6cb0f4d7212c-kube-api-access-dpxt5\") pod \"9c96b597-4172-463c-a63b-6cb0f4d7212c\" (UID: \"9c96b597-4172-463c-a63b-6cb0f4d7212c\") "
Jul 16 09:04:07.501345 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.501282    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/369062fd-68de-4417-853c-6444fc0a0ee8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "369062fd-68de-4417-853c-6444fc0a0ee8" (UID: "369062fd-68de-4417-853c-6444fc0a0ee8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:04:07.502881 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.502850    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/369062fd-68de-4417-853c-6444fc0a0ee8-kube-api-access-rf4k6" (OuterVolumeSpecName: "kube-api-access-rf4k6") pod "369062fd-68de-4417-853c-6444fc0a0ee8" (UID: "369062fd-68de-4417-853c-6444fc0a0ee8"). InnerVolumeSpecName "kube-api-access-rf4k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:04:07.503335 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.503308    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c96b597-4172-463c-a63b-6cb0f4d7212c-kube-api-access-dpxt5" (OuterVolumeSpecName: "kube-api-access-dpxt5") pod "9c96b597-4172-463c-a63b-6cb0f4d7212c" (UID: "9c96b597-4172-463c-a63b-6cb0f4d7212c"). InnerVolumeSpecName "kube-api-access-dpxt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:04:07.602388 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.602358    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpxt5\" (UniqueName: \"kubernetes.io/projected/9c96b597-4172-463c-a63b-6cb0f4d7212c-kube-api-access-dpxt5\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:04:07.602388 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.602386    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/369062fd-68de-4417-853c-6444fc0a0ee8-extensions-socket-volume\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:04:07.602388 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:07.602395    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf4k6\" (UniqueName: \"kubernetes.io/projected/369062fd-68de-4417-853c-6444fc0a0ee8-kube-api-access-rf4k6\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:04:08.333895 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.333860    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:04:08.334358 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.333865    2570 scope.go:117] "RemoveContainer" containerID="f6d0742aaf740ef15796bd4451663fc29fcf80ae7b516fd0e33dd06d902ce7d8"
Jul 16 09:04:08.335760 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.335724    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5" event={"ID":"35e510b8-1f33-47d0-8752-2354f457dfc5","Type":"ContainerStarted","Data":"e9e040bebdd5c41e1bfdf3160b2926d239a1a095e176726768fa5fc98e35dd15"}
Jul 16 09:04:08.336378 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:08.336350    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:04:08.337554 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.337509    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4" event={"ID":"5dbb0aca-bd30-40aa-98d4-d452fdb50e4c","Type":"ContainerStarted","Data":"1b89e60af78837a35ace1bde3a3dee6fdbecc23302b38ab5027b59cd654c4e7e"}
Jul 16 09:04:08.337668 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.337568    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4" event={"ID":"5dbb0aca-bd30-40aa-98d4-d452fdb50e4c","Type":"ContainerStarted","Data":"cd3ecd28d5b217185f3c22367b6b9547feab8a8ef1fcefad23ea5c9e9978bb8b"}
Jul 16 09:04:08.337668 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.337591    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4"
Jul 16 09:04:08.338376 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:08.338350    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-chxm8\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:04:08.339595 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.339574    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz" event={"ID":"f63a2982-ac62-411f-b937-7b0801ef3548","Type":"ContainerStarted","Data":"7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd"}
Jul 16 09:04:08.339708 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.339616    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz" event={"ID":"f63a2982-ac62-411f-b937-7b0801ef3548","Type":"ContainerStarted","Data":"bf6449f7a41a09fab5315d80017704fb5c3f4f699e6e9dec989d421aa5b0b474"}
Jul 16 09:04:08.339708 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.339643    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:04:08.340197 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:08.340172    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:04:08.340969 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.340954    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:04:08.341779 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:08.341754    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-chxm8\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:04:08.344086 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.343861    2570 scope.go:117] "RemoveContainer" containerID="e4698ae6f27e3da9d62480d49ced36ebade84779e828f7e92076a0a1da4f701c"
Jul 16 09:04:08.358182 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.358143    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4" podStartSLOduration=14.358130937 podStartE2EDuration="14.358130937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:04:08.357339442 +0000 UTC m=+543.909372169" watchObservedRunningTime="2026-07-16 09:04:08.358130937 +0000 UTC m=+543.910163663"
Jul 16 09:04:08.375020 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.374981    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4n6r5" podStartSLOduration=2.3511185230000002 podStartE2EDuration="25.374969765s" totalImagesPullingTime="23.023851242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:04:08.374813249 +0000 UTC m=+543.926845976" watchObservedRunningTime="2026-07-16 09:04:08.374969765 +0000 UTC m=+543.927002481"
Jul 16 09:04:08.395154 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.395101    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz" podStartSLOduration=14.395083199 podStartE2EDuration="14.395083199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:04:08.394584078 +0000 UTC m=+543.946616804" watchObservedRunningTime="2026-07-16 09:04:08.395083199 +0000 UTC m=+543.947115927"
Jul 16 09:04:08.396754 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:08.396730    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x264s\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x264s"
Jul 16 09:04:08.400386 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:08.400341    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-chxm8\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chxm8"
Jul 16 09:04:08.971956 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.971927    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="369062fd-68de-4417-853c-6444fc0a0ee8" path="/var/lib/kubelet/pods/369062fd-68de-4417-853c-6444fc0a0ee8/volumes"
Jul 16 09:04:08.972254 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:08.972242    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c96b597-4172-463c-a63b-6cb0f4d7212c" path="/var/lib/kubelet/pods/9c96b597-4172-463c-a63b-6cb0f4d7212c/volumes"
Jul 16 09:04:09.736306 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:09.736259    2570 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-8xc6r_kuadrant-system_b26fae29-0a9c-406c-9ebe-820df579ebbd_0(2e14dc9dc353b4ad15a480b75abd03dc06337cde9036f82fd85f34aee17311e7): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-8xc6r to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 16 09:04:09.736591 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:09.736335    2570 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-8xc6r_kuadrant-system_b26fae29-0a9c-406c-9ebe-820df579ebbd_0(2e14dc9dc353b4ad15a480b75abd03dc06337cde9036f82fd85f34aee17311e7): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-8xc6r to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:04:10.352491 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:10.352456    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:04:10.354874 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:10.354848    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="b26fae29-0a9c-406c-9ebe-820df579ebbd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:04:10.359396 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:10.359374    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:04:10.361472 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:10.361449    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="b26fae29-0a9c-406c-9ebe-820df579ebbd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:04:10.526767 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:10.526716    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b26fae29-0a9c-406c-9ebe-820df579ebbd-extensions-socket-volume\") pod \"b26fae29-0a9c-406c-9ebe-820df579ebbd\" (UID: \"b26fae29-0a9c-406c-9ebe-820df579ebbd\") "
Jul 16 09:04:10.526944 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:10.526786    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44lz9\" (UniqueName: \"kubernetes.io/projected/b26fae29-0a9c-406c-9ebe-820df579ebbd-kube-api-access-44lz9\") pod \"b26fae29-0a9c-406c-9ebe-820df579ebbd\" (UID: \"b26fae29-0a9c-406c-9ebe-820df579ebbd\") "
Jul 16 09:04:10.527003 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:10.526982    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b26fae29-0a9c-406c-9ebe-820df579ebbd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b26fae29-0a9c-406c-9ebe-820df579ebbd" (UID: "b26fae29-0a9c-406c-9ebe-820df579ebbd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:04:10.528876 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:10.528849    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b26fae29-0a9c-406c-9ebe-820df579ebbd-kube-api-access-44lz9" (OuterVolumeSpecName: "kube-api-access-44lz9") pod "b26fae29-0a9c-406c-9ebe-820df579ebbd" (UID: "b26fae29-0a9c-406c-9ebe-820df579ebbd"). InnerVolumeSpecName "kube-api-access-44lz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:04:10.627400 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:10.627320    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b26fae29-0a9c-406c-9ebe-820df579ebbd-extensions-socket-volume\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:04:10.627400 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:10.627346    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44lz9\" (UniqueName: \"kubernetes.io/projected/b26fae29-0a9c-406c-9ebe-820df579ebbd-kube-api-access-44lz9\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:04:10.972001 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:10.971917    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b26fae29-0a9c-406c-9ebe-820df579ebbd" path="/var/lib/kubelet/pods/b26fae29-0a9c-406c-9ebe-820df579ebbd/volumes"
Jul 16 09:04:11.016262 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.016228    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"]
Jul 16 09:04:11.016433 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.016405    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz" podUID="f63a2982-ac62-411f-b937-7b0801ef3548" containerName="manager" containerID="cri-o://7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd" gracePeriod=10
Jul 16 09:04:11.267648 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.267624    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:04:11.358236 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.358207    2570 generic.go:356] "Generic (PLEG): container finished" podID="f63a2982-ac62-411f-b937-7b0801ef3548" containerID="7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd" exitCode=0
Jul 16 09:04:11.358382 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.358267    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"
Jul 16 09:04:11.358382 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.358298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz" event={"ID":"f63a2982-ac62-411f-b937-7b0801ef3548","Type":"ContainerDied","Data":"7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd"}
Jul 16 09:04:11.358382 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.358355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz" event={"ID":"f63a2982-ac62-411f-b937-7b0801ef3548","Type":"ContainerDied","Data":"bf6449f7a41a09fab5315d80017704fb5c3f4f699e6e9dec989d421aa5b0b474"}
Jul 16 09:04:11.358382 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.358383    2570 scope.go:117] "RemoveContainer" containerID="7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd"
Jul 16 09:04:11.358609 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.358409    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:04:11.367071 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.367054    2570 scope.go:117] "RemoveContainer" containerID="7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd"
Jul 16 09:04:11.367340 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:11.367310    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd\": container with ID starting with 7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd not found: ID does not exist" containerID="7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd"
Jul 16 09:04:11.367389 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.367349    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd"} err="failed to get container status \"7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd\": rpc error: code = NotFound desc = could not find container \"7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd\": container with ID starting with 7292c56080a8105d77b5da71b4151f94d6f824cd3d65a7c73471be69e79b7ebd not found: ID does not exist"
Jul 16 09:04:11.377275 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:11.374113    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="b26fae29-0a9c-406c-9ebe-820df579ebbd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:04:11.377275 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:11.376405    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="b26fae29-0a9c-406c-9ebe-820df579ebbd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:04:11.434394 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.434366    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f63a2982-ac62-411f-b937-7b0801ef3548-extensions-socket-volume\") pod \"f63a2982-ac62-411f-b937-7b0801ef3548\" (UID: \"f63a2982-ac62-411f-b937-7b0801ef3548\") "
Jul 16 09:04:11.434583 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.434407    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxv7l\" (UniqueName: \"kubernetes.io/projected/f63a2982-ac62-411f-b937-7b0801ef3548-kube-api-access-lxv7l\") pod \"f63a2982-ac62-411f-b937-7b0801ef3548\" (UID: \"f63a2982-ac62-411f-b937-7b0801ef3548\") "
Jul 16 09:04:11.434757 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.434732    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f63a2982-ac62-411f-b937-7b0801ef3548-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f63a2982-ac62-411f-b937-7b0801ef3548" (UID: "f63a2982-ac62-411f-b937-7b0801ef3548"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:04:11.436411 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.436389    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f63a2982-ac62-411f-b937-7b0801ef3548-kube-api-access-lxv7l" (OuterVolumeSpecName: "kube-api-access-lxv7l") pod "f63a2982-ac62-411f-b937-7b0801ef3548" (UID: "f63a2982-ac62-411f-b937-7b0801ef3548"). InnerVolumeSpecName "kube-api-access-lxv7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:04:11.535603 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.535492    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f63a2982-ac62-411f-b937-7b0801ef3548-extensions-socket-volume\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:04:11.535603 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.535522    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxv7l\" (UniqueName: \"kubernetes.io/projected/f63a2982-ac62-411f-b937-7b0801ef3548-kube-api-access-lxv7l\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:04:11.669133 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:11.669100    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8xc6r\" is forbidden: User \"system:node:ip-10-0-135-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-178.ec2.internal' and this object" podUID="b26fae29-0a9c-406c-9ebe-820df579ebbd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8xc6r"
Jul 16 09:04:11.687117 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.687082    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"]
Jul 16 09:04:11.694257 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:11.694227    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j5kz"]
Jul 16 09:04:12.971213 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:12.971175    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f63a2982-ac62-411f-b937-7b0801ef3548" path="/var/lib/kubelet/pods/f63a2982-ac62-411f-b937-7b0801ef3548/volumes"
Jul 16 09:04:19.349882 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:19.349846    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lxsv4"
Jul 16 09:04:27.408288 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.408256    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"]
Jul 16 09:04:27.409505 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.408969    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f63a2982-ac62-411f-b937-7b0801ef3548" containerName="manager"
Jul 16 09:04:27.409505 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.408994    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f63a2982-ac62-411f-b937-7b0801ef3548" containerName="manager"
Jul 16 09:04:27.409505 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.409146    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f63a2982-ac62-411f-b937-7b0801ef3548" containerName="manager"
Jul 16 09:04:27.422793 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.422759    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.427997 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.425493    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"]
Jul 16 09:04:27.427997 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.427371    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-srcrl\""
Jul 16 09:04:27.427997 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.427766    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 09:04:27.436701 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.436669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:27.463785 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.463754    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.463955 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.463790    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.463955 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.463814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.463955 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.463923    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drjhp\" (UniqueName: \"kubernetes.io/projected/23c48a79-4380-40f6-ad2b-ab5beb81be3b-kube-api-access-drjhp\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.464095 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.463966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.464095 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.464007    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.464199 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.464103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.464199 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.464159    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.464288 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.464218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.565487 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.565448    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.565487 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.565491    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.565749 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.565518    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.565749 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.565561    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.565749 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.565621    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drjhp\" (UniqueName: \"kubernetes.io/projected/23c48a79-4380-40f6-ad2b-ab5beb81be3b-kube-api-access-drjhp\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.565749 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.565651    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.565749 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.565690    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.565749 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.565734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.566060 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.565772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.566327 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.566255    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.566439 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.566325    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.566439 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.566366    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.566566 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.566499    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.566628 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.566604    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.567954 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.567928    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.568085 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.568068    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.574005 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.573979    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c48a79-4380-40f6-ad2b-ab5beb81be3b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.574098 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.574041    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drjhp\" (UniqueName: \"kubernetes.io/projected/23c48a79-4380-40f6-ad2b-ab5beb81be3b-kube-api-access-drjhp\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjqvh\" (UID: \"23c48a79-4380-40f6-ad2b-ab5beb81be3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.671729 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.671636    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:27.741312 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.741281    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:27.907691 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:27.907662    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"]
Jul 16 09:04:27.908875 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:04:27.908850    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c48a79_4380_40f6_ad2b_ab5beb81be3b.slice/crio-22df0258f9422b34d829159b9ff2ffc5c2d07510bd15122042693a1c0c3a88b7 WatchSource:0}: Error finding container 22df0258f9422b34d829159b9ff2ffc5c2d07510bd15122042693a1c0c3a88b7: Status 404 returned error can't find the container with id 22df0258f9422b34d829159b9ff2ffc5c2d07510bd15122042693a1c0c3a88b7
Jul 16 09:04:28.444771 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:28.444739    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh" event={"ID":"23c48a79-4380-40f6-ad2b-ab5beb81be3b","Type":"ContainerStarted","Data":"22df0258f9422b34d829159b9ff2ffc5c2d07510bd15122042693a1c0c3a88b7"}
Jul 16 09:04:30.948492 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:30.948450    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:04:30.948795 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:30.948598    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:04:30.948795 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:30.948649    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:04:31.463969 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:31.463931    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh" event={"ID":"23c48a79-4380-40f6-ad2b-ab5beb81be3b","Type":"ContainerStarted","Data":"906b2508dd7c502bf25552f1f609e41360b9e58c4b299ce2e03dde6faee9244c"}
Jul 16 09:04:31.492908 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:31.492853    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh" podStartSLOduration=1.455651981 podStartE2EDuration="4.492836083s" totalImagesPullingTime="3.037184102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:04:31.491271648 +0000 UTC m=+567.043304374" watchObservedRunningTime="2026-07-16 09:04:31.492836083 +0000 UTC m=+567.044868809"
Jul 16 09:04:31.741780 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:31.741697    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:32.746687 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:32.746655    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:33.474081 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:33.474053    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:33.475147 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:33.475122    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:04:33.737390 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:33.737309    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:33.838286 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:33.838248    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:40.313158 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.313118    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:40.327944 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.327908    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"]
Jul 16 09:04:40.358305 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.358265    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"]
Jul 16 09:04:40.358463 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.358388    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:40.360831 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.360811    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 09:04:40.431867 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.431837    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"]
Jul 16 09:04:40.435278 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.435240    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:40.478364 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.478322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de52e7fc-165c-4a0f-a255-447ede2a7c66-config-file\") pod \"limitador-limitador-64c94fd64f-jt8ll\" (UID: \"de52e7fc-165c-4a0f-a255-447ede2a7c66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:40.478590 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.478383    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7wlm\" (UniqueName: \"kubernetes.io/projected/de52e7fc-165c-4a0f-a255-447ede2a7c66-kube-api-access-b7wlm\") pod \"limitador-limitador-64c94fd64f-jt8ll\" (UID: \"de52e7fc-165c-4a0f-a255-447ede2a7c66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:40.536491 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.536441    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:40.579378 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.579343    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7wlm\" (UniqueName: \"kubernetes.io/projected/de52e7fc-165c-4a0f-a255-447ede2a7c66-kube-api-access-b7wlm\") pod \"limitador-limitador-64c94fd64f-jt8ll\" (UID: \"de52e7fc-165c-4a0f-a255-447ede2a7c66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:40.579618 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.579434    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de52e7fc-165c-4a0f-a255-447ede2a7c66-config-file\") pod \"limitador-limitador-64c94fd64f-jt8ll\" (UID: \"de52e7fc-165c-4a0f-a255-447ede2a7c66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:40.580088 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.580063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de52e7fc-165c-4a0f-a255-447ede2a7c66-config-file\") pod \"limitador-limitador-64c94fd64f-jt8ll\" (UID: \"de52e7fc-165c-4a0f-a255-447ede2a7c66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:40.588047 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.588023    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7wlm\" (UniqueName: \"kubernetes.io/projected/de52e7fc-165c-4a0f-a255-447ede2a7c66-kube-api-access-b7wlm\") pod \"limitador-limitador-64c94fd64f-jt8ll\" (UID: \"de52e7fc-165c-4a0f-a255-447ede2a7c66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:40.668185 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.668148    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:40.758743 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.758703    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:40.803671 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.803647    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"]
Jul 16 09:04:40.805412 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:04:40.805376    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde52e7fc_165c_4a0f_a255_447ede2a7c66.slice/crio-5d39865c02d0a6c5abfc66552cf83af44426806a2f01f5892b179f7f5f9c1d9f WatchSource:0}: Error finding container 5d39865c02d0a6c5abfc66552cf83af44426806a2f01f5892b179f7f5f9c1d9f: Status 404 returned error can't find the container with id 5d39865c02d0a6c5abfc66552cf83af44426806a2f01f5892b179f7f5f9c1d9f
Jul 16 09:04:40.819099 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:40.819071    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:41.151592 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.151555    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6gstv"]
Jul 16 09:04:41.155715 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.155688    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6gstv"
Jul 16 09:04:41.158032 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.158009    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lnl6b\""
Jul 16 09:04:41.162270 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.162241    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6gstv"]
Jul 16 09:04:41.186625 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.186587    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:41.286089 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.286047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnb4w\" (UniqueName: \"kubernetes.io/projected/0fb8117b-91f1-41f8-a181-5a013b8fb086-kube-api-access-rnb4w\") pod \"authorino-58cd955675-6gstv\" (UID: \"0fb8117b-91f1-41f8-a181-5a013b8fb086\") " pod="kuadrant-system/authorino-58cd955675-6gstv"
Jul 16 09:04:41.288063 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.288036    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:41.292335 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.292307    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-b5r5x"]
Jul 16 09:04:41.294936 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.294919    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b5r5x"
Jul 16 09:04:41.302765 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.302741    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b5r5x"]
Jul 16 09:04:41.386609 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.386573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnb4w\" (UniqueName: \"kubernetes.io/projected/0fb8117b-91f1-41f8-a181-5a013b8fb086-kube-api-access-rnb4w\") pod \"authorino-58cd955675-6gstv\" (UID: \"0fb8117b-91f1-41f8-a181-5a013b8fb086\") " pod="kuadrant-system/authorino-58cd955675-6gstv"
Jul 16 09:04:41.386993 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.386664    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw8c6\" (UniqueName: \"kubernetes.io/projected/4c1fc836-5b83-4fff-aa97-c599fafb1fb9-kube-api-access-kw8c6\") pod \"authorino-75d556bd77-b5r5x\" (UID: \"4c1fc836-5b83-4fff-aa97-c599fafb1fb9\") " pod="kuadrant-system/authorino-75d556bd77-b5r5x"
Jul 16 09:04:41.395915 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.395875    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnb4w\" (UniqueName: \"kubernetes.io/projected/0fb8117b-91f1-41f8-a181-5a013b8fb086-kube-api-access-rnb4w\") pod \"authorino-58cd955675-6gstv\" (UID: \"0fb8117b-91f1-41f8-a181-5a013b8fb086\") " pod="kuadrant-system/authorino-58cd955675-6gstv"
Jul 16 09:04:41.467731 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.467649    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6gstv"
Jul 16 09:04:41.487930 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.487900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw8c6\" (UniqueName: \"kubernetes.io/projected/4c1fc836-5b83-4fff-aa97-c599fafb1fb9-kube-api-access-kw8c6\") pod \"authorino-75d556bd77-b5r5x\" (UID: \"4c1fc836-5b83-4fff-aa97-c599fafb1fb9\") " pod="kuadrant-system/authorino-75d556bd77-b5r5x"
Jul 16 09:04:41.496949 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.496921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw8c6\" (UniqueName: \"kubernetes.io/projected/4c1fc836-5b83-4fff-aa97-c599fafb1fb9-kube-api-access-kw8c6\") pod \"authorino-75d556bd77-b5r5x\" (UID: \"4c1fc836-5b83-4fff-aa97-c599fafb1fb9\") " pod="kuadrant-system/authorino-75d556bd77-b5r5x"
Jul 16 09:04:41.519403 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.519334    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll" event={"ID":"de52e7fc-165c-4a0f-a255-447ede2a7c66","Type":"ContainerStarted","Data":"5d39865c02d0a6c5abfc66552cf83af44426806a2f01f5892b179f7f5f9c1d9f"}
Jul 16 09:04:41.604898 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.604865    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b5r5x"
Jul 16 09:04:41.618428 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.618395    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6gstv"]
Jul 16 09:04:41.621377 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:04:41.621337    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fb8117b_91f1_41f8_a181_5a013b8fb086.slice/crio-bf1a1cd9852fa16a91f99259e1d2fb7016ccf854f30efbea0390631a6f7d907e WatchSource:0}: Error finding container bf1a1cd9852fa16a91f99259e1d2fb7016ccf854f30efbea0390631a6f7d907e: Status 404 returned error can't find the container with id bf1a1cd9852fa16a91f99259e1d2fb7016ccf854f30efbea0390631a6f7d907e
Jul 16 09:04:41.758651 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:41.758560    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b5r5x"]
Jul 16 09:04:41.762107 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:04:41.762069    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c1fc836_5b83_4fff_aa97_c599fafb1fb9.slice/crio-c06a1f126d87c51af142f7335e29d544e6f547485f1a99d752efadec39dc579f WatchSource:0}: Error finding container c06a1f126d87c51af142f7335e29d544e6f547485f1a99d752efadec39dc579f: Status 404 returned error can't find the container with id c06a1f126d87c51af142f7335e29d544e6f547485f1a99d752efadec39dc579f
Jul 16 09:04:42.528767 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:42.528725    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6gstv" event={"ID":"0fb8117b-91f1-41f8-a181-5a013b8fb086","Type":"ContainerStarted","Data":"bf1a1cd9852fa16a91f99259e1d2fb7016ccf854f30efbea0390631a6f7d907e"}
Jul 16 09:04:42.530551 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:42.530505    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b5r5x" event={"ID":"4c1fc836-5b83-4fff-aa97-c599fafb1fb9","Type":"ContainerStarted","Data":"c06a1f126d87c51af142f7335e29d544e6f547485f1a99d752efadec39dc579f"}
Jul 16 09:04:46.554602 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:46.554561    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b5r5x" event={"ID":"4c1fc836-5b83-4fff-aa97-c599fafb1fb9","Type":"ContainerStarted","Data":"073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c"}
Jul 16 09:04:46.556000 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:46.555973    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll" event={"ID":"de52e7fc-165c-4a0f-a255-447ede2a7c66","Type":"ContainerStarted","Data":"d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec"}
Jul 16 09:04:46.556134 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:46.556066    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:46.557420 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:46.557396    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6gstv" event={"ID":"0fb8117b-91f1-41f8-a181-5a013b8fb086","Type":"ContainerStarted","Data":"f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf"}
Jul 16 09:04:46.571900 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:46.571857    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-b5r5x" podStartSLOduration=1.755318945 podStartE2EDuration="5.571843788s" totalImagesPullingTime="3.816524843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:04:46.570501034 +0000 UTC m=+582.122533752" watchObservedRunningTime="2026-07-16 09:04:46.571843788 +0000 UTC m=+582.123876493"
Jul 16 09:04:46.589942 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:46.589890    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll" podStartSLOduration=1.823921777 podStartE2EDuration="6.58987554s" totalImagesPullingTime="4.765953763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:04:46.588285326 +0000 UTC m=+582.140318052" watchObservedRunningTime="2026-07-16 09:04:46.58987554 +0000 UTC m=+582.141908266"
Jul 16 09:04:46.603057 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:46.603029    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6gstv"]
Jul 16 09:04:46.612429 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:46.612376    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6gstv" podStartSLOduration=1.658159623 podStartE2EDuration="5.612360349s" totalImagesPullingTime="3.954200726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:04:46.61189523 +0000 UTC m=+582.163927959" watchObservedRunningTime="2026-07-16 09:04:46.612360349 +0000 UTC m=+582.164393074"
Jul 16 09:04:48.566262 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:48.566217    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6gstv" podUID="0fb8117b-91f1-41f8-a181-5a013b8fb086" containerName="authorino" containerID="cri-o://f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf" gracePeriod=30
Jul 16 09:04:48.818258 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:48.818240    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6gstv"
Jul 16 09:04:48.960259 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:48.960230    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnb4w\" (UniqueName: \"kubernetes.io/projected/0fb8117b-91f1-41f8-a181-5a013b8fb086-kube-api-access-rnb4w\") pod \"0fb8117b-91f1-41f8-a181-5a013b8fb086\" (UID: \"0fb8117b-91f1-41f8-a181-5a013b8fb086\") "
Jul 16 09:04:48.962226 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:48.962202    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fb8117b-91f1-41f8-a181-5a013b8fb086-kube-api-access-rnb4w" (OuterVolumeSpecName: "kube-api-access-rnb4w") pod "0fb8117b-91f1-41f8-a181-5a013b8fb086" (UID: "0fb8117b-91f1-41f8-a181-5a013b8fb086"). InnerVolumeSpecName "kube-api-access-rnb4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:04:49.060885 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:49.060850    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnb4w\" (UniqueName: \"kubernetes.io/projected/0fb8117b-91f1-41f8-a181-5a013b8fb086-kube-api-access-rnb4w\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:04:49.572192 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:49.572153    2570 generic.go:356] "Generic (PLEG): container finished" podID="0fb8117b-91f1-41f8-a181-5a013b8fb086" containerID="f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf" exitCode=0
Jul 16 09:04:49.572676 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:49.572204    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6gstv"
Jul 16 09:04:49.572676 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:49.572237    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6gstv" event={"ID":"0fb8117b-91f1-41f8-a181-5a013b8fb086","Type":"ContainerDied","Data":"f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf"}
Jul 16 09:04:49.572676 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:49.572280    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6gstv" event={"ID":"0fb8117b-91f1-41f8-a181-5a013b8fb086","Type":"ContainerDied","Data":"bf1a1cd9852fa16a91f99259e1d2fb7016ccf854f30efbea0390631a6f7d907e"}
Jul 16 09:04:49.572676 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:49.572299    2570 scope.go:117] "RemoveContainer" containerID="f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf"
Jul 16 09:04:49.580543 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:49.580513    2570 scope.go:117] "RemoveContainer" containerID="f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf"
Jul 16 09:04:49.580819 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:49.580797    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf\": container with ID starting with f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf not found: ID does not exist" containerID="f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf"
Jul 16 09:04:49.580900 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:49.580827    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf"} err="failed to get container status \"f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf\": rpc error: code = NotFound desc = could not find container \"f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf\": container with ID starting with f46e93eaf3052d66192f5e86a2306301d160e5705d31d790c32450a15b2268bf not found: ID does not exist"
Jul 16 09:04:49.590147 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:49.590123    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6gstv"]
Jul 16 09:04:49.595094 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:49.595074    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6gstv"]
Jul 16 09:04:50.972337 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:50.972302    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fb8117b-91f1-41f8-a181-5a013b8fb086" path="/var/lib/kubelet/pods/0fb8117b-91f1-41f8-a181-5a013b8fb086/volumes"
Jul 16 09:04:54.880684 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:54.880651    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"]
Jul 16 09:04:54.881080 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:54.880863    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll" podUID="de52e7fc-165c-4a0f-a255-447ede2a7c66" containerName="limitador" containerID="cri-o://d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec" gracePeriod=30
Jul 16 09:04:54.881607 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:54.881569    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:55.424519 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.424497    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:55.517511 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.517426    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de52e7fc-165c-4a0f-a255-447ede2a7c66-config-file\") pod \"de52e7fc-165c-4a0f-a255-447ede2a7c66\" (UID: \"de52e7fc-165c-4a0f-a255-447ede2a7c66\") "
Jul 16 09:04:55.517686 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.517556    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7wlm\" (UniqueName: \"kubernetes.io/projected/de52e7fc-165c-4a0f-a255-447ede2a7c66-kube-api-access-b7wlm\") pod \"de52e7fc-165c-4a0f-a255-447ede2a7c66\" (UID: \"de52e7fc-165c-4a0f-a255-447ede2a7c66\") "
Jul 16 09:04:55.517841 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.517811    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de52e7fc-165c-4a0f-a255-447ede2a7c66-config-file" (OuterVolumeSpecName: "config-file") pod "de52e7fc-165c-4a0f-a255-447ede2a7c66" (UID: "de52e7fc-165c-4a0f-a255-447ede2a7c66"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:04:55.519553 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.519508    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de52e7fc-165c-4a0f-a255-447ede2a7c66-kube-api-access-b7wlm" (OuterVolumeSpecName: "kube-api-access-b7wlm") pod "de52e7fc-165c-4a0f-a255-447ede2a7c66" (UID: "de52e7fc-165c-4a0f-a255-447ede2a7c66"). InnerVolumeSpecName "kube-api-access-b7wlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:04:55.601954 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.601920    2570 generic.go:356] "Generic (PLEG): container finished" podID="de52e7fc-165c-4a0f-a255-447ede2a7c66" containerID="d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec" exitCode=0
Jul 16 09:04:55.601954 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.601958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll" event={"ID":"de52e7fc-165c-4a0f-a255-447ede2a7c66","Type":"ContainerDied","Data":"d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec"}
Jul 16 09:04:55.602149 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.602001    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll" event={"ID":"de52e7fc-165c-4a0f-a255-447ede2a7c66","Type":"ContainerDied","Data":"5d39865c02d0a6c5abfc66552cf83af44426806a2f01f5892b179f7f5f9c1d9f"}
Jul 16 09:04:55.602149 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.602032    2570 scope.go:117] "RemoveContainer" containerID="d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec"
Jul 16 09:04:55.602149 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.602035    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"
Jul 16 09:04:55.610792 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.610769    2570 scope.go:117] "RemoveContainer" containerID="d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec"
Jul 16 09:04:55.611034 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:04:55.611016    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec\": container with ID starting with d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec not found: ID does not exist" containerID="d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec"
Jul 16 09:04:55.611081 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.611043    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec"} err="failed to get container status \"d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec\": rpc error: code = NotFound desc = could not find container \"d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec\": container with ID starting with d59ab095b0b7334ce7c0b9dce6844c515fcf55b5ae8a3bede3913678a91f3bec not found: ID does not exist"
Jul 16 09:04:55.618760 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.618739    2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de52e7fc-165c-4a0f-a255-447ede2a7c66-config-file\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:04:55.618846 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.618761    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7wlm\" (UniqueName: \"kubernetes.io/projected/de52e7fc-165c-4a0f-a255-447ede2a7c66-kube-api-access-b7wlm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:04:55.623814 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.623793    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"]
Jul 16 09:04:55.627436 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:55.627415    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt8ll"]
Jul 16 09:04:56.971817 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:56.971786    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de52e7fc-165c-4a0f-a255-447ede2a7c66" path="/var/lib/kubelet/pods/de52e7fc-165c-4a0f-a255-447ede2a7c66/volumes"
Jul 16 09:04:59.062554 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.062500    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:59.583295 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.583261    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"]
Jul 16 09:04:59.583659 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.583645    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb8117b-91f1-41f8-a181-5a013b8fb086" containerName="authorino"
Jul 16 09:04:59.583718 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.583660    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb8117b-91f1-41f8-a181-5a013b8fb086" containerName="authorino"
Jul 16 09:04:59.583718 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.583678    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de52e7fc-165c-4a0f-a255-447ede2a7c66" containerName="limitador"
Jul 16 09:04:59.583718 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.583683    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="de52e7fc-165c-4a0f-a255-447ede2a7c66" containerName="limitador"
Jul 16 09:04:59.583808 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.583748    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="de52e7fc-165c-4a0f-a255-447ede2a7c66" containerName="limitador"
Jul 16 09:04:59.583808 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.583759    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fb8117b-91f1-41f8-a181-5a013b8fb086" containerName="authorino"
Jul 16 09:04:59.585418 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.585401    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"
Jul 16 09:04:59.587981 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.587958    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 09:04:59.588869 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.588851    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 09:04:59.588931 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.588868    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 09:04:59.588931 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.588873    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qxvqb\""
Jul 16 09:04:59.599701 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.599680    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"]
Jul 16 09:04:59.752773 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.752731    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dffad33f-6e4c-4022-9124-08d6f411ce8f-data\") pod \"postgres-69fb4594cf-vr45f\" (UID: \"dffad33f-6e4c-4022-9124-08d6f411ce8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"
Jul 16 09:04:59.752773 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.752771    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjlrs\" (UniqueName: \"kubernetes.io/projected/dffad33f-6e4c-4022-9124-08d6f411ce8f-kube-api-access-pjlrs\") pod \"postgres-69fb4594cf-vr45f\" (UID: \"dffad33f-6e4c-4022-9124-08d6f411ce8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"
Jul 16 09:04:59.851525 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.851418    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:04:59.853460 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.853436    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dffad33f-6e4c-4022-9124-08d6f411ce8f-data\") pod \"postgres-69fb4594cf-vr45f\" (UID: \"dffad33f-6e4c-4022-9124-08d6f411ce8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"
Jul 16 09:04:59.853526 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.853470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjlrs\" (UniqueName: \"kubernetes.io/projected/dffad33f-6e4c-4022-9124-08d6f411ce8f-kube-api-access-pjlrs\") pod \"postgres-69fb4594cf-vr45f\" (UID: \"dffad33f-6e4c-4022-9124-08d6f411ce8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"
Jul 16 09:04:59.853829 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.853812    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dffad33f-6e4c-4022-9124-08d6f411ce8f-data\") pod \"postgres-69fb4594cf-vr45f\" (UID: \"dffad33f-6e4c-4022-9124-08d6f411ce8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"
Jul 16 09:04:59.862060 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.862034    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjlrs\" (UniqueName: \"kubernetes.io/projected/dffad33f-6e4c-4022-9124-08d6f411ce8f-kube-api-access-pjlrs\") pod \"postgres-69fb4594cf-vr45f\" (UID: \"dffad33f-6e4c-4022-9124-08d6f411ce8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"
Jul 16 09:04:59.895083 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.895053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"
Jul 16 09:04:59.951991 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:04:59.951959    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:00.028363 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:00.028333    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"]
Jul 16 09:05:00.029715 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:05:00.029687    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffad33f_6e4c_4022_9124_08d6f411ce8f.slice/crio-3f4c1543ea96b16a133f6b753730b5442b97334009349ead5f4a2482dde51fd7 WatchSource:0}: Error finding container 3f4c1543ea96b16a133f6b753730b5442b97334009349ead5f4a2482dde51fd7: Status 404 returned error can't find the container with id 3f4c1543ea96b16a133f6b753730b5442b97334009349ead5f4a2482dde51fd7
Jul 16 09:05:00.631061 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:00.631011    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f" event={"ID":"dffad33f-6e4c-4022-9124-08d6f411ce8f","Type":"ContainerStarted","Data":"3f4c1543ea96b16a133f6b753730b5442b97334009349ead5f4a2482dde51fd7"}
Jul 16 09:05:04.861785 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:04.861755    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:05:04.866077 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:04.866051    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:05:05.658039 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:05.657999    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f" event={"ID":"dffad33f-6e4c-4022-9124-08d6f411ce8f","Type":"ContainerStarted","Data":"e1ecb4a7f58521acda02f36bff633c4a3f6317352dcf74c1d23abc0556bb8b02"}
Jul 16 09:05:05.658213 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:05.658068    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"
Jul 16 09:05:05.676608 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:05.676527    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f" podStartSLOduration=2.041725394 podStartE2EDuration="6.67651329s" totalImagesPullingTime="4.634787896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:05.676435945 +0000 UTC m=+601.228468672" watchObservedRunningTime="2026-07-16 09:05:05.67651329 +0000 UTC m=+601.228546015"
Jul 16 09:05:11.698184 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:11.698156    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vr45f"
Jul 16 09:05:12.031401 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.031303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:12.198681 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.198637    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:12.279405 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.279373    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xs49p"]
Jul 16 09:05:12.281930 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.281887    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xs49p"
Jul 16 09:05:12.297175 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.297146    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xs49p"]
Jul 16 09:05:12.375242 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.375208    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7l97\" (UniqueName: \"kubernetes.io/projected/cb7dfc78-4553-4062-821d-656129c270c9-kube-api-access-m7l97\") pod \"authorino-5d4b67c446-xs49p\" (UID: \"cb7dfc78-4553-4062-821d-656129c270c9\") " pod="kuadrant-system/authorino-5d4b67c446-xs49p"
Jul 16 09:05:12.476502 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.476459    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7l97\" (UniqueName: \"kubernetes.io/projected/cb7dfc78-4553-4062-821d-656129c270c9-kube-api-access-m7l97\") pod \"authorino-5d4b67c446-xs49p\" (UID: \"cb7dfc78-4553-4062-821d-656129c270c9\") " pod="kuadrant-system/authorino-5d4b67c446-xs49p"
Jul 16 09:05:12.485774 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.485748    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7l97\" (UniqueName: \"kubernetes.io/projected/cb7dfc78-4553-4062-821d-656129c270c9-kube-api-access-m7l97\") pod \"authorino-5d4b67c446-xs49p\" (UID: \"cb7dfc78-4553-4062-821d-656129c270c9\") " pod="kuadrant-system/authorino-5d4b67c446-xs49p"
Jul 16 09:05:12.533021 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.532939    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xs49p"]
Jul 16 09:05:12.533205 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.533192    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xs49p"
Jul 16 09:05:12.559199 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.559169    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b7d5bd948-r2cjs"]
Jul 16 09:05:12.562717 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.562694    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7d5bd948-r2cjs"
Jul 16 09:05:12.569887 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.569860    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b7d5bd948-r2cjs"]
Jul 16 09:05:12.577962 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.577933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc7wd\" (UniqueName: \"kubernetes.io/projected/6bbcbf84-0391-472b-8afe-f4f9a47ee201-kube-api-access-kc7wd\") pod \"authorino-7b7d5bd948-r2cjs\" (UID: \"6bbcbf84-0391-472b-8afe-f4f9a47ee201\") " pod="kuadrant-system/authorino-7b7d5bd948-r2cjs"
Jul 16 09:05:12.595733 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.595705    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b7d5bd948-r2cjs"]
Jul 16 09:05:12.596373 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:05:12.596340    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kc7wd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7b7d5bd948-r2cjs" podUID="6bbcbf84-0391-472b-8afe-f4f9a47ee201"
Jul 16 09:05:12.624134 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.624097    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79fdfd9868-zf6kr"]
Jul 16 09:05:12.627520 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.627182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79fdfd9868-zf6kr"
Jul 16 09:05:12.629943 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.629917    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 09:05:12.634502 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.634450    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79fdfd9868-zf6kr"]
Jul 16 09:05:12.675167 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.675142    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xs49p"]
Jul 16 09:05:12.677260 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:05:12.677229    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb7dfc78_4553_4062_821d_656129c270c9.slice/crio-d7b6f2de911e7de5dc645b37ec570c2315cc8855c1babac7c70576f48cf53b4a WatchSource:0}: Error finding container d7b6f2de911e7de5dc645b37ec570c2315cc8855c1babac7c70576f48cf53b4a: Status 404 returned error can't find the container with id d7b6f2de911e7de5dc645b37ec570c2315cc8855c1babac7c70576f48cf53b4a
Jul 16 09:05:12.678361 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.678334    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6dfd568-1181-4858-abac-bdf84b7254cc-tls-cert\") pod \"authorino-79fdfd9868-zf6kr\" (UID: \"e6dfd568-1181-4858-abac-bdf84b7254cc\") " pod="kuadrant-system/authorino-79fdfd9868-zf6kr"
Jul 16 09:05:12.678507 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.678476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc7wd\" (UniqueName: \"kubernetes.io/projected/6bbcbf84-0391-472b-8afe-f4f9a47ee201-kube-api-access-kc7wd\") pod \"authorino-7b7d5bd948-r2cjs\" (UID: \"6bbcbf84-0391-472b-8afe-f4f9a47ee201\") " pod="kuadrant-system/authorino-7b7d5bd948-r2cjs"
Jul 16 09:05:12.678633 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.678568    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbt86\" (UniqueName: \"kubernetes.io/projected/e6dfd568-1181-4858-abac-bdf84b7254cc-kube-api-access-zbt86\") pod \"authorino-79fdfd9868-zf6kr\" (UID: \"e6dfd568-1181-4858-abac-bdf84b7254cc\") " pod="kuadrant-system/authorino-79fdfd9868-zf6kr"
Jul 16 09:05:12.686970 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.686950    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc7wd\" (UniqueName: \"kubernetes.io/projected/6bbcbf84-0391-472b-8afe-f4f9a47ee201-kube-api-access-kc7wd\") pod \"authorino-7b7d5bd948-r2cjs\" (UID: \"6bbcbf84-0391-472b-8afe-f4f9a47ee201\") " pod="kuadrant-system/authorino-7b7d5bd948-r2cjs"
Jul 16 09:05:12.698261 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.698241    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7d5bd948-r2cjs"
Jul 16 09:05:12.698577 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.698258    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xs49p" event={"ID":"cb7dfc78-4553-4062-821d-656129c270c9","Type":"ContainerStarted","Data":"d7b6f2de911e7de5dc645b37ec570c2315cc8855c1babac7c70576f48cf53b4a"}
Jul 16 09:05:12.705006 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.704987    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7d5bd948-r2cjs"
Jul 16 09:05:12.779777 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.779747    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc7wd\" (UniqueName: \"kubernetes.io/projected/6bbcbf84-0391-472b-8afe-f4f9a47ee201-kube-api-access-kc7wd\") pod \"6bbcbf84-0391-472b-8afe-f4f9a47ee201\" (UID: \"6bbcbf84-0391-472b-8afe-f4f9a47ee201\") "
Jul 16 09:05:12.780015 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.779997    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6dfd568-1181-4858-abac-bdf84b7254cc-tls-cert\") pod \"authorino-79fdfd9868-zf6kr\" (UID: \"e6dfd568-1181-4858-abac-bdf84b7254cc\") " pod="kuadrant-system/authorino-79fdfd9868-zf6kr"
Jul 16 09:05:12.780102 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.780086    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbt86\" (UniqueName: \"kubernetes.io/projected/e6dfd568-1181-4858-abac-bdf84b7254cc-kube-api-access-zbt86\") pod \"authorino-79fdfd9868-zf6kr\" (UID: \"e6dfd568-1181-4858-abac-bdf84b7254cc\") " pod="kuadrant-system/authorino-79fdfd9868-zf6kr"
Jul 16 09:05:12.781852 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.781821    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bbcbf84-0391-472b-8afe-f4f9a47ee201-kube-api-access-kc7wd" (OuterVolumeSpecName: "kube-api-access-kc7wd") pod "6bbcbf84-0391-472b-8afe-f4f9a47ee201" (UID: "6bbcbf84-0391-472b-8afe-f4f9a47ee201"). InnerVolumeSpecName "kube-api-access-kc7wd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:05:12.782280 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.782262    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6dfd568-1181-4858-abac-bdf84b7254cc-tls-cert\") pod \"authorino-79fdfd9868-zf6kr\" (UID: \"e6dfd568-1181-4858-abac-bdf84b7254cc\") " pod="kuadrant-system/authorino-79fdfd9868-zf6kr"
Jul 16 09:05:12.788609 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.788567    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbt86\" (UniqueName: \"kubernetes.io/projected/e6dfd568-1181-4858-abac-bdf84b7254cc-kube-api-access-zbt86\") pod \"authorino-79fdfd9868-zf6kr\" (UID: \"e6dfd568-1181-4858-abac-bdf84b7254cc\") " pod="kuadrant-system/authorino-79fdfd9868-zf6kr"
Jul 16 09:05:12.881356 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.881323    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc7wd\" (UniqueName: \"kubernetes.io/projected/6bbcbf84-0391-472b-8afe-f4f9a47ee201-kube-api-access-kc7wd\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:05:12.937891 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:12.937858    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79fdfd9868-zf6kr"
Jul 16 09:05:13.089277 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:13.089252    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79fdfd9868-zf6kr"]
Jul 16 09:05:13.091603 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:05:13.091571    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6dfd568_1181_4858_abac_bdf84b7254cc.slice/crio-5e3b02a8df106d33b0102c12b4efca6e03c0809d1c8cca342a46d8e93508995e WatchSource:0}: Error finding container 5e3b02a8df106d33b0102c12b4efca6e03c0809d1c8cca342a46d8e93508995e: Status 404 returned error can't find the container with id 5e3b02a8df106d33b0102c12b4efca6e03c0809d1c8cca342a46d8e93508995e
Jul 16 09:05:13.704922 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:13.704884    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7d5bd948-r2cjs"
Jul 16 09:05:13.705345 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:13.704926    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79fdfd9868-zf6kr" event={"ID":"e6dfd568-1181-4858-abac-bdf84b7254cc","Type":"ContainerStarted","Data":"8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304"}
Jul 16 09:05:13.705345 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:13.704970    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79fdfd9868-zf6kr" event={"ID":"e6dfd568-1181-4858-abac-bdf84b7254cc","Type":"ContainerStarted","Data":"5e3b02a8df106d33b0102c12b4efca6e03c0809d1c8cca342a46d8e93508995e"}
Jul 16 09:05:13.724668 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:13.724616    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79fdfd9868-zf6kr" podStartSLOduration=1.3006545250000001 podStartE2EDuration="1.724599963s" totalImagesPullingTime="423.945438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:13.723448665 +0000 UTC m=+609.275481392" watchObservedRunningTime="2026-07-16 09:05:13.724599963 +0000 UTC m=+609.276632729"
Jul 16 09:05:13.756750 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:13.756678    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b7d5bd948-r2cjs"]
Jul 16 09:05:13.763632 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:13.763605    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b5r5x"]
Jul 16 09:05:13.763873 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:13.763770    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-b5r5x" podUID="4c1fc836-5b83-4fff-aa97-c599fafb1fb9" containerName="authorino" containerID="cri-o://073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c" gracePeriod=30
Jul 16 09:05:13.767017 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:13.766991    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b7d5bd948-r2cjs"]
Jul 16 09:05:14.014998 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.014972    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b5r5x"
Jul 16 09:05:14.096966 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.096939    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw8c6\" (UniqueName: \"kubernetes.io/projected/4c1fc836-5b83-4fff-aa97-c599fafb1fb9-kube-api-access-kw8c6\") pod \"4c1fc836-5b83-4fff-aa97-c599fafb1fb9\" (UID: \"4c1fc836-5b83-4fff-aa97-c599fafb1fb9\") "
Jul 16 09:05:14.098954 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.098930    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c1fc836-5b83-4fff-aa97-c599fafb1fb9-kube-api-access-kw8c6" (OuterVolumeSpecName: "kube-api-access-kw8c6") pod "4c1fc836-5b83-4fff-aa97-c599fafb1fb9" (UID: "4c1fc836-5b83-4fff-aa97-c599fafb1fb9"). InnerVolumeSpecName "kube-api-access-kw8c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:05:14.198268 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.198233    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw8c6\" (UniqueName: \"kubernetes.io/projected/4c1fc836-5b83-4fff-aa97-c599fafb1fb9-kube-api-access-kw8c6\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:05:14.710629 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.710583    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xs49p" event={"ID":"cb7dfc78-4553-4062-821d-656129c270c9","Type":"ContainerStarted","Data":"22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7"}
Jul 16 09:05:14.711149 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.710637    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-xs49p" podUID="cb7dfc78-4553-4062-821d-656129c270c9" containerName="authorino" containerID="cri-o://22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7" gracePeriod=30
Jul 16 09:05:14.711932 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.711910    2570 generic.go:356] "Generic (PLEG): container finished" podID="4c1fc836-5b83-4fff-aa97-c599fafb1fb9" containerID="073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c" exitCode=0
Jul 16 09:05:14.712042 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.711963    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b5r5x"
Jul 16 09:05:14.712042 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.712026    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b5r5x" event={"ID":"4c1fc836-5b83-4fff-aa97-c599fafb1fb9","Type":"ContainerDied","Data":"073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c"}
Jul 16 09:05:14.712154 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.712067    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b5r5x" event={"ID":"4c1fc836-5b83-4fff-aa97-c599fafb1fb9","Type":"ContainerDied","Data":"c06a1f126d87c51af142f7335e29d544e6f547485f1a99d752efadec39dc579f"}
Jul 16 09:05:14.712154 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.712087    2570 scope.go:117] "RemoveContainer" containerID="073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c"
Jul 16 09:05:14.720987 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.720966    2570 scope.go:117] "RemoveContainer" containerID="073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c"
Jul 16 09:05:14.721298 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:05:14.721277    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c\": container with ID starting with 073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c not found: ID does not exist" containerID="073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c"
Jul 16 09:05:14.721346 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.721308    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c"} err="failed to get container status \"073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c\": rpc error: code = NotFound desc = could not find container \"073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c\": container with ID starting with 073de9298fd455fdcd22fee636fe2fa9d9122535e18bcb1817a974775ff0945c not found: ID does not exist"
Jul 16 09:05:14.726900 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.726861    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-xs49p" podStartSLOduration=1.5538192020000001 podStartE2EDuration="2.726848495s" totalImagesPullingTime="1.173029293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:14.724665961 +0000 UTC m=+610.276698688" watchObservedRunningTime="2026-07-16 09:05:14.726848495 +0000 UTC m=+610.278881220"
Jul 16 09:05:14.784065 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.784008    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b5r5x"]
Jul 16 09:05:14.790293 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.788549    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b5r5x"]
Jul 16 09:05:14.960935 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.960909    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xs49p"
Jul 16 09:05:14.971596 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.971567    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c1fc836-5b83-4fff-aa97-c599fafb1fb9" path="/var/lib/kubelet/pods/4c1fc836-5b83-4fff-aa97-c599fafb1fb9/volumes"
Jul 16 09:05:14.971966 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:14.971953    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bbcbf84-0391-472b-8afe-f4f9a47ee201" path="/var/lib/kubelet/pods/6bbcbf84-0391-472b-8afe-f4f9a47ee201/volumes"
Jul 16 09:05:15.006574 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.006516    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7l97\" (UniqueName: \"kubernetes.io/projected/cb7dfc78-4553-4062-821d-656129c270c9-kube-api-access-m7l97\") pod \"cb7dfc78-4553-4062-821d-656129c270c9\" (UID: \"cb7dfc78-4553-4062-821d-656129c270c9\") "
Jul 16 09:05:15.008685 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.008655    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb7dfc78-4553-4062-821d-656129c270c9-kube-api-access-m7l97" (OuterVolumeSpecName: "kube-api-access-m7l97") pod "cb7dfc78-4553-4062-821d-656129c270c9" (UID: "cb7dfc78-4553-4062-821d-656129c270c9"). InnerVolumeSpecName "kube-api-access-m7l97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:05:15.107847 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.107814    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7l97\" (UniqueName: \"kubernetes.io/projected/cb7dfc78-4553-4062-821d-656129c270c9-kube-api-access-m7l97\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:05:15.717935 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.717897    2570 generic.go:356] "Generic (PLEG): container finished" podID="cb7dfc78-4553-4062-821d-656129c270c9" containerID="22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7" exitCode=0
Jul 16 09:05:15.717935 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.717937    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xs49p"
Jul 16 09:05:15.718411 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.717978    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xs49p" event={"ID":"cb7dfc78-4553-4062-821d-656129c270c9","Type":"ContainerDied","Data":"22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7"}
Jul 16 09:05:15.718411 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.718015    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xs49p" event={"ID":"cb7dfc78-4553-4062-821d-656129c270c9","Type":"ContainerDied","Data":"d7b6f2de911e7de5dc645b37ec570c2315cc8855c1babac7c70576f48cf53b4a"}
Jul 16 09:05:15.718411 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.718036    2570 scope.go:117] "RemoveContainer" containerID="22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7"
Jul 16 09:05:15.726673 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.726656    2570 scope.go:117] "RemoveContainer" containerID="22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7"
Jul 16 09:05:15.726912 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:05:15.726896    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7\": container with ID starting with 22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7 not found: ID does not exist" containerID="22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7"
Jul 16 09:05:15.726951 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.726921    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7"} err="failed to get container status \"22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7\": rpc error: code = NotFound desc = could not find container \"22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7\": container with ID starting with 22890bfe05fde58d3353ed20c1dab802799080e6c2cffaefe9fe30cdbd18e4e7 not found: ID does not exist"
Jul 16 09:05:15.741219 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.741194    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xs49p"]
Jul 16 09:05:15.744570 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:15.744546    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xs49p"]
Jul 16 09:05:16.971853 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:16.971819    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb7dfc78-4553-4062-821d-656129c270c9" path="/var/lib/kubelet/pods/cb7dfc78-4553-4062-821d-656129c270c9/volumes"
Jul 16 09:05:18.719203 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.719169    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:18.732719 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.732277    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-844954bfc8-8mvrg"]
Jul 16 09:05:18.733110 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.733084    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1fc836-5b83-4fff-aa97-c599fafb1fb9" containerName="authorino"
Jul 16 09:05:18.733293 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.733278    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1fc836-5b83-4fff-aa97-c599fafb1fb9" containerName="authorino"
Jul 16 09:05:18.733403 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.733391    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb7dfc78-4553-4062-821d-656129c270c9" containerName="authorino"
Jul 16 09:05:18.733477 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.733468    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb7dfc78-4553-4062-821d-656129c270c9" containerName="authorino"
Jul 16 09:05:18.733799 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.733783    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1fc836-5b83-4fff-aa97-c599fafb1fb9" containerName="authorino"
Jul 16 09:05:18.733915 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.733904    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb7dfc78-4553-4062-821d-656129c270c9" containerName="authorino"
Jul 16 09:05:18.749517 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.749489    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-844954bfc8-8mvrg"]
Jul 16 09:05:18.749660 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.749614    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:18.752221 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.752198    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 09:05:18.752358 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.752259    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 09:05:18.752358 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.752305    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r5qbg\""
Jul 16 09:05:18.816218 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.816180    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:18.838216 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.838185    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23165c1c-e98e-4ab9-bf7c-86586f9ff710-webhook-cert\") pod \"maas-controller-844954bfc8-8mvrg\" (UID: \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\") " pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:18.838347 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.838236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdhk\" (UniqueName: \"kubernetes.io/projected/23165c1c-e98e-4ab9-bf7c-86586f9ff710-kube-api-access-vcdhk\") pod \"maas-controller-844954bfc8-8mvrg\" (UID: \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\") " pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:18.920497 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.920460    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:18.936848 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.936811    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75c958864b-zgz7b"]
Jul 16 09:05:18.939132 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.939111    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23165c1c-e98e-4ab9-bf7c-86586f9ff710-webhook-cert\") pod \"maas-controller-844954bfc8-8mvrg\" (UID: \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\") " pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:18.939216 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.939169    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdhk\" (UniqueName: \"kubernetes.io/projected/23165c1c-e98e-4ab9-bf7c-86586f9ff710-kube-api-access-vcdhk\") pod \"maas-controller-844954bfc8-8mvrg\" (UID: \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\") " pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:18.939299 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:05:18.939278    2570 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 16 09:05:18.939378 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:05:18.939366    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23165c1c-e98e-4ab9-bf7c-86586f9ff710-webhook-cert podName:23165c1c-e98e-4ab9-bf7c-86586f9ff710 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:19.439345327 +0000 UTC m=+614.991378045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/23165c1c-e98e-4ab9-bf7c-86586f9ff710-webhook-cert") pod "maas-controller-844954bfc8-8mvrg" (UID: "23165c1c-e98e-4ab9-bf7c-86586f9ff710") : secret "maas-controller-webhook-cert" not found
Jul 16 09:05:18.952009 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.951983    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdhk\" (UniqueName: \"kubernetes.io/projected/23165c1c-e98e-4ab9-bf7c-86586f9ff710-kube-api-access-vcdhk\") pod \"maas-controller-844954bfc8-8mvrg\" (UID: \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\") " pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:18.969693 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.969628    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:05:18.977298 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:18.977277    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c958864b-zgz7b"]
Jul 16 09:05:19.039821 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.039786    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xlkj\" (UniqueName: \"kubernetes.io/projected/5cabcf39-96fb-4047-935b-2d765fb970e7-kube-api-access-5xlkj\") pod \"maas-controller-75c958864b-zgz7b\" (UID: \"5cabcf39-96fb-4047-935b-2d765fb970e7\") " pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:05:19.040030 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.039911    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cabcf39-96fb-4047-935b-2d765fb970e7-webhook-cert\") pod \"maas-controller-75c958864b-zgz7b\" (UID: \"5cabcf39-96fb-4047-935b-2d765fb970e7\") " pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:05:19.125385 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.125350    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:19.140485 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.140458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cabcf39-96fb-4047-935b-2d765fb970e7-webhook-cert\") pod \"maas-controller-75c958864b-zgz7b\" (UID: \"5cabcf39-96fb-4047-935b-2d765fb970e7\") " pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:05:19.140588 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.140516    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xlkj\" (UniqueName: \"kubernetes.io/projected/5cabcf39-96fb-4047-935b-2d765fb970e7-kube-api-access-5xlkj\") pod \"maas-controller-75c958864b-zgz7b\" (UID: \"5cabcf39-96fb-4047-935b-2d765fb970e7\") " pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:05:19.142888 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.142871    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cabcf39-96fb-4047-935b-2d765fb970e7-webhook-cert\") pod \"maas-controller-75c958864b-zgz7b\" (UID: \"5cabcf39-96fb-4047-935b-2d765fb970e7\") " pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:05:19.148664 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.148643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xlkj\" (UniqueName: \"kubernetes.io/projected/5cabcf39-96fb-4047-935b-2d765fb970e7-kube-api-access-5xlkj\") pod \"maas-controller-75c958864b-zgz7b\" (UID: \"5cabcf39-96fb-4047-935b-2d765fb970e7\") " pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:05:19.280927 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.280830    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:05:19.434302 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.434274    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c958864b-zgz7b"]
Jul 16 09:05:19.439421 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:05:19.439393    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cabcf39_96fb_4047_935b_2d765fb970e7.slice/crio-aa5ffc22ba5a4db6f3d098ab2ec233690683fcebe866a08655a21e824fe6bfad WatchSource:0}: Error finding container aa5ffc22ba5a4db6f3d098ab2ec233690683fcebe866a08655a21e824fe6bfad: Status 404 returned error can't find the container with id aa5ffc22ba5a4db6f3d098ab2ec233690683fcebe866a08655a21e824fe6bfad
Jul 16 09:05:19.443329 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.443302    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23165c1c-e98e-4ab9-bf7c-86586f9ff710-webhook-cert\") pod \"maas-controller-844954bfc8-8mvrg\" (UID: \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\") " pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:19.445671 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.445646    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23165c1c-e98e-4ab9-bf7c-86586f9ff710-webhook-cert\") pod \"maas-controller-844954bfc8-8mvrg\" (UID: \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\") " pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:19.662110 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.662062    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:19.748077 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.748037    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c958864b-zgz7b" event={"ID":"5cabcf39-96fb-4047-935b-2d765fb970e7","Type":"ContainerStarted","Data":"aa5ffc22ba5a4db6f3d098ab2ec233690683fcebe866a08655a21e824fe6bfad"}
Jul 16 09:05:19.796485 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:19.796456    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-844954bfc8-8mvrg"]
Jul 16 09:05:19.798193 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:05:19.798166    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23165c1c_e98e_4ab9_bf7c_86586f9ff710.slice/crio-51cfa27b1b21b4640933467dd9e24dafd8b0506798117dd0f7e274d5aab93c0d WatchSource:0}: Error finding container 51cfa27b1b21b4640933467dd9e24dafd8b0506798117dd0f7e274d5aab93c0d: Status 404 returned error can't find the container with id 51cfa27b1b21b4640933467dd9e24dafd8b0506798117dd0f7e274d5aab93c0d
Jul 16 09:05:20.760157 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:20.760123    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844954bfc8-8mvrg" event={"ID":"23165c1c-e98e-4ab9-bf7c-86586f9ff710","Type":"ContainerStarted","Data":"51cfa27b1b21b4640933467dd9e24dafd8b0506798117dd0f7e274d5aab93c0d"}
Jul 16 09:05:22.405085 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:22.405051    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:22.773326 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:22.773286    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c958864b-zgz7b" event={"ID":"5cabcf39-96fb-4047-935b-2d765fb970e7","Type":"ContainerStarted","Data":"9f978bb666a37f9772f031422b39e45379b1847794d9299d425b1ee340025a73"}
Jul 16 09:05:22.773526 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:22.773351    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:05:22.774985 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:22.774959    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844954bfc8-8mvrg" event={"ID":"23165c1c-e98e-4ab9-bf7c-86586f9ff710","Type":"ContainerStarted","Data":"309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39"}
Jul 16 09:05:22.775114 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:22.775004    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:22.794785 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:22.794736    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75c958864b-zgz7b" podStartSLOduration=2.036621747 podStartE2EDuration="4.794719553s" totalImagesPullingTime="2.758097806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:22.793820589 +0000 UTC m=+618.345853329" watchObservedRunningTime="2026-07-16 09:05:22.794719553 +0000 UTC m=+618.346752279"
Jul 16 09:05:22.815639 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:22.815575    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-844954bfc8-8mvrg" podStartSLOduration=2.4058004 podStartE2EDuration="4.815554426s" totalImagesPullingTime="2.409754026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:22.81344623 +0000 UTC m=+618.365478956" watchObservedRunningTime="2026-07-16 09:05:22.815554426 +0000 UTC m=+618.367587149"
Jul 16 09:05:23.690817 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:23.690779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:33.781899 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:33.781864    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:33.782480 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:33.781950    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:05:33.843104 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:33.843067    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-844954bfc8-8mvrg"]
Jul 16 09:05:33.843411 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:33.843280    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-844954bfc8-8mvrg" podUID="23165c1c-e98e-4ab9-bf7c-86586f9ff710" containerName="manager" containerID="cri-o://309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39" gracePeriod=30
Jul 16 09:05:34.099973 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.099948    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:34.173440 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.173409    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcdhk\" (UniqueName: \"kubernetes.io/projected/23165c1c-e98e-4ab9-bf7c-86586f9ff710-kube-api-access-vcdhk\") pod \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\" (UID: \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\") "
Jul 16 09:05:34.173634 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.173582    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23165c1c-e98e-4ab9-bf7c-86586f9ff710-webhook-cert\") pod \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\" (UID: \"23165c1c-e98e-4ab9-bf7c-86586f9ff710\") "
Jul 16 09:05:34.175573 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.175544    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23165c1c-e98e-4ab9-bf7c-86586f9ff710-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "23165c1c-e98e-4ab9-bf7c-86586f9ff710" (UID: "23165c1c-e98e-4ab9-bf7c-86586f9ff710"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:05:34.175679 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.175641    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23165c1c-e98e-4ab9-bf7c-86586f9ff710-kube-api-access-vcdhk" (OuterVolumeSpecName: "kube-api-access-vcdhk") pod "23165c1c-e98e-4ab9-bf7c-86586f9ff710" (UID: "23165c1c-e98e-4ab9-bf7c-86586f9ff710"). InnerVolumeSpecName "kube-api-access-vcdhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:05:34.274224 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.274196    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23165c1c-e98e-4ab9-bf7c-86586f9ff710-webhook-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:05:34.274224 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.274222    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcdhk\" (UniqueName: \"kubernetes.io/projected/23165c1c-e98e-4ab9-bf7c-86586f9ff710-kube-api-access-vcdhk\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:05:34.835276 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.835241    2570 generic.go:356] "Generic (PLEG): container finished" podID="23165c1c-e98e-4ab9-bf7c-86586f9ff710" containerID="309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39" exitCode=0
Jul 16 09:05:34.835738 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.835294    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844954bfc8-8mvrg"
Jul 16 09:05:34.835738 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.835330    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844954bfc8-8mvrg" event={"ID":"23165c1c-e98e-4ab9-bf7c-86586f9ff710","Type":"ContainerDied","Data":"309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39"}
Jul 16 09:05:34.835738 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.835389    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844954bfc8-8mvrg" event={"ID":"23165c1c-e98e-4ab9-bf7c-86586f9ff710","Type":"ContainerDied","Data":"51cfa27b1b21b4640933467dd9e24dafd8b0506798117dd0f7e274d5aab93c0d"}
Jul 16 09:05:34.835738 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.835418    2570 scope.go:117] "RemoveContainer" containerID="309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39"
Jul 16 09:05:34.844665 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.844452    2570 scope.go:117] "RemoveContainer" containerID="309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39"
Jul 16 09:05:34.844752 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:05:34.844730    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39\": container with ID starting with 309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39 not found: ID does not exist" containerID="309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39"
Jul 16 09:05:34.844791 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.844760    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39"} err="failed to get container status \"309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39\": rpc error: code = NotFound desc = could not find container \"309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39\": container with ID starting with 309d47d7a8797dad1447e3d48aeb78e21902a1d0ea160e8b844073d4e96c9a39 not found: ID does not exist"
Jul 16 09:05:34.857292 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.857268    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-844954bfc8-8mvrg"]
Jul 16 09:05:34.863708 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.863685    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-844954bfc8-8mvrg"]
Jul 16 09:05:34.973544 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:34.973489    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23165c1c-e98e-4ab9-bf7c-86586f9ff710" path="/var/lib/kubelet/pods/23165c1c-e98e-4ab9-bf7c-86586f9ff710/volumes"
Jul 16 09:05:44.169044 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:44.169004    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:53.003140 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.003091    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:53.129259 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.129220    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:53.459509 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.459470    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:53.714188 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.714108    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"]
Jul 16 09:05:53.714493 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.714481    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23165c1c-e98e-4ab9-bf7c-86586f9ff710" containerName="manager"
Jul 16 09:05:53.714603 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.714494    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="23165c1c-e98e-4ab9-bf7c-86586f9ff710" containerName="manager"
Jul 16 09:05:53.714603 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.714595    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="23165c1c-e98e-4ab9-bf7c-86586f9ff710" containerName="manager"
Jul 16 09:05:53.735107 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.735072    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:53.736885 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.736862    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"]
Jul 16 09:05:53.736960 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.736953    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:53.740365 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.740345    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-p4cq4\""
Jul 16 09:05:53.740365 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.740356    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 16 09:05:53.847409 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.847378    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0f0e1db-bfd2-4c07-bd18-545622e3608c-maas-api-tls\") pod \"maas-api-d9fc9cd7f-rd5fx\" (UID: \"d0f0e1db-bfd2-4c07-bd18-545622e3608c\") " pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:53.847607 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.847430    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dcjn\" (UniqueName: \"kubernetes.io/projected/d0f0e1db-bfd2-4c07-bd18-545622e3608c-kube-api-access-4dcjn\") pod \"maas-api-d9fc9cd7f-rd5fx\" (UID: \"d0f0e1db-bfd2-4c07-bd18-545622e3608c\") " pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:53.847607 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.847490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f0e1db-bfd2-4c07-bd18-545622e3608c-openshift-service-ca\") pod \"maas-api-d9fc9cd7f-rd5fx\" (UID: \"d0f0e1db-bfd2-4c07-bd18-545622e3608c\") " pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:53.948134 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.948090    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dcjn\" (UniqueName: \"kubernetes.io/projected/d0f0e1db-bfd2-4c07-bd18-545622e3608c-kube-api-access-4dcjn\") pod \"maas-api-d9fc9cd7f-rd5fx\" (UID: \"d0f0e1db-bfd2-4c07-bd18-545622e3608c\") " pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:53.948318 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.948144    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f0e1db-bfd2-4c07-bd18-545622e3608c-openshift-service-ca\") pod \"maas-api-d9fc9cd7f-rd5fx\" (UID: \"d0f0e1db-bfd2-4c07-bd18-545622e3608c\") " pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:53.948318 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.948210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0f0e1db-bfd2-4c07-bd18-545622e3608c-maas-api-tls\") pod \"maas-api-d9fc9cd7f-rd5fx\" (UID: \"d0f0e1db-bfd2-4c07-bd18-545622e3608c\") " pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:53.948889 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.948859    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f0e1db-bfd2-4c07-bd18-545622e3608c-openshift-service-ca\") pod \"maas-api-d9fc9cd7f-rd5fx\" (UID: \"d0f0e1db-bfd2-4c07-bd18-545622e3608c\") " pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:53.950709 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.950688    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0f0e1db-bfd2-4c07-bd18-545622e3608c-maas-api-tls\") pod \"maas-api-d9fc9cd7f-rd5fx\" (UID: \"d0f0e1db-bfd2-4c07-bd18-545622e3608c\") " pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:53.958977 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:53.958951    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dcjn\" (UniqueName: \"kubernetes.io/projected/d0f0e1db-bfd2-4c07-bd18-545622e3608c-kube-api-access-4dcjn\") pod \"maas-api-d9fc9cd7f-rd5fx\" (UID: \"d0f0e1db-bfd2-4c07-bd18-545622e3608c\") " pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:54.048295 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.048207    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:54.113136 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.113102    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:54.200163 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.200138    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"]
Jul 16 09:05:54.202328 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.202294    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:54.203119 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:05:54.203092    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f0e1db_bfd2_4c07_bd18_545622e3608c.slice/crio-8ae3c4bfa81c35fe7bfbdff3f8caf6654deee9b578f342532c6a6a1cc5d92e23 WatchSource:0}: Error finding container 8ae3c4bfa81c35fe7bfbdff3f8caf6654deee9b578f342532c6a6a1cc5d92e23: Status 404 returned error can't find the container with id 8ae3c4bfa81c35fe7bfbdff3f8caf6654deee9b578f342532c6a6a1cc5d92e23
Jul 16 09:05:54.204815 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.204793    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:05:54.249600 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.249566    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"]
Jul 16 09:05:54.255953 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.255910    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"
Jul 16 09:05:54.259157 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.259124    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-c9hwf\""
Jul 16 09:05:54.259699 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.259197    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 09:05:54.261939 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.261917    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"]
Jul 16 09:05:54.351348 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.351318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxdmn\" (UniqueName: \"kubernetes.io/projected/d46bf430-052a-4a6e-b3d4-05049d8a2fc1-kube-api-access-vxdmn\") pod \"payload-processing-f9b8d9b9b-7v7p7\" (UID: \"d46bf430-052a-4a6e-b3d4-05049d8a2fc1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"
Jul 16 09:05:54.351522 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.351365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d46bf430-052a-4a6e-b3d4-05049d8a2fc1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-7v7p7\" (UID: \"d46bf430-052a-4a6e-b3d4-05049d8a2fc1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"
Jul 16 09:05:54.451925 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.451885    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxdmn\" (UniqueName: \"kubernetes.io/projected/d46bf430-052a-4a6e-b3d4-05049d8a2fc1-kube-api-access-vxdmn\") pod \"payload-processing-f9b8d9b9b-7v7p7\" (UID: \"d46bf430-052a-4a6e-b3d4-05049d8a2fc1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"
Jul 16 09:05:54.452117 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.451979    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d46bf430-052a-4a6e-b3d4-05049d8a2fc1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-7v7p7\" (UID: \"d46bf430-052a-4a6e-b3d4-05049d8a2fc1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"
Jul 16 09:05:54.452739 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.452713    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d46bf430-052a-4a6e-b3d4-05049d8a2fc1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-7v7p7\" (UID: \"d46bf430-052a-4a6e-b3d4-05049d8a2fc1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"
Jul 16 09:05:54.460602 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.460576    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxdmn\" (UniqueName: \"kubernetes.io/projected/d46bf430-052a-4a6e-b3d4-05049d8a2fc1-kube-api-access-vxdmn\") pod \"payload-processing-f9b8d9b9b-7v7p7\" (UID: \"d46bf430-052a-4a6e-b3d4-05049d8a2fc1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"
Jul 16 09:05:54.568567 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.568489    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"
Jul 16 09:05:54.711825 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.711801    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"]
Jul 16 09:05:54.713503 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:05:54.713480    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46bf430_052a_4a6e_b3d4_05049d8a2fc1.slice/crio-fe3aaaa21c79c8eb96e3a9a4a59263fe5ed7536431c5ef4cd861aa39f920d220 WatchSource:0}: Error finding container fe3aaaa21c79c8eb96e3a9a4a59263fe5ed7536431c5ef4cd861aa39f920d220: Status 404 returned error can't find the container with id fe3aaaa21c79c8eb96e3a9a4a59263fe5ed7536431c5ef4cd861aa39f920d220
Jul 16 09:05:54.939402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.939066    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7" event={"ID":"d46bf430-052a-4a6e-b3d4-05049d8a2fc1","Type":"ContainerStarted","Data":"fe3aaaa21c79c8eb96e3a9a4a59263fe5ed7536431c5ef4cd861aa39f920d220"}
Jul 16 09:05:54.940870 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:54.940799    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx" event={"ID":"d0f0e1db-bfd2-4c07-bd18-545622e3608c","Type":"ContainerStarted","Data":"8ae3c4bfa81c35fe7bfbdff3f8caf6654deee9b578f342532c6a6a1cc5d92e23"}
Jul 16 09:05:56.955965 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:56.955930    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7" event={"ID":"d46bf430-052a-4a6e-b3d4-05049d8a2fc1","Type":"ContainerStarted","Data":"d07643eee14fc3ffff5af4d4345e0432d7a3bd1a6b2eb75d93598a4d13a29d71"}
Jul 16 09:05:56.956419 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:56.955996    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"
Jul 16 09:05:56.957484 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:56.957459    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx" event={"ID":"d0f0e1db-bfd2-4c07-bd18-545622e3608c","Type":"ContainerStarted","Data":"f2cacc68455325ccdb8dbcc8469c3de8ca2b3b94591489fdaf6ac30c77c77769"}
Jul 16 09:05:56.957635 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:56.957518    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:05:56.972438 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:56.972383    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7" podStartSLOduration=1.147787696 podStartE2EDuration="2.972364519s" totalImagesPullingTime="1.824576823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:56.971208254 +0000 UTC m=+652.523240982" watchObservedRunningTime="2026-07-16 09:05:56.972364519 +0000 UTC m=+652.524397248"
Jul 16 09:05:56.998555 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:05:56.996769    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx" podStartSLOduration=1.6635492200000002 podStartE2EDuration="3.996737586s" totalImagesPullingTime="2.333188366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:56.988251824 +0000 UTC m=+652.540284550" watchObservedRunningTime="2026-07-16 09:05:56.996737586 +0000 UTC m=+652.548770314"
Jul 16 09:06:01.982228 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:01.982121    2570 generic.go:356] "Generic (PLEG): container finished" podID="23c48a79-4380-40f6-ad2b-ab5beb81be3b" containerID="906b2508dd7c502bf25552f1f609e41360b9e58c4b299ce2e03dde6faee9244c" exitCode=0
Jul 16 09:06:01.982228 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:01.982194    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh" event={"ID":"23c48a79-4380-40f6-ad2b-ab5beb81be3b","Type":"ContainerDied","Data":"906b2508dd7c502bf25552f1f609e41360b9e58c4b299ce2e03dde6faee9244c"}
Jul 16 09:06:01.982773 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:01.982608    2570 scope.go:117] "RemoveContainer" containerID="906b2508dd7c502bf25552f1f609e41360b9e58c4b299ce2e03dde6faee9244c"
Jul 16 09:06:01.983607 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:01.983578    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:06:01.983729 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:01.983660    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:06:01.983729 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:01.983709    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:06:02.972753 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:02.972718    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d9fc9cd7f-rd5fx"
Jul 16 09:06:02.988387 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:02.988355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh" event={"ID":"23c48a79-4380-40f6-ad2b-ab5beb81be3b","Type":"ContainerStarted","Data":"c3a1c7e8cd25154e8154c11c2dafbd33553eba9166217ad2c00a440d5e169b57"}
Jul 16 09:06:03.474903 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:03.474860    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:06:03.745742 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:03.745642    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:06:03.746126 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:03.746088    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kjqvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 16 09:06:03.746228 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:03.746152    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh" podUID="23c48a79-4380-40f6-ad2b-ab5beb81be3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 16 09:06:04.243864 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:04.243820    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:04.742444 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:04.742407    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kjqvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 16 09:06:04.742653 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:04.742463    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh" podUID="23c48a79-4380-40f6-ad2b-ab5beb81be3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 16 09:06:04.922550 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:04.922494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:05.741900 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:05.741864    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kjqvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 16 09:06:05.742300 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:05.741920    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh" podUID="23c48a79-4380-40f6-ad2b-ab5beb81be3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 16 09:06:06.741819 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:06.741782    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kjqvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 16 09:06:06.742001 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:06.741838    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh" podUID="23c48a79-4380-40f6-ad2b-ab5beb81be3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 16 09:06:07.745630 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:07.745594    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:06:07.746626 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:07.746605    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjqvh"
Jul 16 09:06:07.964249 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:07.964217    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-7v7p7"
Jul 16 09:06:18.865659 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.865618    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"]
Jul 16 09:06:18.869690 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.869668    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:18.872357 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.872333    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 09:06:18.872470 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.872381    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 09:06:18.873208 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.873191    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jn4fs\""
Jul 16 09:06:18.873308 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.873236    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 16 09:06:18.878516 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.878494    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"]
Jul 16 09:06:18.892387 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.892360    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:18.970583 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.970554    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:18.970741 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.970621    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:18.970741 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.970666    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf98s\" (UniqueName: \"kubernetes.io/projected/80e9280c-016c-423b-96b8-f00dd2637a46-kube-api-access-lf98s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:18.970741 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.970689    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:18.970741 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.970716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:18.970741 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:18.970734    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80e9280c-016c-423b-96b8-f00dd2637a46-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.071274 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.071243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.071465 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.071292    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf98s\" (UniqueName: \"kubernetes.io/projected/80e9280c-016c-423b-96b8-f00dd2637a46-kube-api-access-lf98s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.071465 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.071315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.071465 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.071337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.071465 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.071383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80e9280c-016c-423b-96b8-f00dd2637a46-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.071465 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.071464    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.071805 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.071779    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.072042 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.071995    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.072042 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.072033    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.074221 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.074197    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80e9280c-016c-423b-96b8-f00dd2637a46-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.074221 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.074210    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80e9280c-016c-423b-96b8-f00dd2637a46-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.079497 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.079475    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf98s\" (UniqueName: \"kubernetes.io/projected/80e9280c-016c-423b-96b8-f00dd2637a46-kube-api-access-lf98s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd\" (UID: \"80e9280c-016c-423b-96b8-f00dd2637a46\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.181310 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.181217    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:19.325022 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:19.324993    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"]
Jul 16 09:06:19.326946 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:06:19.326909    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e9280c_016c_423b_96b8_f00dd2637a46.slice/crio-78061d6ec3ea18631eaabad6cb4d8f0202304f9f42e591d6e46c180a0a3853bc WatchSource:0}: Error finding container 78061d6ec3ea18631eaabad6cb4d8f0202304f9f42e591d6e46c180a0a3853bc: Status 404 returned error can't find the container with id 78061d6ec3ea18631eaabad6cb4d8f0202304f9f42e591d6e46c180a0a3853bc
Jul 16 09:06:20.085075 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:20.085037    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd" event={"ID":"80e9280c-016c-423b-96b8-f00dd2637a46","Type":"ContainerStarted","Data":"78061d6ec3ea18631eaabad6cb4d8f0202304f9f42e591d6e46c180a0a3853bc"}
Jul 16 09:06:21.091779 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:21.091746    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd" event={"ID":"80e9280c-016c-423b-96b8-f00dd2637a46","Type":"ContainerStarted","Data":"15563a67cdd0fa9313e3f35d0db9267344baf2c8839075966262ec4d52119f1e"}
Jul 16 09:06:21.110150 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:21.110079    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd" podStartSLOduration=1.879223164 podStartE2EDuration="3.110062761s" totalImagesPullingTime="1.230839597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:06:21.108587327 +0000 UTC m=+676.660620050" watchObservedRunningTime="2026-07-16 09:06:21.110062761 +0000 UTC m=+676.662095487"
Jul 16 09:06:29.181683 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:29.181647    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:29.182148 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:29.181733    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:29.194230 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:29.194200    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:30.152706 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:30.152678    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd"
Jul 16 09:06:31.344733 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.344687    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"]
Jul 16 09:06:31.348435 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.348410    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.350951 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.350928    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 16 09:06:31.360976 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.360947    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"]
Jul 16 09:06:31.384508 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.384474    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:31.484943 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.484910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.484943 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.484947    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.485146 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.484972    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.485146 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.485086    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.485216 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.485145    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj85b\" (UniqueName: \"kubernetes.io/projected/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-kube-api-access-bj85b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.485216 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.485171    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.585996 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.585957    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.586180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.586019    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj85b\" (UniqueName: \"kubernetes.io/projected/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-kube-api-access-bj85b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.586180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.586039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.586180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.586067    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.586180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.586094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.586395 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.586233    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.586456 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.586416    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.586511 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.586488    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.586613 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.586508    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.588351 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.588330    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.588567 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.588524    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.594893 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.594832    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj85b\" (UniqueName: \"kubernetes.io/projected/fd35d279-26ea-4b12-8c8c-4ab9361d6c9f-kube-api-access-bj85b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2s6b\" (UID: \"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.660764 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.660730    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:31.798752 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:31.798726    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"]
Jul 16 09:06:31.800819 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:06:31.800790    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd35d279_26ea_4b12_8c8c_4ab9361d6c9f.slice/crio-40be415a4ffc83b891e0d915af08edd23e932e2e3abd845fcc335e0ae8d9d2c3 WatchSource:0}: Error finding container 40be415a4ffc83b891e0d915af08edd23e932e2e3abd845fcc335e0ae8d9d2c3: Status 404 returned error can't find the container with id 40be415a4ffc83b891e0d915af08edd23e932e2e3abd845fcc335e0ae8d9d2c3
Jul 16 09:06:32.154257 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:32.154151    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b" event={"ID":"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f","Type":"ContainerStarted","Data":"cc090034fe934f65b2e33260abbf92573614011813056b52b390cf47af3b7b96"}
Jul 16 09:06:32.154257 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:32.154219    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b" event={"ID":"fd35d279-26ea-4b12-8c8c-4ab9361d6c9f","Type":"ContainerStarted","Data":"40be415a4ffc83b891e0d915af08edd23e932e2e3abd845fcc335e0ae8d9d2c3"}
Jul 16 09:06:32.177166 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:32.177114    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b" podStartSLOduration=0.945816632 podStartE2EDuration="1.177096543s" totalImagesPullingTime="231.279911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:06:32.175759159 +0000 UTC m=+687.727791886" watchObservedRunningTime="2026-07-16 09:06:32.177096543 +0000 UTC m=+687.729129297"
Jul 16 09:06:35.583702 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:35.583663    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:41.661701 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:41.661663    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:41.662169 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:41.661731    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:41.674481 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:41.674449    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:42.215760 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:42.215731    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2s6b"
Jul 16 09:06:45.400788 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:45.400751    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:48.049480 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:06:48.049438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:07:01.673369 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.673290    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"]
Jul 16 09:07:01.676974 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.676954    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.679550 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.679515    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 16 09:07:01.689218 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.689194    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"]
Jul 16 09:07:01.761498 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.761457    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.761498 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.761498    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.761770 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.761518    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmxfp\" (UniqueName: \"kubernetes.io/projected/66624084-68c6-4fa5-b097-007a8c62b8c0-kube-api-access-fmxfp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.761770 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.761650    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.761770 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.761702    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66624084-68c6-4fa5-b097-007a8c62b8c0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.761901 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.761787    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.770501 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.770469    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:07:01.862960 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.862920    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.862960 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.862965    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.863231 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.862993    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmxfp\" (UniqueName: \"kubernetes.io/projected/66624084-68c6-4fa5-b097-007a8c62b8c0-kube-api-access-fmxfp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.863231 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.863046    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.863231 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.863098    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66624084-68c6-4fa5-b097-007a8c62b8c0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.863231 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.863153    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.863550 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.863509    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.863623 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.863584    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.863861 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.863836    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.865440 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.865415    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66624084-68c6-4fa5-b097-007a8c62b8c0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.866350 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.866327    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66624084-68c6-4fa5-b097-007a8c62b8c0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.880021 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.879990    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmxfp\" (UniqueName: \"kubernetes.io/projected/66624084-68c6-4fa5-b097-007a8c62b8c0-kube-api-access-fmxfp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8vd4w\" (UID: \"66624084-68c6-4fa5-b097-007a8c62b8c0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:01.988570 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:01.988453    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:02.150343 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:02.150317    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"]
Jul 16 09:07:02.152290 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:07:02.152257    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66624084_68c6_4fa5_b097_007a8c62b8c0.slice/crio-bac9206f73cd7527b45887fb61aa83c9620a98862a87b3e45b09d1f5c63f747d WatchSource:0}: Error finding container bac9206f73cd7527b45887fb61aa83c9620a98862a87b3e45b09d1f5c63f747d: Status 404 returned error can't find the container with id bac9206f73cd7527b45887fb61aa83c9620a98862a87b3e45b09d1f5c63f747d
Jul 16 09:07:02.302887 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:02.302803    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w" event={"ID":"66624084-68c6-4fa5-b097-007a8c62b8c0","Type":"ContainerStarted","Data":"bac9206f73cd7527b45887fb61aa83c9620a98862a87b3e45b09d1f5c63f747d"}
Jul 16 09:07:03.309492 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:03.309452    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w" event={"ID":"66624084-68c6-4fa5-b097-007a8c62b8c0","Type":"ContainerStarted","Data":"0ebc7352b9cbbcb044fd8a9ef2d1a17b389c0f1810fb31c2d67f091e5fed4871"}
Jul 16 09:07:03.329335 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:03.329284    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w" podStartSLOduration=2.09730545 podStartE2EDuration="2.329268104s" totalImagesPullingTime="231.962654ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:07:03.327762102 +0000 UTC m=+718.879794840" watchObservedRunningTime="2026-07-16 09:07:03.329268104 +0000 UTC m=+718.881300829"
Jul 16 09:07:05.946975 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:05.946939    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:07:06.139428 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:06.139390    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:07:06.206449 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:06.206360    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:07:11.988707 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:11.988662    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:11.989138 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:11.989016    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:12.001512 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:12.001478    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:12.366828 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:12.366801    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8vd4w"
Jul 16 09:07:13.708698 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:13.708658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:07:17.039406 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:17.039361    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:07:17.159680 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:07:17.159635    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:08:09.550754 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.550720    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c97b7b54f-4lvg5"]
Jul 16 09:08:09.554157 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.554138    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c97b7b54f-4lvg5"
Jul 16 09:08:09.562585 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.562559    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c97b7b54f-4lvg5"]
Jul 16 09:08:09.694675 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.694639    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsdfb\" (UniqueName: \"kubernetes.io/projected/4efb561b-6a9a-4473-812b-33b1a0ac000d-kube-api-access-lsdfb\") pod \"authorino-6c97b7b54f-4lvg5\" (UID: \"4efb561b-6a9a-4473-812b-33b1a0ac000d\") " pod="kuadrant-system/authorino-6c97b7b54f-4lvg5"
Jul 16 09:08:09.694865 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.694760    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4efb561b-6a9a-4473-812b-33b1a0ac000d-tls-cert\") pod \"authorino-6c97b7b54f-4lvg5\" (UID: \"4efb561b-6a9a-4473-812b-33b1a0ac000d\") " pod="kuadrant-system/authorino-6c97b7b54f-4lvg5"
Jul 16 09:08:09.795520 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.795480    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4efb561b-6a9a-4473-812b-33b1a0ac000d-tls-cert\") pod \"authorino-6c97b7b54f-4lvg5\" (UID: \"4efb561b-6a9a-4473-812b-33b1a0ac000d\") " pod="kuadrant-system/authorino-6c97b7b54f-4lvg5"
Jul 16 09:08:09.795709 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.795553    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsdfb\" (UniqueName: \"kubernetes.io/projected/4efb561b-6a9a-4473-812b-33b1a0ac000d-kube-api-access-lsdfb\") pod \"authorino-6c97b7b54f-4lvg5\" (UID: \"4efb561b-6a9a-4473-812b-33b1a0ac000d\") " pod="kuadrant-system/authorino-6c97b7b54f-4lvg5"
Jul 16 09:08:09.798021 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.797994    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4efb561b-6a9a-4473-812b-33b1a0ac000d-tls-cert\") pod \"authorino-6c97b7b54f-4lvg5\" (UID: \"4efb561b-6a9a-4473-812b-33b1a0ac000d\") " pod="kuadrant-system/authorino-6c97b7b54f-4lvg5"
Jul 16 09:08:09.804001 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.803935    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsdfb\" (UniqueName: \"kubernetes.io/projected/4efb561b-6a9a-4473-812b-33b1a0ac000d-kube-api-access-lsdfb\") pod \"authorino-6c97b7b54f-4lvg5\" (UID: \"4efb561b-6a9a-4473-812b-33b1a0ac000d\") " pod="kuadrant-system/authorino-6c97b7b54f-4lvg5"
Jul 16 09:08:09.864965 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.864929    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c97b7b54f-4lvg5"
Jul 16 09:08:09.982934 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:09.982881    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:08:10.013667 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:10.013635    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c97b7b54f-4lvg5"]
Jul 16 09:08:10.014925 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:08:10.014896    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4efb561b_6a9a_4473_812b_33b1a0ac000d.slice/crio-9c25771cc613ff32c025e0fef12256bbd1ff4f73639a2a76a5bbea71062bee24 WatchSource:0}: Error finding container 9c25771cc613ff32c025e0fef12256bbd1ff4f73639a2a76a5bbea71062bee24: Status 404 returned error can't find the container with id 9c25771cc613ff32c025e0fef12256bbd1ff4f73639a2a76a5bbea71062bee24
Jul 16 09:08:10.086733 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:10.086703    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:08:10.644625 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:10.644584    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c97b7b54f-4lvg5" event={"ID":"4efb561b-6a9a-4473-812b-33b1a0ac000d","Type":"ContainerStarted","Data":"9c25771cc613ff32c025e0fef12256bbd1ff4f73639a2a76a5bbea71062bee24"}
Jul 16 09:08:12.513494 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:12.513451    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:08:12.614889 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:12.614848    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:08:12.657891 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:12.657851    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c97b7b54f-4lvg5" event={"ID":"4efb561b-6a9a-4473-812b-33b1a0ac000d","Type":"ContainerStarted","Data":"d2821fe0e0e86634f8241d878753cbab74631eb5a3d713c42cfc2a07e8a62307"}
Jul 16 09:08:12.679109 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:12.679045    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c97b7b54f-4lvg5" podStartSLOduration=1.7687380560000001 podStartE2EDuration="3.679021465s" totalImagesPullingTime="1.910283409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:08:12.676600538 +0000 UTC m=+788.228633265" watchObservedRunningTime="2026-07-16 09:08:12.679021465 +0000 UTC m=+788.231054193"
Jul 16 09:08:12.717362 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:12.717321    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79fdfd9868-zf6kr"]
Jul 16 09:08:12.717739 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:12.717687    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-79fdfd9868-zf6kr" podUID="e6dfd568-1181-4858-abac-bdf84b7254cc" containerName="authorino" containerID="cri-o://8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304" gracePeriod=30
Jul 16 09:08:12.991707 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:12.991680    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79fdfd9868-zf6kr"
Jul 16 09:08:13.129685 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.129643    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6dfd568-1181-4858-abac-bdf84b7254cc-tls-cert\") pod \"e6dfd568-1181-4858-abac-bdf84b7254cc\" (UID: \"e6dfd568-1181-4858-abac-bdf84b7254cc\") "
Jul 16 09:08:13.129857 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.129780    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbt86\" (UniqueName: \"kubernetes.io/projected/e6dfd568-1181-4858-abac-bdf84b7254cc-kube-api-access-zbt86\") pod \"e6dfd568-1181-4858-abac-bdf84b7254cc\" (UID: \"e6dfd568-1181-4858-abac-bdf84b7254cc\") "
Jul 16 09:08:13.131752 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.131718    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6dfd568-1181-4858-abac-bdf84b7254cc-kube-api-access-zbt86" (OuterVolumeSpecName: "kube-api-access-zbt86") pod "e6dfd568-1181-4858-abac-bdf84b7254cc" (UID: "e6dfd568-1181-4858-abac-bdf84b7254cc"). InnerVolumeSpecName "kube-api-access-zbt86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:08:13.143069 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.143034    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6dfd568-1181-4858-abac-bdf84b7254cc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e6dfd568-1181-4858-abac-bdf84b7254cc" (UID: "e6dfd568-1181-4858-abac-bdf84b7254cc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:08:13.231503 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.231458    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbt86\" (UniqueName: \"kubernetes.io/projected/e6dfd568-1181-4858-abac-bdf84b7254cc-kube-api-access-zbt86\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:08:13.231503 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.231503    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6dfd568-1181-4858-abac-bdf84b7254cc-tls-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:08:13.664771 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.664739    2570 generic.go:356] "Generic (PLEG): container finished" podID="e6dfd568-1181-4858-abac-bdf84b7254cc" containerID="8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304" exitCode=0
Jul 16 09:08:13.665283 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.664784    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79fdfd9868-zf6kr"
Jul 16 09:08:13.665283 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.664832    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79fdfd9868-zf6kr" event={"ID":"e6dfd568-1181-4858-abac-bdf84b7254cc","Type":"ContainerDied","Data":"8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304"}
Jul 16 09:08:13.665283 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.664869    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79fdfd9868-zf6kr" event={"ID":"e6dfd568-1181-4858-abac-bdf84b7254cc","Type":"ContainerDied","Data":"5e3b02a8df106d33b0102c12b4efca6e03c0809d1c8cca342a46d8e93508995e"}
Jul 16 09:08:13.665283 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.664886    2570 scope.go:117] "RemoveContainer" containerID="8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304"
Jul 16 09:08:13.674570 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.674547    2570 scope.go:117] "RemoveContainer" containerID="8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304"
Jul 16 09:08:13.674873 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:08:13.674853    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304\": container with ID starting with 8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304 not found: ID does not exist" containerID="8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304"
Jul 16 09:08:13.674933 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.674885    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304"} err="failed to get container status \"8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304\": rpc error: code = NotFound desc = could not find container \"8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304\": container with ID starting with 8eacf90a6dda0aaddae27e48845601edbb41e3dd3ad41d0d19850168c6ec7304 not found: ID does not exist"
Jul 16 09:08:13.694297 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.694188    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79fdfd9868-zf6kr"]
Jul 16 09:08:13.696826 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:13.696803    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79fdfd9868-zf6kr"]
Jul 16 09:08:14.973266 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:08:14.973232    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6dfd568-1181-4858-abac-bdf84b7254cc" path="/var/lib/kubelet/pods/e6dfd568-1181-4858-abac-bdf84b7254cc/volumes"
Jul 16 09:09:13.700180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:13.700141    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:23.806573 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:23.806519    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75c958864b-zgz7b"]
Jul 16 09:09:23.807161 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:23.806866    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75c958864b-zgz7b" podUID="5cabcf39-96fb-4047-935b-2d765fb970e7" containerName="manager" containerID="cri-o://9f978bb666a37f9772f031422b39e45379b1847794d9299d425b1ee340025a73" gracePeriod=30
Jul 16 09:09:24.023384 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:24.023351    2570 generic.go:356] "Generic (PLEG): container finished" podID="5cabcf39-96fb-4047-935b-2d765fb970e7" containerID="9f978bb666a37f9772f031422b39e45379b1847794d9299d425b1ee340025a73" exitCode=0
Jul 16 09:09:24.023573 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:24.023418    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c958864b-zgz7b" event={"ID":"5cabcf39-96fb-4047-935b-2d765fb970e7","Type":"ContainerDied","Data":"9f978bb666a37f9772f031422b39e45379b1847794d9299d425b1ee340025a73"}
Jul 16 09:09:24.067281 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:24.067209    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:09:24.195684 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:24.195656    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xlkj\" (UniqueName: \"kubernetes.io/projected/5cabcf39-96fb-4047-935b-2d765fb970e7-kube-api-access-5xlkj\") pod \"5cabcf39-96fb-4047-935b-2d765fb970e7\" (UID: \"5cabcf39-96fb-4047-935b-2d765fb970e7\") "
Jul 16 09:09:24.195888 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:24.195703    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cabcf39-96fb-4047-935b-2d765fb970e7-webhook-cert\") pod \"5cabcf39-96fb-4047-935b-2d765fb970e7\" (UID: \"5cabcf39-96fb-4047-935b-2d765fb970e7\") "
Jul 16 09:09:24.197829 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:24.197800    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cabcf39-96fb-4047-935b-2d765fb970e7-kube-api-access-5xlkj" (OuterVolumeSpecName: "kube-api-access-5xlkj") pod "5cabcf39-96fb-4047-935b-2d765fb970e7" (UID: "5cabcf39-96fb-4047-935b-2d765fb970e7"). InnerVolumeSpecName "kube-api-access-5xlkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:09:24.197930 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:24.197850    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cabcf39-96fb-4047-935b-2d765fb970e7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5cabcf39-96fb-4047-935b-2d765fb970e7" (UID: "5cabcf39-96fb-4047-935b-2d765fb970e7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:09:24.296802 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:24.296764    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cabcf39-96fb-4047-935b-2d765fb970e7-webhook-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:09:24.296802 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:24.296794    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xlkj\" (UniqueName: \"kubernetes.io/projected/5cabcf39-96fb-4047-935b-2d765fb970e7-kube-api-access-5xlkj\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:09:25.029330 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.029305    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c958864b-zgz7b"
Jul 16 09:09:25.029900 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.029293    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c958864b-zgz7b" event={"ID":"5cabcf39-96fb-4047-935b-2d765fb970e7","Type":"ContainerDied","Data":"aa5ffc22ba5a4db6f3d098ab2ec233690683fcebe866a08655a21e824fe6bfad"}
Jul 16 09:09:25.029900 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.029456    2570 scope.go:117] "RemoveContainer" containerID="9f978bb666a37f9772f031422b39e45379b1847794d9299d425b1ee340025a73"
Jul 16 09:09:25.048424 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.048397    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75c958864b-zgz7b"]
Jul 16 09:09:25.057523 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.053855    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75c958864b-zgz7b"]
Jul 16 09:09:25.113774 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.113740    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:25.755962 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.755921    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:25.886582 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.886543    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75c958864b-nsp49"]
Jul 16 09:09:25.887034 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.887017    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6dfd568-1181-4858-abac-bdf84b7254cc" containerName="authorino"
Jul 16 09:09:25.887084 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.887036    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6dfd568-1181-4858-abac-bdf84b7254cc" containerName="authorino"
Jul 16 09:09:25.887084 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.887063    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cabcf39-96fb-4047-935b-2d765fb970e7" containerName="manager"
Jul 16 09:09:25.887084 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.887069    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cabcf39-96fb-4047-935b-2d765fb970e7" containerName="manager"
Jul 16 09:09:25.887180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.887137    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6dfd568-1181-4858-abac-bdf84b7254cc" containerName="authorino"
Jul 16 09:09:25.887180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.887144    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cabcf39-96fb-4047-935b-2d765fb970e7" containerName="manager"
Jul 16 09:09:25.891357 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.891335    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c958864b-nsp49"
Jul 16 09:09:25.895053 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.895033    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 09:09:25.895171 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.895033    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 09:09:25.895171 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.895034    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r5qbg\""
Jul 16 09:09:25.899790 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:25.899770    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c958864b-nsp49"]
Jul 16 09:09:26.009682 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:26.009595    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c186f07-9333-41fd-af0b-97defa937164-webhook-cert\") pod \"maas-controller-75c958864b-nsp49\" (UID: \"7c186f07-9333-41fd-af0b-97defa937164\") " pod="opendatahub/maas-controller-75c958864b-nsp49"
Jul 16 09:09:26.009682 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:26.009630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54sgl\" (UniqueName: \"kubernetes.io/projected/7c186f07-9333-41fd-af0b-97defa937164-kube-api-access-54sgl\") pod \"maas-controller-75c958864b-nsp49\" (UID: \"7c186f07-9333-41fd-af0b-97defa937164\") " pod="opendatahub/maas-controller-75c958864b-nsp49"
Jul 16 09:09:26.110336 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:26.110292    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c186f07-9333-41fd-af0b-97defa937164-webhook-cert\") pod \"maas-controller-75c958864b-nsp49\" (UID: \"7c186f07-9333-41fd-af0b-97defa937164\") " pod="opendatahub/maas-controller-75c958864b-nsp49"
Jul 16 09:09:26.110336 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:26.110336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54sgl\" (UniqueName: \"kubernetes.io/projected/7c186f07-9333-41fd-af0b-97defa937164-kube-api-access-54sgl\") pod \"maas-controller-75c958864b-nsp49\" (UID: \"7c186f07-9333-41fd-af0b-97defa937164\") " pod="opendatahub/maas-controller-75c958864b-nsp49"
Jul 16 09:09:26.112915 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:26.112884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c186f07-9333-41fd-af0b-97defa937164-webhook-cert\") pod \"maas-controller-75c958864b-nsp49\" (UID: \"7c186f07-9333-41fd-af0b-97defa937164\") " pod="opendatahub/maas-controller-75c958864b-nsp49"
Jul 16 09:09:26.120708 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:26.120684    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54sgl\" (UniqueName: \"kubernetes.io/projected/7c186f07-9333-41fd-af0b-97defa937164-kube-api-access-54sgl\") pod \"maas-controller-75c958864b-nsp49\" (UID: \"7c186f07-9333-41fd-af0b-97defa937164\") " pod="opendatahub/maas-controller-75c958864b-nsp49"
Jul 16 09:09:26.202648 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:26.202611    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c958864b-nsp49"
Jul 16 09:09:26.340013 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:26.339974    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c958864b-nsp49"]
Jul 16 09:09:26.340314 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:09:26.340283    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c186f07_9333_41fd_af0b_97defa937164.slice/crio-ee53d77c2b8e5c791f2423622e6a8b238b99faa43fb2a41dbc1ccf95f245684b WatchSource:0}: Error finding container ee53d77c2b8e5c791f2423622e6a8b238b99faa43fb2a41dbc1ccf95f245684b: Status 404 returned error can't find the container with id ee53d77c2b8e5c791f2423622e6a8b238b99faa43fb2a41dbc1ccf95f245684b
Jul 16 09:09:26.972201 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:26.972165    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cabcf39-96fb-4047-935b-2d765fb970e7" path="/var/lib/kubelet/pods/5cabcf39-96fb-4047-935b-2d765fb970e7/volumes"
Jul 16 09:09:27.040208 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:27.040175    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c958864b-nsp49" event={"ID":"7c186f07-9333-41fd-af0b-97defa937164","Type":"ContainerStarted","Data":"ee53d77c2b8e5c791f2423622e6a8b238b99faa43fb2a41dbc1ccf95f245684b"}
Jul 16 09:09:29.051888 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:29.051854    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c958864b-nsp49" event={"ID":"7c186f07-9333-41fd-af0b-97defa937164","Type":"ContainerStarted","Data":"face7e14965adda0d349bcb0b1bf5572e843fa7d3b97373ae76c45ffef3768c9"}
Jul 16 09:09:29.052296 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:29.051908    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75c958864b-nsp49"
Jul 16 09:09:29.071253 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:29.071208    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75c958864b-nsp49" podStartSLOduration=1.966090505 podStartE2EDuration="4.071194481s" totalImagesPullingTime="2.105103976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:09:29.070726887 +0000 UTC m=+864.622759612" watchObservedRunningTime="2026-07-16 09:09:29.071194481 +0000 UTC m=+864.623227206"
Jul 16 09:09:40.059485 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:09:40.059445    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75c958864b-nsp49"
Jul 16 09:10:00.919322 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:00.919219    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:04.900240 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:04.900209    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:10:04.900240 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:04.900232    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:10:10.884474 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:10.884434    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:10.991027 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:10.990978    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:11.138680 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:11.138590    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:17.271841 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:17.271803    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:17.369861 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:17.369822    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:17.469404 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:17.469352    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:17.645588 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:17.645526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:23.365023 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:23.364986    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:23.464121 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:10:23.464067    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:26.396691 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:12:26.396655    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:28.165547 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:12:28.165505    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:36.906747 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:12:36.906712    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:37.214118 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:12:37.214005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:15.006108 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:14:15.006069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:04.929429 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:15:04.929398    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:15:04.930950 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:15:04.930925    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:15:21.827908 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:15:21.827870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:20:04.959952 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:20:04.959922    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:20:04.962391 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:20:04.962318    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:20:29.673101 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:20:29.673010    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:12.588684 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:12.588635    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:22.284704 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:22.284644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:30.560400 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:30.560360    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:35.761598 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:35.761553    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:38.943104 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:38.943051    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:39.032791 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:39.032758    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:39.415455 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:39.415417    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:45.576620 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:45.576575    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:45.648012 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:45.647969    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:45.819098 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:45.819039    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:45.919617 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:45.919503    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:46.016211 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.016172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:46.062680 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.062640    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"]
Jul 16 09:21:46.066985 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.066963    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.069670 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.069627    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5f4d028a-serving-cert\""
Jul 16 09:21:46.078156 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.078122    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"]
Jul 16 09:21:46.136360 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.136323    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzxz9\" (UniqueName: \"kubernetes.io/projected/6e8c26fb-288e-4298-b6ba-f26a40558018-kube-api-access-vzxz9\") pod \"maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.136588 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.136440    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e8c26fb-288e-4298-b6ba-f26a40558018-openshift-service-ca\") pod \"maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.136588 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.136468    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e8c26fb-288e-4298-b6ba-f26a40558018-maas-api-tls\") pod \"maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.237828 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.237731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e8c26fb-288e-4298-b6ba-f26a40558018-maas-api-tls\") pod \"maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.237828 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.237781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzxz9\" (UniqueName: \"kubernetes.io/projected/6e8c26fb-288e-4298-b6ba-f26a40558018-kube-api-access-vzxz9\") pod \"maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.238071 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.237867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e8c26fb-288e-4298-b6ba-f26a40558018-openshift-service-ca\") pod \"maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.238516 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.238489    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e8c26fb-288e-4298-b6ba-f26a40558018-openshift-service-ca\") pod \"maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.240372 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.240346    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e8c26fb-288e-4298-b6ba-f26a40558018-maas-api-tls\") pod \"maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.247012 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.246985    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzxz9\" (UniqueName: \"kubernetes.io/projected/6e8c26fb-288e-4298-b6ba-f26a40558018-kube-api-access-vzxz9\") pod \"maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.365873 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.365820    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:46.381604 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.381575    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:46.466965 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.466925    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:46.525753 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.525728    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"]
Jul 16 09:21:46.527613 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:21:46.527582    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8c26fb_288e_4298_b6ba_f26a40558018.slice/crio-be4c5ae3b31378d998d483074755123be4c0c4611688ed55bdb83c9733f4255e WatchSource:0}: Error finding container be4c5ae3b31378d998d483074755123be4c0c4611688ed55bdb83c9733f4255e: Status 404 returned error can't find the container with id be4c5ae3b31378d998d483074755123be4c0c4611688ed55bdb83c9733f4255e
Jul 16 09:21:46.531643 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.531619    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:21:46.735675 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.735618    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:46.805941 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.805842    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb" event={"ID":"6e8c26fb-288e-4298-b6ba-f26a40558018","Type":"ContainerStarted","Data":"be4c5ae3b31378d998d483074755123be4c0c4611688ed55bdb83c9733f4255e"}
Jul 16 09:21:46.835760 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:46.835718    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:47.813606 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:47.813571    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb" event={"ID":"6e8c26fb-288e-4298-b6ba-f26a40558018","Type":"ContainerStarted","Data":"185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15"}
Jul 16 09:21:47.814050 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:47.813718    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:47.834245 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:47.834193    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb" podStartSLOduration=1.396085359 podStartE2EDuration="1.834177336s" totalImagesPullingTime="438.091977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:21:47.8330843 +0000 UTC m=+1603.385117026" watchObservedRunningTime="2026-07-16 09:21:47.834177336 +0000 UTC m=+1603.386210062"
Jul 16 09:21:48.455086 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:48.455051    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:48.515293 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:48.515253    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:49.893407 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:49.893370    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:52.255850 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:52.255815    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:52.365599 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:52.365524    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:53.824962 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:53.824934    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:55.897922 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:55.897883    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:57.949210 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:57.949126    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"]
Jul 16 09:21:57.949675 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:57.949334    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb" podUID="6e8c26fb-288e-4298-b6ba-f26a40558018" containerName="maas-api" containerID="cri-o://185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15" gracePeriod=30
Jul 16 09:21:57.982686 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:57.982638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:58.204409 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.204349    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:58.349910 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.349872    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e8c26fb-288e-4298-b6ba-f26a40558018-maas-api-tls\") pod \"6e8c26fb-288e-4298-b6ba-f26a40558018\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") "
Jul 16 09:21:58.350100 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.349930    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzxz9\" (UniqueName: \"kubernetes.io/projected/6e8c26fb-288e-4298-b6ba-f26a40558018-kube-api-access-vzxz9\") pod \"6e8c26fb-288e-4298-b6ba-f26a40558018\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") "
Jul 16 09:21:58.350100 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.349962    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e8c26fb-288e-4298-b6ba-f26a40558018-openshift-service-ca\") pod \"6e8c26fb-288e-4298-b6ba-f26a40558018\" (UID: \"6e8c26fb-288e-4298-b6ba-f26a40558018\") "
Jul 16 09:21:58.350424 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.350396    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e8c26fb-288e-4298-b6ba-f26a40558018-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6e8c26fb-288e-4298-b6ba-f26a40558018" (UID: "6e8c26fb-288e-4298-b6ba-f26a40558018"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:21:58.352251 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.352222    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e8c26fb-288e-4298-b6ba-f26a40558018-kube-api-access-vzxz9" (OuterVolumeSpecName: "kube-api-access-vzxz9") pod "6e8c26fb-288e-4298-b6ba-f26a40558018" (UID: "6e8c26fb-288e-4298-b6ba-f26a40558018"). InnerVolumeSpecName "kube-api-access-vzxz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:21:58.352251 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.352228    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e8c26fb-288e-4298-b6ba-f26a40558018-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6e8c26fb-288e-4298-b6ba-f26a40558018" (UID: "6e8c26fb-288e-4298-b6ba-f26a40558018"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:21:58.451036 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.450998    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e8c26fb-288e-4298-b6ba-f26a40558018-maas-api-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:21:58.451036 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.451030    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzxz9\" (UniqueName: \"kubernetes.io/projected/6e8c26fb-288e-4298-b6ba-f26a40558018-kube-api-access-vzxz9\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:21:58.451233 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.451045    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e8c26fb-288e-4298-b6ba-f26a40558018-openshift-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:21:58.625836 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.625794    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:58.869402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.869369    2570 generic.go:356] "Generic (PLEG): container finished" podID="6e8c26fb-288e-4298-b6ba-f26a40558018" containerID="185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15" exitCode=0
Jul 16 09:21:58.869591 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.869417    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"
Jul 16 09:21:58.869591 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.869448    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb" event={"ID":"6e8c26fb-288e-4298-b6ba-f26a40558018","Type":"ContainerDied","Data":"185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15"}
Jul 16 09:21:58.869591 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.869522    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb" event={"ID":"6e8c26fb-288e-4298-b6ba-f26a40558018","Type":"ContainerDied","Data":"be4c5ae3b31378d998d483074755123be4c0c4611688ed55bdb83c9733f4255e"}
Jul 16 09:21:58.869591 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.869564    2570 scope.go:117] "RemoveContainer" containerID="185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15"
Jul 16 09:21:58.878672 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.878649    2570 scope.go:117] "RemoveContainer" containerID="185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15"
Jul 16 09:21:58.878968 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:21:58.878947    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15\": container with ID starting with 185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15 not found: ID does not exist" containerID="185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15"
Jul 16 09:21:58.879030 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.878977    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15"} err="failed to get container status \"185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15\": rpc error: code = NotFound desc = could not find container \"185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15\": container with ID starting with 185088e77f2b9e392f764bda2448f284341a643dac9b94ff291f007d857d3d15 not found: ID does not exist"
Jul 16 09:21:58.891396 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.891369    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"]
Jul 16 09:21:58.895751 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.895732    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f4d028a-7c669f8b6b-98vgb"]
Jul 16 09:21:58.972490 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:21:58.972462    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e8c26fb-288e-4298-b6ba-f26a40558018" path="/var/lib/kubelet/pods/6e8c26fb-288e-4298-b6ba-f26a40558018/volumes"
Jul 16 09:22:04.225313 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:04.225273    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:04.326265 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:04.326229    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:04.520042 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:04.519933    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:04.614799 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:04.614760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:04.725693 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:04.725656    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:05.042757 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.042720    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"]
Jul 16 09:22:05.043353 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.043337    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e8c26fb-288e-4298-b6ba-f26a40558018" containerName="maas-api"
Jul 16 09:22:05.043417 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.043356    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e8c26fb-288e-4298-b6ba-f26a40558018" containerName="maas-api"
Jul 16 09:22:05.043482 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.043470    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e8c26fb-288e-4298-b6ba-f26a40558018" containerName="maas-api"
Jul 16 09:22:05.048224 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.048198    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.051587 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.051561    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2d7d58ac-serving-cert\""
Jul 16 09:22:05.053947 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.053918    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"]
Jul 16 09:22:05.211488 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.211453    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec397bb2-b212-4100-a205-c1be4e41cc28-maas-api-tls\") pod \"maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.211797 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.211774    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec397bb2-b212-4100-a205-c1be4e41cc28-openshift-service-ca\") pod \"maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.211975 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.211952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw2bx\" (UniqueName: \"kubernetes.io/projected/ec397bb2-b212-4100-a205-c1be4e41cc28-kube-api-access-sw2bx\") pod \"maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.264903 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.264869    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:05.312677 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.312588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec397bb2-b212-4100-a205-c1be4e41cc28-openshift-service-ca\") pod \"maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.312677 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.312641    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw2bx\" (UniqueName: \"kubernetes.io/projected/ec397bb2-b212-4100-a205-c1be4e41cc28-kube-api-access-sw2bx\") pod \"maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.312907 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.312734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec397bb2-b212-4100-a205-c1be4e41cc28-maas-api-tls\") pod \"maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.313363 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.313333    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec397bb2-b212-4100-a205-c1be4e41cc28-openshift-service-ca\") pod \"maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.315720 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.315693    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec397bb2-b212-4100-a205-c1be4e41cc28-maas-api-tls\") pod \"maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.321631 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.321597    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw2bx\" (UniqueName: \"kubernetes.io/projected/ec397bb2-b212-4100-a205-c1be4e41cc28-kube-api-access-sw2bx\") pod \"maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.362567 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.362524    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:05.364577 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.364515    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:05.440052 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.440018    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:05.590289 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.590243    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:05.726507 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.726479    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"]
Jul 16 09:22:05.728571 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:22:05.728545    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec397bb2_b212_4100_a205_c1be4e41cc28.slice/crio-a5ee5d78de09e557d95a75899ac5e84614bc7be87ccf58aa5d2555bf98d806dc WatchSource:0}: Error finding container a5ee5d78de09e557d95a75899ac5e84614bc7be87ccf58aa5d2555bf98d806dc: Status 404 returned error can't find the container with id a5ee5d78de09e557d95a75899ac5e84614bc7be87ccf58aa5d2555bf98d806dc
Jul 16 09:22:05.907081 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:05.906991    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c" event={"ID":"ec397bb2-b212-4100-a205-c1be4e41cc28","Type":"ContainerStarted","Data":"a5ee5d78de09e557d95a75899ac5e84614bc7be87ccf58aa5d2555bf98d806dc"}
Jul 16 09:22:06.139048 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:06.139010    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:06.913012 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:06.912970    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c" event={"ID":"ec397bb2-b212-4100-a205-c1be4e41cc28","Type":"ContainerStarted","Data":"353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7"}
Jul 16 09:22:06.913501 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:06.913128    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:06.939112 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:06.939063    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c" podStartSLOduration=1.47509371 podStartE2EDuration="1.939047614s" totalImagesPullingTime="463.953904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:22:06.936423102 +0000 UTC m=+1622.488455828" watchObservedRunningTime="2026-07-16 09:22:06.939047614 +0000 UTC m=+1622.491080339"
Jul 16 09:22:07.865256 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:07.865219    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:11.238805 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:11.238750    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:11.339390 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:11.339333    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:12.255600 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:12.255560    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:12.925101 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:12.925069    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:15.955708 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:15.955668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:16.570267 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.570232    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"]
Jul 16 09:22:16.570542 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.570481    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c" podUID="ec397bb2-b212-4100-a205-c1be4e41cc28" containerName="maas-api" containerID="cri-o://353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7" gracePeriod=30
Jul 16 09:22:16.592952 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.592922    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:16.829955 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.829888    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:16.922315 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.922283    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw2bx\" (UniqueName: \"kubernetes.io/projected/ec397bb2-b212-4100-a205-c1be4e41cc28-kube-api-access-sw2bx\") pod \"ec397bb2-b212-4100-a205-c1be4e41cc28\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") "
Jul 16 09:22:16.922485 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.922335    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec397bb2-b212-4100-a205-c1be4e41cc28-maas-api-tls\") pod \"ec397bb2-b212-4100-a205-c1be4e41cc28\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") "
Jul 16 09:22:16.922485 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.922360    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec397bb2-b212-4100-a205-c1be4e41cc28-openshift-service-ca\") pod \"ec397bb2-b212-4100-a205-c1be4e41cc28\" (UID: \"ec397bb2-b212-4100-a205-c1be4e41cc28\") "
Jul 16 09:22:16.922819 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.922792    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec397bb2-b212-4100-a205-c1be4e41cc28-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec397bb2-b212-4100-a205-c1be4e41cc28" (UID: "ec397bb2-b212-4100-a205-c1be4e41cc28"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:22:16.924451 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.924426    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec397bb2-b212-4100-a205-c1be4e41cc28-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec397bb2-b212-4100-a205-c1be4e41cc28" (UID: "ec397bb2-b212-4100-a205-c1be4e41cc28"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:22:16.924574 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.924552    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec397bb2-b212-4100-a205-c1be4e41cc28-kube-api-access-sw2bx" (OuterVolumeSpecName: "kube-api-access-sw2bx") pod "ec397bb2-b212-4100-a205-c1be4e41cc28" (UID: "ec397bb2-b212-4100-a205-c1be4e41cc28"). InnerVolumeSpecName "kube-api-access-sw2bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:22:16.970852 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.970819    2570 generic.go:356] "Generic (PLEG): container finished" podID="ec397bb2-b212-4100-a205-c1be4e41cc28" containerID="353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7" exitCode=0
Jul 16 09:22:16.971317 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.970941    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"
Jul 16 09:22:16.972181 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.972157    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c" event={"ID":"ec397bb2-b212-4100-a205-c1be4e41cc28","Type":"ContainerDied","Data":"353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7"}
Jul 16 09:22:16.972291 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.972199    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c" event={"ID":"ec397bb2-b212-4100-a205-c1be4e41cc28","Type":"ContainerDied","Data":"a5ee5d78de09e557d95a75899ac5e84614bc7be87ccf58aa5d2555bf98d806dc"}
Jul 16 09:22:16.972291 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.972221    2570 scope.go:117] "RemoveContainer" containerID="353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7"
Jul 16 09:22:16.982254 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.982232    2570 scope.go:117] "RemoveContainer" containerID="353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7"
Jul 16 09:22:16.982590 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:22:16.982560    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7\": container with ID starting with 353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7 not found: ID does not exist" containerID="353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7"
Jul 16 09:22:16.982696 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.982602    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7"} err="failed to get container status \"353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7\": rpc error: code = NotFound desc = could not find container \"353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7\": container with ID starting with 353799c7ead661828716a46b53733839ba65391f3334ddcdf46c0aade31e21c7 not found: ID does not exist"
Jul 16 09:22:16.997369 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:16.997348    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"]
Jul 16 09:22:17.002038 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:17.002016    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d7d58ac-65457bb7cf-6rk9c"]
Jul 16 09:22:17.023303 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:17.023274    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw2bx\" (UniqueName: \"kubernetes.io/projected/ec397bb2-b212-4100-a205-c1be4e41cc28-kube-api-access-sw2bx\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:22:17.023303 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:17.023302    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec397bb2-b212-4100-a205-c1be4e41cc28-maas-api-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:22:17.023464 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:17.023311    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec397bb2-b212-4100-a205-c1be4e41cc28-openshift-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:22:17.061547 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:17.061507    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:18.981440 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:18.981407    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec397bb2-b212-4100-a205-c1be4e41cc28" path="/var/lib/kubelet/pods/ec397bb2-b212-4100-a205-c1be4e41cc28/volumes"
Jul 16 09:22:23.400500 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.400458    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:23.503070 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.503028    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:23.655487 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.655404    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:23.737838 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.737796    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:23.837179 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.837133    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:23.856258 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.856222    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"]
Jul 16 09:22:23.856902 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.856870    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec397bb2-b212-4100-a205-c1be4e41cc28" containerName="maas-api"
Jul 16 09:22:23.856902 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.856891    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec397bb2-b212-4100-a205-c1be4e41cc28" containerName="maas-api"
Jul 16 09:22:23.857105 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.857008    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec397bb2-b212-4100-a205-c1be4e41cc28" containerName="maas-api"
Jul 16 09:22:23.861670 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.861650    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:23.864184 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.864163    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ed97d282-serving-cert\""
Jul 16 09:22:23.872144 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.871935    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"]
Jul 16 09:22:23.882786 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.882756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3b10d60-d403-4841-a465-f927a3d3465f-maas-api-tls\") pod \"maas-api-e2e-derive-ed97d282-6798749f64-88sql\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:23.882897 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.882830    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b10d60-d403-4841-a465-f927a3d3465f-openshift-service-ca\") pod \"maas-api-e2e-derive-ed97d282-6798749f64-88sql\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:23.882897 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.882872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x95vf\" (UniqueName: \"kubernetes.io/projected/f3b10d60-d403-4841-a465-f927a3d3465f-kube-api-access-x95vf\") pod \"maas-api-e2e-derive-ed97d282-6798749f64-88sql\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:23.937407 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.937299    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:23.983847 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.983808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3b10d60-d403-4841-a465-f927a3d3465f-maas-api-tls\") pod \"maas-api-e2e-derive-ed97d282-6798749f64-88sql\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:23.984047 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:22:23.983928    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-serving-cert: secret "maas-api-e2e-derive-ed97d282-serving-cert" not found
Jul 16 09:22:23.984047 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.983954    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b10d60-d403-4841-a465-f927a3d3465f-openshift-service-ca\") pod \"maas-api-e2e-derive-ed97d282-6798749f64-88sql\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:23.984047 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:22:23.984000    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3b10d60-d403-4841-a465-f927a3d3465f-maas-api-tls podName:f3b10d60-d403-4841-a465-f927a3d3465f nodeName:}" failed. No retries permitted until 2026-07-16 09:22:24.483979328 +0000 UTC m=+1640.036012033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3b10d60-d403-4841-a465-f927a3d3465f-maas-api-tls") pod "maas-api-e2e-derive-ed97d282-6798749f64-88sql" (UID: "f3b10d60-d403-4841-a465-f927a3d3465f") : secret "maas-api-e2e-derive-ed97d282-serving-cert" not found
Jul 16 09:22:23.984047 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.984032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95vf\" (UniqueName: \"kubernetes.io/projected/f3b10d60-d403-4841-a465-f927a3d3465f-kube-api-access-x95vf\") pod \"maas-api-e2e-derive-ed97d282-6798749f64-88sql\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:23.984638 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.984616    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b10d60-d403-4841-a465-f927a3d3465f-openshift-service-ca\") pod \"maas-api-e2e-derive-ed97d282-6798749f64-88sql\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:23.993397 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:23.993372    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x95vf\" (UniqueName: \"kubernetes.io/projected/f3b10d60-d403-4841-a465-f927a3d3465f-kube-api-access-x95vf\") pod \"maas-api-e2e-derive-ed97d282-6798749f64-88sql\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:24.092234 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:24.092197    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:24.489121 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:24.489082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3b10d60-d403-4841-a465-f927a3d3465f-maas-api-tls\") pod \"maas-api-e2e-derive-ed97d282-6798749f64-88sql\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:24.492094 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:24.492059    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3b10d60-d403-4841-a465-f927a3d3465f-maas-api-tls\") pod \"maas-api-e2e-derive-ed97d282-6798749f64-88sql\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:24.535001 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:24.534970    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:24.635987 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:24.635946    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:24.776437 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:24.776337    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:24.932793 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:24.932747    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"]
Jul 16 09:22:24.933049 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:22:24.933026    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b10d60_d403_4841_a465_f927a3d3465f.slice/crio-403b8f61cf7e1e40e8ab77ecbf2b07948688ddeb749dd2944ff27ed8dbe57664 WatchSource:0}: Error finding container 403b8f61cf7e1e40e8ab77ecbf2b07948688ddeb749dd2944ff27ed8dbe57664: Status 404 returned error can't find the container with id 403b8f61cf7e1e40e8ab77ecbf2b07948688ddeb749dd2944ff27ed8dbe57664
Jul 16 09:22:25.014215 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:25.014176    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql" event={"ID":"f3b10d60-d403-4841-a465-f927a3d3465f","Type":"ContainerStarted","Data":"403b8f61cf7e1e40e8ab77ecbf2b07948688ddeb749dd2944ff27ed8dbe57664"}
Jul 16 09:22:27.024811 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:27.024758    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql" event={"ID":"f3b10d60-d403-4841-a465-f927a3d3465f","Type":"ContainerStarted","Data":"5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932"}
Jul 16 09:22:27.025220 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:27.024865    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:27.095879 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:27.095840    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:30.065349 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:30.065313    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:30.129862 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:30.129828    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:31.214098 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:31.214056    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:33.034848 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:33.034819    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:33.053938 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:33.053850    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql" podStartSLOduration=8.781377885 podStartE2EDuration="10.053830538s" totalImagesPullingTime="1.272452653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:22:27.042503611 +0000 UTC m=+1642.594536338" watchObservedRunningTime="2026-07-16 09:22:33.053830538 +0000 UTC m=+1648.605863269"
Jul 16 09:22:35.166578 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.166545    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"]
Jul 16 09:22:35.167061 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.166732    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql" podUID="f3b10d60-d403-4841-a465-f927a3d3465f" containerName="maas-api" containerID="cri-o://5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932" gracePeriod=30
Jul 16 09:22:35.195711 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.195664    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:35.423703 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.423634    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:35.496469 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.496440    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x95vf\" (UniqueName: \"kubernetes.io/projected/f3b10d60-d403-4841-a465-f927a3d3465f-kube-api-access-x95vf\") pod \"f3b10d60-d403-4841-a465-f927a3d3465f\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") "
Jul 16 09:22:35.496681 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.496517    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3b10d60-d403-4841-a465-f927a3d3465f-maas-api-tls\") pod \"f3b10d60-d403-4841-a465-f927a3d3465f\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") "
Jul 16 09:22:35.496681 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.496587    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b10d60-d403-4841-a465-f927a3d3465f-openshift-service-ca\") pod \"f3b10d60-d403-4841-a465-f927a3d3465f\" (UID: \"f3b10d60-d403-4841-a465-f927a3d3465f\") "
Jul 16 09:22:35.496923 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.496899    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b10d60-d403-4841-a465-f927a3d3465f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3b10d60-d403-4841-a465-f927a3d3465f" (UID: "f3b10d60-d403-4841-a465-f927a3d3465f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:22:35.498573 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.498514    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b10d60-d403-4841-a465-f927a3d3465f-kube-api-access-x95vf" (OuterVolumeSpecName: "kube-api-access-x95vf") pod "f3b10d60-d403-4841-a465-f927a3d3465f" (UID: "f3b10d60-d403-4841-a465-f927a3d3465f"). InnerVolumeSpecName "kube-api-access-x95vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:22:35.498715 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.498693    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3b10d60-d403-4841-a465-f927a3d3465f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3b10d60-d403-4841-a465-f927a3d3465f" (UID: "f3b10d60-d403-4841-a465-f927a3d3465f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:22:35.597819 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.597784    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x95vf\" (UniqueName: \"kubernetes.io/projected/f3b10d60-d403-4841-a465-f927a3d3465f-kube-api-access-x95vf\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:22:35.597819 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.597817    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3b10d60-d403-4841-a465-f927a3d3465f-maas-api-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:22:35.598013 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.597830    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b10d60-d403-4841-a465-f927a3d3465f-openshift-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:22:35.793988 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:35.793901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:36.071849 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:36.071818    2570 generic.go:356] "Generic (PLEG): container finished" podID="f3b10d60-d403-4841-a465-f927a3d3465f" containerID="5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932" exitCode=0
Jul 16 09:22:36.072011 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:36.071867    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"
Jul 16 09:22:36.072011 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:36.071894    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql" event={"ID":"f3b10d60-d403-4841-a465-f927a3d3465f","Type":"ContainerDied","Data":"5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932"}
Jul 16 09:22:36.072011 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:36.071953    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql" event={"ID":"f3b10d60-d403-4841-a465-f927a3d3465f","Type":"ContainerDied","Data":"403b8f61cf7e1e40e8ab77ecbf2b07948688ddeb749dd2944ff27ed8dbe57664"}
Jul 16 09:22:36.072011 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:36.071975    2570 scope.go:117] "RemoveContainer" containerID="5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932"
Jul 16 09:22:36.081334 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:36.081320    2570 scope.go:117] "RemoveContainer" containerID="5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932"
Jul 16 09:22:36.081591 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:22:36.081571    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932\": container with ID starting with 5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932 not found: ID does not exist" containerID="5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932"
Jul 16 09:22:36.081635 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:36.081601    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932"} err="failed to get container status \"5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932\": rpc error: code = NotFound desc = could not find container \"5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932\": container with ID starting with 5a11272ebeff08d2f9bfd660bdcf2c5b0112741eff4b1d09e3b8750efc89d932 not found: ID does not exist"
Jul 16 09:22:36.094751 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:36.094725    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"]
Jul 16 09:22:36.098973 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:36.098950    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ed97d282-6798749f64-88sql"]
Jul 16 09:22:36.971772 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:36.971733    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b10d60-d403-4841-a465-f927a3d3465f" path="/var/lib/kubelet/pods/f3b10d60-d403-4841-a465-f927a3d3465f/volumes"
Jul 16 09:22:41.809430 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:41.809386    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:41.910043 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:41.910007    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:42.336463 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:42.336415    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:42.437730 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:42.437677    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:42.534491 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:42.534456    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:44.036008 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:44.035945    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:49.972597 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:49.972547    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:50.074416 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:50.074376    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:50.211618 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:50.211583    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:50.295480 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:50.295391    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:50.756815 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:22:50.756775    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:16.830604 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:16.830571    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:23.056737 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:23.056697    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:23.158552 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:23.158499    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:23.259952 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:23.259913    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:24.117114 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:24.117079    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:39.283243 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:39.283206    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:45.601177 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:45.601131    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:45.715052 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:45.715010    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:45.811643 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:45.811599    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:56.416706 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:56.416666    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:57.311854 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:23:57.311816    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:03.904876 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:03.904841    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:04.005897 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:04.005861    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:04.087543 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:04.087488    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:04.187488 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:04.187392    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:05.125223 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:05.125190    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:05.233562 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:05.233516    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:05.311662 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:05.311623    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:07.112908 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:07.112868    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:14.330102 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:14.330062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:14.430649 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:14.430613    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:15.092719 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:15.092682    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:21.888246 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:21.888203    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:21.987833 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:21.987793    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:22.185518 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:22.185428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:22.569050 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:22.569012    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:22.874607 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:22.874497    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:24.498007 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.497953    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:24.588670 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.588638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:24.776204 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.776125    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"]
Jul 16 09:24:24.776563 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.776527    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b10d60-d403-4841-a465-f927a3d3465f" containerName="maas-api"
Jul 16 09:24:24.776563 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.776561    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b10d60-d403-4841-a465-f927a3d3465f" containerName="maas-api"
Jul 16 09:24:24.776748 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.776639    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b10d60-d403-4841-a465-f927a3d3465f" containerName="maas-api"
Jul 16 09:24:24.779746 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.779726    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:24.782365 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.782348    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8e4c8858-serving-cert\""
Jul 16 09:24:24.798090 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.798055    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"]
Jul 16 09:24:24.826441 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.826386    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:24.928957 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.928917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60cc38dc-bc8f-492a-86fd-8738a4632a28-openshift-service-ca\") pod \"maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:24.929163 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.928995    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htwth\" (UniqueName: \"kubernetes.io/projected/60cc38dc-bc8f-492a-86fd-8738a4632a28-kube-api-access-htwth\") pod \"maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:24.929163 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:24.929024    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60cc38dc-bc8f-492a-86fd-8738a4632a28-maas-api-tls\") pod \"maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:25.029745 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.029634    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htwth\" (UniqueName: \"kubernetes.io/projected/60cc38dc-bc8f-492a-86fd-8738a4632a28-kube-api-access-htwth\") pod \"maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:25.029745 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.029689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60cc38dc-bc8f-492a-86fd-8738a4632a28-maas-api-tls\") pod \"maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:25.030010 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.029763    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60cc38dc-bc8f-492a-86fd-8738a4632a28-openshift-service-ca\") pod \"maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:25.030010 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:24:25.029867    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-serving-cert: secret "maas-api-e2e-mt-8e4c8858-serving-cert" not found
Jul 16 09:24:25.030010 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:24:25.029937    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60cc38dc-bc8f-492a-86fd-8738a4632a28-maas-api-tls podName:60cc38dc-bc8f-492a-86fd-8738a4632a28 nodeName:}" failed. No retries permitted until 2026-07-16 09:24:25.529914824 +0000 UTC m=+1761.081947544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/60cc38dc-bc8f-492a-86fd-8738a4632a28-maas-api-tls") pod "maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r" (UID: "60cc38dc-bc8f-492a-86fd-8738a4632a28") : secret "maas-api-e2e-mt-8e4c8858-serving-cert" not found
Jul 16 09:24:25.030462 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.030441    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60cc38dc-bc8f-492a-86fd-8738a4632a28-openshift-service-ca\") pod \"maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:25.043868 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.043834    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htwth\" (UniqueName: \"kubernetes.io/projected/60cc38dc-bc8f-492a-86fd-8738a4632a28-kube-api-access-htwth\") pod \"maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:25.212312 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.212278    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:25.334685 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.334650    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:25.436228 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.436164    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:25.535120 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.535079    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60cc38dc-bc8f-492a-86fd-8738a4632a28-maas-api-tls\") pod \"maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:25.537699 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.537671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60cc38dc-bc8f-492a-86fd-8738a4632a28-maas-api-tls\") pod \"maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:25.691913 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:25.691818    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:26.055023 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:26.054992    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"]
Jul 16 09:24:26.056742 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:24:26.056717    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60cc38dc_bc8f_492a_86fd_8738a4632a28.slice/crio-3bb4b6c700ae1893b151658462325d6b33e125bf6f33d453e1c3769f2cd98f07 WatchSource:0}: Error finding container 3bb4b6c700ae1893b151658462325d6b33e125bf6f33d453e1c3769f2cd98f07: Status 404 returned error can't find the container with id 3bb4b6c700ae1893b151658462325d6b33e125bf6f33d453e1c3769f2cd98f07
Jul 16 09:24:26.639784 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:26.639746    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r" event={"ID":"60cc38dc-bc8f-492a-86fd-8738a4632a28","Type":"ContainerStarted","Data":"3bb4b6c700ae1893b151658462325d6b33e125bf6f33d453e1c3769f2cd98f07"}
Jul 16 09:24:27.645912 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:27.645866    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r" event={"ID":"60cc38dc-bc8f-492a-86fd-8738a4632a28","Type":"ContainerStarted","Data":"6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7"}
Jul 16 09:24:27.646369 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:27.645942    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:27.665428 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:27.665330    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r" podStartSLOduration=2.3256657130000002 podStartE2EDuration="3.665314873s" totalImagesPullingTime="1.33964916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:24:27.663363616 +0000 UTC m=+1763.215396366" watchObservedRunningTime="2026-07-16 09:24:27.665314873 +0000 UTC m=+1763.217347600"
Jul 16 09:24:30.071606 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:30.071566    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:30.792830 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:30.792787    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:30.889886 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:30.889850    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:31.283546 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:31.283501    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:33.657166 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:33.657131    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:37.157522 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:37.157483    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:37.216696 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:37.216657    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:37.960032 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:37.959988    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:43.674790 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:43.674752    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"]
Jul 16 09:24:43.675572 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:43.675524    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r" podUID="60cc38dc-bc8f-492a-86fd-8738a4632a28" containerName="maas-api" containerID="cri-o://6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7" gracePeriod=30
Jul 16 09:24:43.701784 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:43.701748    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:43.931725 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:43.931670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:43.941928 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:43.941905    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:43.999148 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:43.999115    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htwth\" (UniqueName: \"kubernetes.io/projected/60cc38dc-bc8f-492a-86fd-8738a4632a28-kube-api-access-htwth\") pod \"60cc38dc-bc8f-492a-86fd-8738a4632a28\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") "
Jul 16 09:24:43.999319 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:43.999195    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60cc38dc-bc8f-492a-86fd-8738a4632a28-maas-api-tls\") pod \"60cc38dc-bc8f-492a-86fd-8738a4632a28\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") "
Jul 16 09:24:43.999319 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:43.999239    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60cc38dc-bc8f-492a-86fd-8738a4632a28-openshift-service-ca\") pod \"60cc38dc-bc8f-492a-86fd-8738a4632a28\" (UID: \"60cc38dc-bc8f-492a-86fd-8738a4632a28\") "
Jul 16 09:24:43.999715 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:43.999681    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60cc38dc-bc8f-492a-86fd-8738a4632a28-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "60cc38dc-bc8f-492a-86fd-8738a4632a28" (UID: "60cc38dc-bc8f-492a-86fd-8738a4632a28"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:24:44.001364 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.001337    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60cc38dc-bc8f-492a-86fd-8738a4632a28-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "60cc38dc-bc8f-492a-86fd-8738a4632a28" (UID: "60cc38dc-bc8f-492a-86fd-8738a4632a28"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:24:44.001467 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.001385    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60cc38dc-bc8f-492a-86fd-8738a4632a28-kube-api-access-htwth" (OuterVolumeSpecName: "kube-api-access-htwth") pod "60cc38dc-bc8f-492a-86fd-8738a4632a28" (UID: "60cc38dc-bc8f-492a-86fd-8738a4632a28"). InnerVolumeSpecName "kube-api-access-htwth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:24:44.100846 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.100809    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60cc38dc-bc8f-492a-86fd-8738a4632a28-openshift-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:24:44.100846 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.100840    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htwth\" (UniqueName: \"kubernetes.io/projected/60cc38dc-bc8f-492a-86fd-8738a4632a28-kube-api-access-htwth\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:24:44.100846 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.100850    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60cc38dc-bc8f-492a-86fd-8738a4632a28-maas-api-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:24:44.731954 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.731918    2570 generic.go:356] "Generic (PLEG): container finished" podID="60cc38dc-bc8f-492a-86fd-8738a4632a28" containerID="6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7" exitCode=0
Jul 16 09:24:44.732394 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.731964    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"
Jul 16 09:24:44.732394 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.731992    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r" event={"ID":"60cc38dc-bc8f-492a-86fd-8738a4632a28","Type":"ContainerDied","Data":"6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7"}
Jul 16 09:24:44.732394 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.732042    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r" event={"ID":"60cc38dc-bc8f-492a-86fd-8738a4632a28","Type":"ContainerDied","Data":"3bb4b6c700ae1893b151658462325d6b33e125bf6f33d453e1c3769f2cd98f07"}
Jul 16 09:24:44.732394 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.732077    2570 scope.go:117] "RemoveContainer" containerID="6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7"
Jul 16 09:24:44.742061 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.742042    2570 scope.go:117] "RemoveContainer" containerID="6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7"
Jul 16 09:24:44.742319 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:24:44.742300    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7\": container with ID starting with 6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7 not found: ID does not exist" containerID="6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7"
Jul 16 09:24:44.742370 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.742327    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7"} err="failed to get container status \"6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7\": rpc error: code = NotFound desc = could not find container \"6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7\": container with ID starting with 6e1197d39a617c2eb44b293fb2e0de044da88c41df02742481697d1e2c7385e7 not found: ID does not exist"
Jul 16 09:24:44.756898 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.756870    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"]
Jul 16 09:24:44.759202 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.759181    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8e4c8858-6757b8d66d-tfp6r"]
Jul 16 09:24:44.971674 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:44.971636    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60cc38dc-bc8f-492a-86fd-8738a4632a28" path="/var/lib/kubelet/pods/60cc38dc-bc8f-492a-86fd-8738a4632a28/volumes"
Jul 16 09:24:48.503158 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:48.503120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:48.604906 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:48.604867    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:49.957986 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:49.957947    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:50.029653 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:50.029614    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:50.258399 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:50.258305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:50.477384 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:50.477347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:50.626688 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:50.626654    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:50.725691 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:50.725653    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:50.879058 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:50.878957    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:56.807085 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:56.806971    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:56.907753 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:56.907716    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:57.012163 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:57.012131    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:57.176025 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:24:57.175984    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:03.250955 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:03.250920    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:03.325576 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:03.325514    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:04.999234 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:04.999118    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:25:04.999234 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:04.999166    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:25:11.266473 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:11.266431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:11.363564 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:11.363514    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:11.463342 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:11.463303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:12.283737 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:12.283701    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:12.384138 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:12.384105    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:12.483527 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:12.483486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:14.104958 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:14.104916    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:20.105985 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:20.105947    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:20.165757 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:20.165718    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:20.856797 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:20.856765    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:26.876102 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:26.876059    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:26.935471 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:26.935437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:27.024194 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:27.024160    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:27.118686 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:27.118645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:37.729223 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:37.729187    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:39.304391 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:39.304350    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:59.220630 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:25:59.220589    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:05.118527 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:05.118490    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:05.218414 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:05.218369    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:05.501185 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:05.501099    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:05.860154 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:05.860123    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:06.066650 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:06.066591    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:07.524859 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.524821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:07.624056 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.624020    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:07.715183 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.715147    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"]
Jul 16 09:26:07.715621 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.715606    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60cc38dc-bc8f-492a-86fd-8738a4632a28" containerName="maas-api"
Jul 16 09:26:07.715621 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.715622    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="60cc38dc-bc8f-492a-86fd-8738a4632a28" containerName="maas-api"
Jul 16 09:26:07.715763 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.715738    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="60cc38dc-bc8f-492a-86fd-8738a4632a28" containerName="maas-api"
Jul 16 09:26:07.719166 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.719140    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:07.721811 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.721783    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-00d870-serving-cert\""
Jul 16 09:26:07.731775 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.731750    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"]
Jul 16 09:26:07.758973 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.758937    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:07.769170 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.769145    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvmp\" (UniqueName: \"kubernetes.io/projected/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-kube-api-access-hqvmp\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:07.769322 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.769231    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:07.769322 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.769260    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-openshift-service-ca\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:07.869877 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.869832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvmp\" (UniqueName: \"kubernetes.io/projected/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-kube-api-access-hqvmp\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:07.870146 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.869959    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:07.870146 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.869996    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-openshift-service-ca\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:07.870316 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:26:07.870288    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-serving-cert: secret "maas-api-e2e-inf-a-00d870-serving-cert" not found
Jul 16 09:26:07.870386 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:26:07.870377    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls podName:5f555e04-0ee8-4422-bbb3-1e5ce16f3202 nodeName:}" failed. No retries permitted until 2026-07-16 09:26:08.370354645 +0000 UTC m=+1863.922387350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls") pod "maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp" (UID: "5f555e04-0ee8-4422-bbb3-1e5ce16f3202") : secret "maas-api-e2e-inf-a-00d870-serving-cert" not found
Jul 16 09:26:07.870998 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.870972    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-openshift-service-ca\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:07.878917 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:07.878897    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvmp\" (UniqueName: \"kubernetes.io/projected/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-kube-api-access-hqvmp\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:08.251380 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:08.251285    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:08.352736 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:08.352696    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:08.375557 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:08.375506    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:08.375750 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:26:08.375678    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-serving-cert: secret "maas-api-e2e-inf-a-00d870-serving-cert" not found
Jul 16 09:26:08.375825 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:26:08.375765    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls podName:5f555e04-0ee8-4422-bbb3-1e5ce16f3202 nodeName:}" failed. No retries permitted until 2026-07-16 09:26:09.375745678 +0000 UTC m=+1864.927778397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls") pod "maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp" (UID: "5f555e04-0ee8-4422-bbb3-1e5ce16f3202") : secret "maas-api-e2e-inf-a-00d870-serving-cert" not found
Jul 16 09:26:08.451863 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:08.451814    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:09.384938 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:09.384891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:09.387466 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:09.387436    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls\") pod \"maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:09.532509 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:09.532472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:09.677363 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:09.677330    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"]
Jul 16 09:26:09.679620 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:26:09.679577    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f555e04_0ee8_4422_bbb3_1e5ce16f3202.slice/crio-701792d4a87929e48b3589bb3c85c09412511c28db1395289d92d5dd54c89d52 WatchSource:0}: Error finding container 701792d4a87929e48b3589bb3c85c09412511c28db1395289d92d5dd54c89d52: Status 404 returned error can't find the container with id 701792d4a87929e48b3589bb3c85c09412511c28db1395289d92d5dd54c89d52
Jul 16 09:26:10.156001 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:10.155963    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp" event={"ID":"5f555e04-0ee8-4422-bbb3-1e5ce16f3202","Type":"ContainerStarted","Data":"701792d4a87929e48b3589bb3c85c09412511c28db1395289d92d5dd54c89d52"}
Jul 16 09:26:11.162804 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:11.162767    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp" event={"ID":"5f555e04-0ee8-4422-bbb3-1e5ce16f3202","Type":"ContainerStarted","Data":"b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668"}
Jul 16 09:26:11.163211 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:11.162879    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:11.181851 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:11.181798    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp" podStartSLOduration=3.524704668 podStartE2EDuration="4.181777669s" totalImagesPullingTime="657.073001ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:26:11.181384208 +0000 UTC m=+1866.733416934" watchObservedRunningTime="2026-07-16 09:26:11.181777669 +0000 UTC m=+1866.733810397"
Jul 16 09:26:13.099439 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.099404    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:13.476010 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.475906    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:13.791096 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.791012    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"]
Jul 16 09:26:13.796044 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.796012    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.799019 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.798988    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-cfc611-openshift-default-dockercfg-4qbgg\""
Jul 16 09:26:13.806142 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.805707    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"]
Jul 16 09:26:13.826871 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.826829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-credential-socket\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.826871 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.826872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbztx\" (UniqueName: \"kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-kube-api-access-dbztx\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.827180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.826894    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-socket\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.827180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.826911    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b352bffb-65d7-4cc3-91f1-78878446b4eb-istiod-ca-cert\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.827180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.826977    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-token\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.827180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.826998    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-certs\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.827180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.827014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-data\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.827180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.827082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-envoy\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.827180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.827144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-podinfo\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.829576 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.829501    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:13.928316 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928283    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-certs\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.928316 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928318    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-data\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.928610 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-envoy\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.928610 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928380    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-podinfo\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.928610 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-credential-socket\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.928610 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbztx\" (UniqueName: \"kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-kube-api-access-dbztx\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.928610 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928511    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-socket\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.928610 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928554    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b352bffb-65d7-4cc3-91f1-78878446b4eb-istiod-ca-cert\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.928922 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928635    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-token\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.928922 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928797    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-data\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.928922 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.928841    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-certs\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.929105 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.929082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-socket\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.929229 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.929183    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-credential-socket\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.929478 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.929459    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b352bffb-65d7-4cc3-91f1-78878446b4eb-istiod-ca-cert\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.931226 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.931207    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-envoy\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.931544 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.931509    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-podinfo\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.937404 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.937371    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-token\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:13.937545 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:13.937514    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbztx\" (UniqueName: \"kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-kube-api-access-dbztx\") pod \"e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") " pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:14.111508 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:14.111468    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:14.263264 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:14.263232    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"]
Jul 16 09:26:14.264797 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:26:14.264770    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb352bffb_65d7_4cc3_91f1_78878446b4eb.slice/crio-2af7fe011bc01c89560e7c642840ee9ed26ae22a3485ad8a68d682f415517f4a WatchSource:0}: Error finding container 2af7fe011bc01c89560e7c642840ee9ed26ae22a3485ad8a68d682f415517f4a: Status 404 returned error can't find the container with id 2af7fe011bc01c89560e7c642840ee9ed26ae22a3485ad8a68d682f415517f4a
Jul 16 09:26:14.267206 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:14.267173    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:26:14.267364 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:14.267253    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:26:14.267364 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:14.267303    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:26:14.592677 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:14.592641    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:15.190224 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:15.190185    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" event={"ID":"b352bffb-65d7-4cc3-91f1-78878446b4eb","Type":"ContainerStarted","Data":"6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89"}
Jul 16 09:26:15.190695 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:15.190246    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" event={"ID":"b352bffb-65d7-4cc3-91f1-78878446b4eb","Type":"ContainerStarted","Data":"2af7fe011bc01c89560e7c642840ee9ed26ae22a3485ad8a68d682f415517f4a"}
Jul 16 09:26:15.211800 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:15.211750    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" podStartSLOduration=2.211732993 podStartE2EDuration="2.211732993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:26:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:26:15.209877859 +0000 UTC m=+1870.761910597" watchObservedRunningTime="2026-07-16 09:26:15.211732993 +0000 UTC m=+1870.763765776"
Jul 16 09:26:16.112400 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.112364    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:16.117864 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.117836    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:16.165419 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.165301    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:16.197438 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.197393    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:16.198402 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.198384    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:16.234790 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.234751    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:16.358108 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.358071    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"]
Jul 16 09:26:16.363193 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.363090    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:16.365338 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.365310    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-cfc611-serving-cert\""
Jul 16 09:26:16.372489 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.372455    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"]
Jul 16 09:26:16.414615 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.414576    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:16.453758 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.453725    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:16.453758 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.453761    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5j6h\" (UniqueName: \"kubernetes.io/projected/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-kube-api-access-f5j6h\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:16.453948 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.453808    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:16.555050 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.555010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:16.555050 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.555052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5j6h\" (UniqueName: \"kubernetes.io/projected/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-kube-api-access-f5j6h\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:16.555287 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.555078    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:16.555287 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:26:16.555252    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-serving-cert: secret "maas-api-e2e-inf-b-cfc611-serving-cert" not found
Jul 16 09:26:16.555364 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:26:16.555328    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls podName:e56c58cf-1b8c-442d-8cbe-74be8693c8e0 nodeName:}" failed. No retries permitted until 2026-07-16 09:26:17.05530613 +0000 UTC m=+1872.607338849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls") pod "maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj" (UID: "e56c58cf-1b8c-442d-8cbe-74be8693c8e0") : secret "maas-api-e2e-inf-b-cfc611-serving-cert" not found
Jul 16 09:26:16.555748 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.555727    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:16.563689 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.563671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5j6h\" (UniqueName: \"kubernetes.io/projected/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-kube-api-access-f5j6h\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:16.937342 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:16.937296    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:17.039546 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:17.039496    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:17.060836 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:17.060792    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:17.061027 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:26:17.060942    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-serving-cert: secret "maas-api-e2e-inf-b-cfc611-serving-cert" not found
Jul 16 09:26:17.061027 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:26:17.061010    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls podName:e56c58cf-1b8c-442d-8cbe-74be8693c8e0 nodeName:}" failed. No retries permitted until 2026-07-16 09:26:18.060994895 +0000 UTC m=+1873.613027599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls") pod "maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj" (UID: "e56c58cf-1b8c-442d-8cbe-74be8693c8e0") : secret "maas-api-e2e-inf-b-cfc611-serving-cert" not found
Jul 16 09:26:17.176804 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:17.176771    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:26:17.281101 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:17.281007    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:18.070361 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:18.070317    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:18.072912 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:18.072888    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls\") pod \"maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:18.178746 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:18.178700    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:18.323272 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:18.323233    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"]
Jul 16 09:26:18.324634 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:26:18.324592    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode56c58cf_1b8c_442d_8cbe_74be8693c8e0.slice/crio-da378a4acdcd09948028911f69d76e0c12b6bc04c4fd412266dfd207ed125657 WatchSource:0}: Error finding container da378a4acdcd09948028911f69d76e0c12b6bc04c4fd412266dfd207ed125657: Status 404 returned error can't find the container with id da378a4acdcd09948028911f69d76e0c12b6bc04c4fd412266dfd207ed125657
Jul 16 09:26:19.216711 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:19.216670    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj" event={"ID":"e56c58cf-1b8c-442d-8cbe-74be8693c8e0","Type":"ContainerStarted","Data":"a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c"}
Jul 16 09:26:19.216900 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:19.216729    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj" event={"ID":"e56c58cf-1b8c-442d-8cbe-74be8693c8e0","Type":"ContainerStarted","Data":"da378a4acdcd09948028911f69d76e0c12b6bc04c4fd412266dfd207ed125657"}
Jul 16 09:26:19.216900 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:19.216755    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:19.234216 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:19.234164    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj" podStartSLOduration=2.844282002 podStartE2EDuration="3.234147549s" totalImagesPullingTime="389.865547ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:26:19.233262662 +0000 UTC m=+1874.785295388" watchObservedRunningTime="2026-07-16 09:26:19.234147549 +0000 UTC m=+1874.786180274"
Jul 16 09:26:21.705948 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:21.705907    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:25.227790 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:25.227759    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:26:29.134438 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:29.134395    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:29.233050 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:29.233008    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:30.274872 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:30.274766    2570 generic.go:356] "Generic (PLEG): container finished" podID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerID="6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89" exitCode=0
Jul 16 09:26:30.274872 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:30.274843    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" event={"ID":"b352bffb-65d7-4cc3-91f1-78878446b4eb","Type":"ContainerDied","Data":"6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89"}
Jul 16 09:26:30.275492 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:30.275372    2570 scope.go:117] "RemoveContainer" containerID="6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89"
Jul 16 09:26:30.276435 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:30.276411    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:26:30.276502 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:30.276477    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:26:30.276576 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:30.276508    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:26:31.197831 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:31.197790    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:31.281940 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:31.281901    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" event={"ID":"b352bffb-65d7-4cc3-91f1-78878446b4eb","Type":"ContainerStarted","Data":"7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690"}
Jul 16 09:26:32.112608 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:32.112557    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:32.114208 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:32.114168    2570 patch_prober.go:28] interesting pod/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 16 09:26:32.114364 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:32.114238    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 16 09:26:33.112777 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:33.112730    2570 patch_prober.go:28] interesting pod/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 16 09:26:33.113420 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:33.113383    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 16 09:26:34.112999 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:34.112956    2570 patch_prober.go:28] interesting pod/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 16 09:26:34.113546 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:34.113046    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 16 09:26:35.112401 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:35.112348    2570 patch_prober.go:28] interesting pod/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 16 09:26:35.112636 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:35.112422    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 16 09:26:36.116208 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:36.116170    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:36.116660 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:36.116454    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:36.117071 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:36.117054    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:26:38.851745 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:38.851700    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:38.952154 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:38.952121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:55.311480 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:26:55.311425    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:27:22.280224 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:27:22.280171    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:27:41.265663 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:27:41.265624    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:27:42.301012 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:27:42.300973    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:27:42.803464 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:27:42.803427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:27:47.880761 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:27:47.880719    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:27:59.080505 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:27:59.080388    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:24.223461 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.223424    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"]
Jul 16 09:28:24.223902 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.223711    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp" podUID="5f555e04-0ee8-4422-bbb3-1e5ce16f3202" containerName="maas-api" containerID="cri-o://b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668" gracePeriod=30
Jul 16 09:28:24.252025 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.251992    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:24.483431 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.483366    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:28:24.625289 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.625254    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls\") pod \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") "
Jul 16 09:28:24.625289 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.625293    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqvmp\" (UniqueName: \"kubernetes.io/projected/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-kube-api-access-hqvmp\") pod \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") "
Jul 16 09:28:24.625581 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.625361    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-openshift-service-ca\") pod \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\" (UID: \"5f555e04-0ee8-4422-bbb3-1e5ce16f3202\") "
Jul 16 09:28:24.625797 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.625771    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f555e04-0ee8-4422-bbb3-1e5ce16f3202" (UID: "5f555e04-0ee8-4422-bbb3-1e5ce16f3202"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:28:24.627464 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.627440    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f555e04-0ee8-4422-bbb3-1e5ce16f3202" (UID: "5f555e04-0ee8-4422-bbb3-1e5ce16f3202"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:28:24.627624 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.627600    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-kube-api-access-hqvmp" (OuterVolumeSpecName: "kube-api-access-hqvmp") pod "5f555e04-0ee8-4422-bbb3-1e5ce16f3202" (UID: "5f555e04-0ee8-4422-bbb3-1e5ce16f3202"). InnerVolumeSpecName "kube-api-access-hqvmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:28:24.726861 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.726828    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-openshift-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:24.726861 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.726856    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-maas-api-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:24.726861 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.726867    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqvmp\" (UniqueName: \"kubernetes.io/projected/5f555e04-0ee8-4422-bbb3-1e5ce16f3202-kube-api-access-hqvmp\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:24.899146 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.899099    2570 generic.go:356] "Generic (PLEG): container finished" podID="5f555e04-0ee8-4422-bbb3-1e5ce16f3202" containerID="b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668" exitCode=0
Jul 16 09:28:24.899341 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.899202    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"
Jul 16 09:28:24.899341 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.899263    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp" event={"ID":"5f555e04-0ee8-4422-bbb3-1e5ce16f3202","Type":"ContainerDied","Data":"b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668"}
Jul 16 09:28:24.899496 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.899471    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp" event={"ID":"5f555e04-0ee8-4422-bbb3-1e5ce16f3202","Type":"ContainerDied","Data":"701792d4a87929e48b3589bb3c85c09412511c28db1395289d92d5dd54c89d52"}
Jul 16 09:28:24.899671 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.899510    2570 scope.go:117] "RemoveContainer" containerID="b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668"
Jul 16 09:28:24.910274 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.910249    2570 scope.go:117] "RemoveContainer" containerID="b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668"
Jul 16 09:28:24.910604 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:28:24.910567    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668\": container with ID starting with b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668 not found: ID does not exist" containerID="b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668"
Jul 16 09:28:24.910604 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.910593    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668"} err="failed to get container status \"b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668\": rpc error: code = NotFound desc = could not find container \"b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668\": container with ID starting with b3f2b23ebcf9da247cf2f7fe388ba595c8069c1b67a2c7a410c364378ea0e668 not found: ID does not exist"
Jul 16 09:28:24.924522 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.924492    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"]
Jul 16 09:28:24.930278 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.930250    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00d870-ccd866b94-2lkrp"]
Jul 16 09:28:24.933447 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.933422    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:24.972800 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:24.972767    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f555e04-0ee8-4422-bbb3-1e5ce16f3202" path="/var/lib/kubelet/pods/5f555e04-0ee8-4422-bbb3-1e5ce16f3202/volumes"
Jul 16 09:28:30.877202 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:30.877165    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:30.959443 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:30.959397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:31.212207 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:31.212114    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:31.474740 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:31.474656    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:32.013203 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:32.013166    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:38.138267 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.138236    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"]
Jul 16 09:28:38.138688 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.138563    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj" podUID="e56c58cf-1b8c-442d-8cbe-74be8693c8e0" containerName="maas-api" containerID="cri-o://a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c" gracePeriod=30
Jul 16 09:28:38.173950 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.173917    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:38.404029 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.403967    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:28:38.468244 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.468212    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-openshift-service-ca\") pod \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") "
Jul 16 09:28:38.468437 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.468287    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls\") pod \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") "
Jul 16 09:28:38.468437 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.468318    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5j6h\" (UniqueName: \"kubernetes.io/projected/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-kube-api-access-f5j6h\") pod \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\" (UID: \"e56c58cf-1b8c-442d-8cbe-74be8693c8e0\") "
Jul 16 09:28:38.468629 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.468603    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e56c58cf-1b8c-442d-8cbe-74be8693c8e0" (UID: "e56c58cf-1b8c-442d-8cbe-74be8693c8e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:28:38.470398 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.470376    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e56c58cf-1b8c-442d-8cbe-74be8693c8e0" (UID: "e56c58cf-1b8c-442d-8cbe-74be8693c8e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:28:38.470398 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.470384    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-kube-api-access-f5j6h" (OuterVolumeSpecName: "kube-api-access-f5j6h") pod "e56c58cf-1b8c-442d-8cbe-74be8693c8e0" (UID: "e56c58cf-1b8c-442d-8cbe-74be8693c8e0"). InnerVolumeSpecName "kube-api-access-f5j6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:28:38.569117 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.569080    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-openshift-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:38.569117 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.569113    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-maas-api-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:38.569117 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.569123    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5j6h\" (UniqueName: \"kubernetes.io/projected/e56c58cf-1b8c-442d-8cbe-74be8693c8e0-kube-api-access-f5j6h\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:38.977148 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.977110    2570 generic.go:356] "Generic (PLEG): container finished" podID="e56c58cf-1b8c-442d-8cbe-74be8693c8e0" containerID="a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c" exitCode=0
Jul 16 09:28:38.977148 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.977152    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"
Jul 16 09:28:38.977415 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.977174    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj" event={"ID":"e56c58cf-1b8c-442d-8cbe-74be8693c8e0","Type":"ContainerDied","Data":"a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c"}
Jul 16 09:28:38.977415 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.977214    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj" event={"ID":"e56c58cf-1b8c-442d-8cbe-74be8693c8e0","Type":"ContainerDied","Data":"da378a4acdcd09948028911f69d76e0c12b6bc04c4fd412266dfd207ed125657"}
Jul 16 09:28:38.977415 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.977234    2570 scope.go:117] "RemoveContainer" containerID="a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c"
Jul 16 09:28:38.987249 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.987227    2570 scope.go:117] "RemoveContainer" containerID="a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c"
Jul 16 09:28:38.987525 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:28:38.987503    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c\": container with ID starting with a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c not found: ID does not exist" containerID="a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c"
Jul 16 09:28:38.987603 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:38.987585    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c"} err="failed to get container status \"a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c\": rpc error: code = NotFound desc = could not find container \"a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c\": container with ID starting with a1e749f7b748aac67ff10fa0b9f15eb772a6c1b4df1d059e5c882b86fd7d9a6c not found: ID does not exist"
Jul 16 09:28:39.008004 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:39.007972    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"]
Jul 16 09:28:39.021556 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:39.021517    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cfc611-bc46d7464-ddfpj"]
Jul 16 09:28:39.083475 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:39.083444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:40.972651 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:40.972617    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e56c58cf-1b8c-442d-8cbe-74be8693c8e0" path="/var/lib/kubelet/pods/e56c58cf-1b8c-442d-8cbe-74be8693c8e0/volumes"
Jul 16 09:28:45.092390 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:45.092352    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:45.193205 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:45.193169    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:45.402758 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:45.402669    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"]
Jul 16 09:28:45.402946 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:45.402919    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy" containerID="cri-o://7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690" gracePeriod=30
Jul 16 09:28:45.429616 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:45.429561    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:45.671064 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:45.670960    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:46.047492 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:46.047394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:46.401155 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:46.401110    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:46.880458 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:46.880414    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:48.349148 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.349099    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:48.452580 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.452523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:48.487555 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.487044    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"]
Jul 16 09:28:48.488517 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.488489    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f555e04-0ee8-4422-bbb3-1e5ce16f3202" containerName="maas-api"
Jul 16 09:28:48.488682 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.488668    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f555e04-0ee8-4422-bbb3-1e5ce16f3202" containerName="maas-api"
Jul 16 09:28:48.488780 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.488769    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e56c58cf-1b8c-442d-8cbe-74be8693c8e0" containerName="maas-api"
Jul 16 09:28:48.488853 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.488844    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e56c58cf-1b8c-442d-8cbe-74be8693c8e0" containerName="maas-api"
Jul 16 09:28:48.489152 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.489135    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f555e04-0ee8-4422-bbb3-1e5ce16f3202" containerName="maas-api"
Jul 16 09:28:48.489257 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.489247    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e56c58cf-1b8c-442d-8cbe-74be8693c8e0" containerName="maas-api"
Jul 16 09:28:48.495291 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.495218    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:48.498753 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.498730    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-6b0aee-serving-cert\""
Jul 16 09:28:48.502239 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.502210    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"]
Jul 16 09:28:48.551119 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.551075    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:48.561212 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.561155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-openshift-service-ca\") pod \"maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:48.561212 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.561225    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-maas-api-tls\") pod \"maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:48.561440 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.561275    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzw9\" (UniqueName: \"kubernetes.io/projected/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-kube-api-access-gzzw9\") pod \"maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:48.645008 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.644915    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:48.662837 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.662805    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzzw9\" (UniqueName: \"kubernetes.io/projected/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-kube-api-access-gzzw9\") pod \"maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:48.662986 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.662949    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-openshift-service-ca\") pod \"maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:48.663036 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.662999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-maas-api-tls\") pod \"maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:48.663735 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.663713    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-openshift-service-ca\") pod \"maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:48.665486 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.665466    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-maas-api-tls\") pod \"maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:48.674083 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.674058    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzzw9\" (UniqueName: \"kubernetes.io/projected/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-kube-api-access-gzzw9\") pod \"maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:48.811848 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:48.811813    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:49.173885 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:49.173854    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"]
Jul 16 09:28:49.175561 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:28:49.175519    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dea4f00_2073_4ca3_a94b_b6b460fb2c73.slice/crio-ef50fd8aaa6c6c9b53fe984928f0caecafa186a4381fb5bacaf2ef1271a9dde8 WatchSource:0}: Error finding container ef50fd8aaa6c6c9b53fe984928f0caecafa186a4381fb5bacaf2ef1271a9dde8: Status 404 returned error can't find the container with id ef50fd8aaa6c6c9b53fe984928f0caecafa186a4381fb5bacaf2ef1271a9dde8
Jul 16 09:28:49.176931 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:49.176910    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:28:49.180967 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:49.180934    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:49.262579 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:49.262512    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:50.037356 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.037241    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl" event={"ID":"7dea4f00-2073-4ca3-a94b-b6b460fb2c73","Type":"ContainerStarted","Data":"b5cf16978a507c7fe0eda84d5afefc929d3ed53a86f6e4c7856ec3661eeaa842"}
Jul 16 09:28:50.037356 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.037315    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:50.037356 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.037339    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl" event={"ID":"7dea4f00-2073-4ca3-a94b-b6b460fb2c73","Type":"ContainerStarted","Data":"ef50fd8aaa6c6c9b53fe984928f0caecafa186a4381fb5bacaf2ef1271a9dde8"}
Jul 16 09:28:50.055767 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.055713    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl" podStartSLOduration=1.477827857 podStartE2EDuration="2.05569451s" totalImagesPullingTime="577.866653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:28:50.055600439 +0000 UTC m=+2025.607633165" watchObservedRunningTime="2026-07-16 09:28:50.05569451 +0000 UTC m=+2025.607727240"
Jul 16 09:28:50.669721 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.669658    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:28:50.786104 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786072    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbztx\" (UniqueName: \"kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-kube-api-access-dbztx\") pod \"b352bffb-65d7-4cc3-91f1-78878446b4eb\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") "
Jul 16 09:28:50.786104 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786110    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-envoy\") pod \"b352bffb-65d7-4cc3-91f1-78878446b4eb\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") "
Jul 16 09:28:50.786380 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786137    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-certs\") pod \"b352bffb-65d7-4cc3-91f1-78878446b4eb\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") "
Jul 16 09:28:50.786380 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786262    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-podinfo\") pod \"b352bffb-65d7-4cc3-91f1-78878446b4eb\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") "
Jul 16 09:28:50.786380 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786318    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-data\") pod \"b352bffb-65d7-4cc3-91f1-78878446b4eb\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") "
Jul 16 09:28:50.786380 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786368    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b352bffb-65d7-4cc3-91f1-78878446b4eb-istiod-ca-cert\") pod \"b352bffb-65d7-4cc3-91f1-78878446b4eb\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") "
Jul 16 09:28:50.786643 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786399    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-credential-socket\") pod \"b352bffb-65d7-4cc3-91f1-78878446b4eb\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") "
Jul 16 09:28:50.786643 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786463    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-socket\") pod \"b352bffb-65d7-4cc3-91f1-78878446b4eb\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") "
Jul 16 09:28:50.786643 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786560    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-token\") pod \"b352bffb-65d7-4cc3-91f1-78878446b4eb\" (UID: \"b352bffb-65d7-4cc3-91f1-78878446b4eb\") "
Jul 16 09:28:50.786788 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786708    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b352bffb-65d7-4cc3-91f1-78878446b4eb" (UID: "b352bffb-65d7-4cc3-91f1-78878446b4eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:28:50.787258 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.786986    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:50.787258 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.787090    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b352bffb-65d7-4cc3-91f1-78878446b4eb" (UID: "b352bffb-65d7-4cc3-91f1-78878446b4eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:28:50.787258 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.787222    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b352bffb-65d7-4cc3-91f1-78878446b4eb" (UID: "b352bffb-65d7-4cc3-91f1-78878446b4eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:28:50.787514 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.787315    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "b352bffb-65d7-4cc3-91f1-78878446b4eb" (UID: "b352bffb-65d7-4cc3-91f1-78878446b4eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:28:50.787962 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.787932    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b352bffb-65d7-4cc3-91f1-78878446b4eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b352bffb-65d7-4cc3-91f1-78878446b4eb" (UID: "b352bffb-65d7-4cc3-91f1-78878446b4eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:28:50.788514 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.788491    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b352bffb-65d7-4cc3-91f1-78878446b4eb" (UID: "b352bffb-65d7-4cc3-91f1-78878446b4eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:28:50.788514 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.788502    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b352bffb-65d7-4cc3-91f1-78878446b4eb" (UID: "b352bffb-65d7-4cc3-91f1-78878446b4eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:28:50.788658 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.788604    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-kube-api-access-dbztx" (OuterVolumeSpecName: "kube-api-access-dbztx") pod "b352bffb-65d7-4cc3-91f1-78878446b4eb" (UID: "b352bffb-65d7-4cc3-91f1-78878446b4eb"). InnerVolumeSpecName "kube-api-access-dbztx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:28:50.788900 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.788884    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "b352bffb-65d7-4cc3-91f1-78878446b4eb" (UID: "b352bffb-65d7-4cc3-91f1-78878446b4eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:28:50.887948 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.887917    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:50.887948 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.887945    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b352bffb-65d7-4cc3-91f1-78878446b4eb-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:50.887948 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.887955    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:50.888170 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.887964    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:50.888170 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.887974    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbztx\" (UniqueName: \"kubernetes.io/projected/b352bffb-65d7-4cc3-91f1-78878446b4eb-kube-api-access-dbztx\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:50.888170 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.887984    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:50.888170 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.887992    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b352bffb-65d7-4cc3-91f1-78878446b4eb-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:50.888170 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:50.887999    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b352bffb-65d7-4cc3-91f1-78878446b4eb-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:28:51.044147 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.044112    2570 generic.go:356] "Generic (PLEG): container finished" podID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerID="7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690" exitCode=0
Jul 16 09:28:51.044566 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.044161    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"
Jul 16 09:28:51.044566 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.044198    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" event={"ID":"b352bffb-65d7-4cc3-91f1-78878446b4eb","Type":"ContainerDied","Data":"7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690"}
Jul 16 09:28:51.044566 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.044261    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26" event={"ID":"b352bffb-65d7-4cc3-91f1-78878446b4eb","Type":"ContainerDied","Data":"2af7fe011bc01c89560e7c642840ee9ed26ae22a3485ad8a68d682f415517f4a"}
Jul 16 09:28:51.044566 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.044277    2570 scope.go:117] "RemoveContainer" containerID="7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690"
Jul 16 09:28:51.053462 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.053446    2570 scope.go:117] "RemoveContainer" containerID="6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89"
Jul 16 09:28:51.061499 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.061484    2570 scope.go:117] "RemoveContainer" containerID="7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690"
Jul 16 09:28:51.061759 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:28:51.061741    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690\": container with ID starting with 7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690 not found: ID does not exist" containerID="7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690"
Jul 16 09:28:51.061808 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.061768    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690"} err="failed to get container status \"7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690\": rpc error: code = NotFound desc = could not find container \"7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690\": container with ID starting with 7846e5e458388c47f358e7e46acc87d0dcda32722ca5ec9d7f95aead755a0690 not found: ID does not exist"
Jul 16 09:28:51.061808 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.061784    2570 scope.go:117] "RemoveContainer" containerID="6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89"
Jul 16 09:28:51.061978 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:28:51.061962    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89\": container with ID starting with 6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89 not found: ID does not exist" containerID="6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89"
Jul 16 09:28:51.062015 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.061982    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89"} err="failed to get container status \"6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89\": rpc error: code = NotFound desc = could not find container \"6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89\": container with ID starting with 6cc37671a68ca69b652a2193c02bb1e251af507bd4026ad572deaf74e0d50d89 not found: ID does not exist"
Jul 16 09:28:51.066097 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.066072    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"]
Jul 16 09:28:51.071513 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:51.071490    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-cfc611-openshift-default-c9f686459-qsj26"]
Jul 16 09:28:52.973235 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:52.973198    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" path="/var/lib/kubelet/pods/b352bffb-65d7-4cc3-91f1-78878446b4eb/volumes"
Jul 16 09:28:53.895858 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:53.895820    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:54.426959 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.426910    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:54.696696 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.696607    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"]
Jul 16 09:28:54.697180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.697158    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy"
Jul 16 09:28:54.697180 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.697181    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy"
Jul 16 09:28:54.697343 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.697200    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy"
Jul 16 09:28:54.697343 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.697207    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy"
Jul 16 09:28:54.697343 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.697323    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy"
Jul 16 09:28:54.697343 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.697341    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b352bffb-65d7-4cc3-91f1-78878446b4eb" containerName="istio-proxy"
Jul 16 09:28:54.702148 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.702126    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.704914 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.704889    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-357950-openshift-default-dockercfg-vj7r8\""
Jul 16 09:28:54.716314 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.716287    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"]
Jul 16 09:28:54.740861 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.740824    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:54.828243 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.828182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-certs\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.828653 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.828630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-data\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.828800 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.828786    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-token\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.828910 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.828897    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-podinfo\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.829037 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.829009    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lfpr\" (UniqueName: \"kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-kube-api-access-8lfpr\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.829175 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.829057    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-credential-socket\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.829175 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.829087    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-socket\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.829305 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.829183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-envoy\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.829305 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.829242    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istiod-ca-cert\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.930512 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.930469    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-certs\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.930716 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.930525    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-data\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.930716 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.930585    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-token\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.930716 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.930611    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-podinfo\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.930716 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.930644    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lfpr\" (UniqueName: \"kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-kube-api-access-8lfpr\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.930716 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.930678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-credential-socket\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.930716 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.930704    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-socket\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.931074 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.930745    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-envoy\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.931074 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.930772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istiod-ca-cert\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.931074 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.930960    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-certs\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.931240 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.931172    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-data\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.931240 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.931222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-credential-socket\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.931341 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.931296    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-socket\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.931563 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.931511    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istiod-ca-cert\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.933043 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.933021    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-envoy\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.933194 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.933176    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-podinfo\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.942711 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.942684    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-token\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:54.942888 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:54.942868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lfpr\" (UniqueName: \"kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-kube-api-access-8lfpr\") pod \"e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") " pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:55.013719 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:55.013615    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:55.165467 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:55.165397    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"]
Jul 16 09:28:55.168862 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:28:55.168835    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b31e0f9_00a2_4283_aa33_201d0f63ef6e.slice/crio-91b048dc438a57f0033b2ea0ca15395aaa1b63acd71ff5f7d96ce1ec55273585 WatchSource:0}: Error finding container 91b048dc438a57f0033b2ea0ca15395aaa1b63acd71ff5f7d96ce1ec55273585: Status 404 returned error can't find the container with id 91b048dc438a57f0033b2ea0ca15395aaa1b63acd71ff5f7d96ce1ec55273585
Jul 16 09:28:55.170880 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:55.170850    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:28:55.170959 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:55.170913    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:28:55.170959 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:55.170944    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:28:55.199593 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:55.199559    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:56.050705 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:56.050671    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:28:56.077465 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:56.077428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" event={"ID":"1b31e0f9-00a2-4283-aa33-201d0f63ef6e","Type":"ContainerStarted","Data":"264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342"}
Jul 16 09:28:56.077666 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:56.077488    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" event={"ID":"1b31e0f9-00a2-4283-aa33-201d0f63ef6e","Type":"ContainerStarted","Data":"91b048dc438a57f0033b2ea0ca15395aaa1b63acd71ff5f7d96ce1ec55273585"}
Jul 16 09:28:56.099947 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:56.099897    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" podStartSLOduration=2.099878868 podStartE2EDuration="2.099878868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:28:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:28:56.097931472 +0000 UTC m=+2031.649964200" watchObservedRunningTime="2026-07-16 09:28:56.099878868 +0000 UTC m=+2031.651911594"
Jul 16 09:28:57.014592 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.014556    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:57.020717 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.020685    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:57.083985 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.083947    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:57.085107 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.085085    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:57.086162 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.086140    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:28:57.182865 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.182821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:57.260389 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.260354    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"]
Jul 16 09:28:57.264325 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.264300    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:57.266865 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.266790    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-357950-serving-cert\""
Jul 16 09:28:57.275327 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.275301    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"]
Jul 16 09:28:57.296573 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.296517    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:57.354537 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.354489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84hm4\" (UniqueName: \"kubernetes.io/projected/c57b34ab-ed35-4025-8b4c-324311e63a56-kube-api-access-84hm4\") pod \"maas-api-e2e-api-b-357950-5bb9bf666b-df4mx\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:57.354718 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.354589    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c57b34ab-ed35-4025-8b4c-324311e63a56-openshift-service-ca\") pod \"maas-api-e2e-api-b-357950-5bb9bf666b-df4mx\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:57.354718 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.354679    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c57b34ab-ed35-4025-8b4c-324311e63a56-maas-api-tls\") pod \"maas-api-e2e-api-b-357950-5bb9bf666b-df4mx\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:57.455854 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.455812    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c57b34ab-ed35-4025-8b4c-324311e63a56-openshift-service-ca\") pod \"maas-api-e2e-api-b-357950-5bb9bf666b-df4mx\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:57.456063 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.455878    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c57b34ab-ed35-4025-8b4c-324311e63a56-maas-api-tls\") pod \"maas-api-e2e-api-b-357950-5bb9bf666b-df4mx\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:57.456063 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.455948    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84hm4\" (UniqueName: \"kubernetes.io/projected/c57b34ab-ed35-4025-8b4c-324311e63a56-kube-api-access-84hm4\") pod \"maas-api-e2e-api-b-357950-5bb9bf666b-df4mx\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:57.456184 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:28:57.456054    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-357950-serving-cert: secret "maas-api-e2e-api-b-357950-serving-cert" not found
Jul 16 09:28:57.456184 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:28:57.456127    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c57b34ab-ed35-4025-8b4c-324311e63a56-maas-api-tls podName:c57b34ab-ed35-4025-8b4c-324311e63a56 nodeName:}" failed. No retries permitted until 2026-07-16 09:28:57.956105714 +0000 UTC m=+2033.508138431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c57b34ab-ed35-4025-8b4c-324311e63a56-maas-api-tls") pod "maas-api-e2e-api-b-357950-5bb9bf666b-df4mx" (UID: "c57b34ab-ed35-4025-8b4c-324311e63a56") : secret "maas-api-e2e-api-b-357950-serving-cert" not found
Jul 16 09:28:57.456617 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.456593    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c57b34ab-ed35-4025-8b4c-324311e63a56-openshift-service-ca\") pod \"maas-api-e2e-api-b-357950-5bb9bf666b-df4mx\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:57.465235 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.465211    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84hm4\" (UniqueName: \"kubernetes.io/projected/c57b34ab-ed35-4025-8b4c-324311e63a56-kube-api-access-84hm4\") pod \"maas-api-e2e-api-b-357950-5bb9bf666b-df4mx\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:57.729109 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.729060    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:57.831176 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.831139    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:57.936918 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.936876    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:57.960185 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.960143    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c57b34ab-ed35-4025-8b4c-324311e63a56-maas-api-tls\") pod \"maas-api-e2e-api-b-357950-5bb9bf666b-df4mx\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:57.962954 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:57.962929    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c57b34ab-ed35-4025-8b4c-324311e63a56-maas-api-tls\") pod \"maas-api-e2e-api-b-357950-5bb9bf666b-df4mx\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:58.179828 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:58.179797    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:28:58.326074 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:58.326042    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"]
Jul 16 09:28:58.328517 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:28:58.328485    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57b34ab_ed35_4025_8b4c_324311e63a56.slice/crio-e98fac88d0f250a84565d103fcca6d734d99030ac65d6c3bed1fb70cfc68e903 WatchSource:0}: Error finding container e98fac88d0f250a84565d103fcca6d734d99030ac65d6c3bed1fb70cfc68e903: Status 404 returned error can't find the container with id e98fac88d0f250a84565d103fcca6d734d99030ac65d6c3bed1fb70cfc68e903
Jul 16 09:28:59.097226 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:59.097120    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx" event={"ID":"c57b34ab-ed35-4025-8b4c-324311e63a56","Type":"ContainerStarted","Data":"00a08cfb9e13039d1509a3773ee544ed3445c4420eb4c1d65e2932643fb59e60"}
Jul 16 09:28:59.097226 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:28:59.097184    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx" event={"ID":"c57b34ab-ed35-4025-8b4c-324311e63a56","Type":"ContainerStarted","Data":"e98fac88d0f250a84565d103fcca6d734d99030ac65d6c3bed1fb70cfc68e903"}
Jul 16 09:29:00.102504 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:00.102473    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:29:02.640111 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:02.640073    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:06.113373 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:06.113342    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:29:06.130318 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:06.130266    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx" podStartSLOduration=8.726979169 podStartE2EDuration="9.130247779s" totalImagesPullingTime="403.26861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:28:59.125600781 +0000 UTC m=+2034.677633507" watchObservedRunningTime="2026-07-16 09:29:06.130247779 +0000 UTC m=+2041.682280506"
Jul 16 09:29:11.088632 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:11.088594    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:11.189764 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:11.189720    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:11.326185 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:11.326147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:13.126751 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:13.126704    2570 patch_prober.go:28] interesting pod/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 09:29:13.127162 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:13.126767    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 09:29:15.188034 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:15.187931    2570 generic.go:356] "Generic (PLEG): container finished" podID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerID="264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342" exitCode=0
Jul 16 09:29:15.188441 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:15.188020    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" event={"ID":"1b31e0f9-00a2-4283-aa33-201d0f63ef6e","Type":"ContainerDied","Data":"264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342"}
Jul 16 09:29:15.188441 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:15.188424    2570 scope.go:117] "RemoveContainer" containerID="264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342"
Jul 16 09:29:15.189466 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:15.189436    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:29:15.189603 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:15.189520    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:29:15.189603 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:15.189595    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:29:15.954232 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:15.954157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:16.195859 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:16.195826    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" event={"ID":"1b31e0f9-00a2-4283-aa33-201d0f63ef6e","Type":"ContainerStarted","Data":"fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9"}
Jul 16 09:29:16.922556 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:16.918453    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"]
Jul 16 09:29:16.933633 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:16.932879    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl" podUID="7dea4f00-2073-4ca3-a94b-b6b460fb2c73" containerName="maas-api" containerID="cri-o://b5cf16978a507c7fe0eda84d5afefc929d3ed53a86f6e4c7856ec3661eeaa842" gracePeriod=30
Jul 16 09:29:16.935201 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:16.935167    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:17.014342 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.014288    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:29:17.014772 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.014742    2570 patch_prober.go:28] interesting pod/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 16 09:29:17.014992 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.014963    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 16 09:29:17.222602 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.222567    2570 generic.go:356] "Generic (PLEG): container finished" podID="7dea4f00-2073-4ca3-a94b-b6b460fb2c73" containerID="b5cf16978a507c7fe0eda84d5afefc929d3ed53a86f6e4c7856ec3661eeaa842" exitCode=0
Jul 16 09:29:17.222602 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.222605    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl" event={"ID":"7dea4f00-2073-4ca3-a94b-b6b460fb2c73","Type":"ContainerDied","Data":"b5cf16978a507c7fe0eda84d5afefc929d3ed53a86f6e4c7856ec3661eeaa842"}
Jul 16 09:29:17.223033 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.222664    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl" event={"ID":"7dea4f00-2073-4ca3-a94b-b6b460fb2c73","Type":"ContainerDied","Data":"ef50fd8aaa6c6c9b53fe984928f0caecafa186a4381fb5bacaf2ef1271a9dde8"}
Jul 16 09:29:17.223033 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.222691    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef50fd8aaa6c6c9b53fe984928f0caecafa186a4381fb5bacaf2ef1271a9dde8"
Jul 16 09:29:17.225806 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.225786    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:29:17.242974 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.242945    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-openshift-service-ca\") pod \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") "
Jul 16 09:29:17.243321 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.243293    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7dea4f00-2073-4ca3-a94b-b6b460fb2c73" (UID: "7dea4f00-2073-4ca3-a94b-b6b460fb2c73"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:29:17.344278 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.344246    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-maas-api-tls\") pod \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") "
Jul 16 09:29:17.344278 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.344280    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzzw9\" (UniqueName: \"kubernetes.io/projected/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-kube-api-access-gzzw9\") pod \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\" (UID: \"7dea4f00-2073-4ca3-a94b-b6b460fb2c73\") "
Jul 16 09:29:17.344506 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.344487    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-openshift-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:17.346293 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.346260    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7dea4f00-2073-4ca3-a94b-b6b460fb2c73" (UID: "7dea4f00-2073-4ca3-a94b-b6b460fb2c73"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:29:17.346423 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.346360    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-kube-api-access-gzzw9" (OuterVolumeSpecName: "kube-api-access-gzzw9") pod "7dea4f00-2073-4ca3-a94b-b6b460fb2c73" (UID: "7dea4f00-2073-4ca3-a94b-b6b460fb2c73"). InnerVolumeSpecName "kube-api-access-gzzw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:29:17.362395 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.362365    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:17.445386 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.445297    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-maas-api-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:17.445386 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:17.445329    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzzw9\" (UniqueName: \"kubernetes.io/projected/7dea4f00-2073-4ca3-a94b-b6b460fb2c73-kube-api-access-gzzw9\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:18.014338 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:18.014285    2570 patch_prober.go:28] interesting pod/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 16 09:29:18.014550 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:18.014361    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 16 09:29:18.227385 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:18.227349    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"
Jul 16 09:29:18.250334 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:18.250305    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"]
Jul 16 09:29:18.254502 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:18.254476    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6b0aee-5d7d86cf49-9wdbl"]
Jul 16 09:29:18.774033 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:18.773988    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:18.870132 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:18.870094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:18.978703 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:18.978671    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dea4f00-2073-4ca3-a94b-b6b460fb2c73" path="/var/lib/kubelet/pods/7dea4f00-2073-4ca3-a94b-b6b460fb2c73/volumes"
Jul 16 09:29:19.014789 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:19.014750    2570 patch_prober.go:28] interesting pod/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 16 09:29:19.015079 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:19.015045    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 16 09:29:20.014170 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:20.014123    2570 patch_prober.go:28] interesting pod/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 16 09:29:20.014701 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:20.014195    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 16 09:29:21.017935 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:21.017901    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:29:21.018428 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:21.018321    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:29:21.018980 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:21.018959    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:29:23.437799 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:23.437761    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:23.565617 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:23.565583    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:23.738957 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:23.738843    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:23.994576 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:23.994467    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:24.509700 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:24.509669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:30.086561 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.086432    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"]
Jul 16 09:29:30.087026 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.086710    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx" podUID="c57b34ab-ed35-4025-8b4c-324311e63a56" containerName="maas-api" containerID="cri-o://00a08cfb9e13039d1509a3773ee544ed3445c4420eb4c1d65e2932643fb59e60" gracePeriod=30
Jul 16 09:29:30.116512 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.116479    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:30.293087 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.293019    2570 generic.go:356] "Generic (PLEG): container finished" podID="c57b34ab-ed35-4025-8b4c-324311e63a56" containerID="00a08cfb9e13039d1509a3773ee544ed3445c4420eb4c1d65e2932643fb59e60" exitCode=0
Jul 16 09:29:30.293266 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.293117    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx" event={"ID":"c57b34ab-ed35-4025-8b4c-324311e63a56","Type":"ContainerDied","Data":"00a08cfb9e13039d1509a3773ee544ed3445c4420eb4c1d65e2932643fb59e60"}
Jul 16 09:29:30.349130 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.349060    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:29:30.442892 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.442854    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:30.469881 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.469851    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c57b34ab-ed35-4025-8b4c-324311e63a56-openshift-service-ca\") pod \"c57b34ab-ed35-4025-8b4c-324311e63a56\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") "
Jul 16 09:29:30.470044 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.469906    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84hm4\" (UniqueName: \"kubernetes.io/projected/c57b34ab-ed35-4025-8b4c-324311e63a56-kube-api-access-84hm4\") pod \"c57b34ab-ed35-4025-8b4c-324311e63a56\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") "
Jul 16 09:29:30.470044 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.470014    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c57b34ab-ed35-4025-8b4c-324311e63a56-maas-api-tls\") pod \"c57b34ab-ed35-4025-8b4c-324311e63a56\" (UID: \"c57b34ab-ed35-4025-8b4c-324311e63a56\") "
Jul 16 09:29:30.470288 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.470263    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57b34ab-ed35-4025-8b4c-324311e63a56-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c57b34ab-ed35-4025-8b4c-324311e63a56" (UID: "c57b34ab-ed35-4025-8b4c-324311e63a56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:29:30.472062 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.472037    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57b34ab-ed35-4025-8b4c-324311e63a56-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c57b34ab-ed35-4025-8b4c-324311e63a56" (UID: "c57b34ab-ed35-4025-8b4c-324311e63a56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:29:30.472137 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.472044    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57b34ab-ed35-4025-8b4c-324311e63a56-kube-api-access-84hm4" (OuterVolumeSpecName: "kube-api-access-84hm4") pod "c57b34ab-ed35-4025-8b4c-324311e63a56" (UID: "c57b34ab-ed35-4025-8b4c-324311e63a56"). InnerVolumeSpecName "kube-api-access-84hm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:29:30.571748 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.571712    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c57b34ab-ed35-4025-8b4c-324311e63a56-maas-api-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:30.571748 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.571744    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c57b34ab-ed35-4025-8b4c-324311e63a56-openshift-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:30.571748 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:30.571757    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84hm4\" (UniqueName: \"kubernetes.io/projected/c57b34ab-ed35-4025-8b4c-324311e63a56-kube-api-access-84hm4\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:31.300372 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:31.300280    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx" event={"ID":"c57b34ab-ed35-4025-8b4c-324311e63a56","Type":"ContainerDied","Data":"e98fac88d0f250a84565d103fcca6d734d99030ac65d6c3bed1fb70cfc68e903"}
Jul 16 09:29:31.300372 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:31.300307    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"
Jul 16 09:29:31.300372 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:31.300348    2570 scope.go:117] "RemoveContainer" containerID="00a08cfb9e13039d1509a3773ee544ed3445c4420eb4c1d65e2932643fb59e60"
Jul 16 09:29:31.319621 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:31.319570    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"]
Jul 16 09:29:31.321503 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:31.321481    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-357950-5bb9bf666b-df4mx"]
Jul 16 09:29:32.973216 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:32.973181    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c57b34ab-ed35-4025-8b4c-324311e63a56" path="/var/lib/kubelet/pods/c57b34ab-ed35-4025-8b4c-324311e63a56/volumes"
Jul 16 09:29:36.222921 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:36.222886    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:36.324879 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:36.324840    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:36.491217 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:36.491121    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"]
Jul 16 09:29:36.491413 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:36.491387    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy" containerID="cri-o://fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9" gracePeriod=30
Jul 16 09:29:36.514410 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:36.514376    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:36.755584 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:36.755469    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:37.153191 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:37.153135    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:37.549806 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:37.549690    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:37.675175 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:37.675141    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:39.446827 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.446790    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:39.546487 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.546453    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:39.642282 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.642235    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"]
Jul 16 09:29:39.643569 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.643525    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dea4f00-2073-4ca3-a94b-b6b460fb2c73" containerName="maas-api"
Jul 16 09:29:39.643569 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.643566    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dea4f00-2073-4ca3-a94b-b6b460fb2c73" containerName="maas-api"
Jul 16 09:29:39.643788 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.643606    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57b34ab-ed35-4025-8b4c-324311e63a56" containerName="maas-api"
Jul 16 09:29:39.643788 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.643615    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57b34ab-ed35-4025-8b4c-324311e63a56" containerName="maas-api"
Jul 16 09:29:39.643788 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.643716    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dea4f00-2073-4ca3-a94b-b6b460fb2c73" containerName="maas-api"
Jul 16 09:29:39.643788 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.643727    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57b34ab-ed35-4025-8b4c-324311e63a56" containerName="maas-api"
Jul 16 09:29:39.647252 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.647218    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:39.649827 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.649799    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-923c3a-serving-cert\""
Jul 16 09:29:39.656139 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.655997    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"]
Jul 16 09:29:39.678203 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.678170    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:39.760248 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.760148    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mxf6\" (UniqueName: \"kubernetes.io/projected/a124ee3f-37ac-4341-aac8-aceab7db05f3-kube-api-access-2mxf6\") pod \"maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:39.760248 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.760195    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a124ee3f-37ac-4341-aac8-aceab7db05f3-maas-api-tls\") pod \"maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:39.760248 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.760223    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a124ee3f-37ac-4341-aac8-aceab7db05f3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:39.861597 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.861561    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mxf6\" (UniqueName: \"kubernetes.io/projected/a124ee3f-37ac-4341-aac8-aceab7db05f3-kube-api-access-2mxf6\") pod \"maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:39.861798 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.861607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a124ee3f-37ac-4341-aac8-aceab7db05f3-maas-api-tls\") pod \"maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:39.861798 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.861648    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a124ee3f-37ac-4341-aac8-aceab7db05f3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:39.861798 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:29:39.861772    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-serving-cert: secret "maas-api-e2e-shared-a-923c3a-serving-cert" not found
Jul 16 09:29:39.861956 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:29:39.861842    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a124ee3f-37ac-4341-aac8-aceab7db05f3-maas-api-tls podName:a124ee3f-37ac-4341-aac8-aceab7db05f3 nodeName:}" failed. No retries permitted until 2026-07-16 09:29:40.361827044 +0000 UTC m=+2075.913859752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a124ee3f-37ac-4341-aac8-aceab7db05f3-maas-api-tls") pod "maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd" (UID: "a124ee3f-37ac-4341-aac8-aceab7db05f3") : secret "maas-api-e2e-shared-a-923c3a-serving-cert" not found
Jul 16 09:29:39.862440 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.862415    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a124ee3f-37ac-4341-aac8-aceab7db05f3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:39.870675 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.870645    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mxf6\" (UniqueName: \"kubernetes.io/projected/a124ee3f-37ac-4341-aac8-aceab7db05f3-kube-api-access-2mxf6\") pod \"maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:39.920819 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:39.920783    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:40.156550 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:40.156506    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:40.258406 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:40.258367    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:40.366922 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:40.366885    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a124ee3f-37ac-4341-aac8-aceab7db05f3-maas-api-tls\") pod \"maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:40.369561 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:40.369519    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a124ee3f-37ac-4341-aac8-aceab7db05f3-maas-api-tls\") pod \"maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:40.561512 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:40.561426    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:40.705480 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:40.705451    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"]
Jul 16 09:29:40.708972 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:29:40.708927    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda124ee3f_37ac_4341_aac8_aceab7db05f3.slice/crio-6d5c4a5b108c438fac4602d27f7be4fa38c925a02679f5e73784579b3d8859ce WatchSource:0}: Error finding container 6d5c4a5b108c438fac4602d27f7be4fa38c925a02679f5e73784579b3d8859ce: Status 404 returned error can't find the container with id 6d5c4a5b108c438fac4602d27f7be4fa38c925a02679f5e73784579b3d8859ce
Jul 16 09:29:41.355672 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.355628    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd" event={"ID":"a124ee3f-37ac-4341-aac8-aceab7db05f3","Type":"ContainerStarted","Data":"4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc"}
Jul 16 09:29:41.355892 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.355851    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:41.355969 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.355896    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd" event={"ID":"a124ee3f-37ac-4341-aac8-aceab7db05f3","Type":"ContainerStarted","Data":"6d5c4a5b108c438fac4602d27f7be4fa38c925a02679f5e73784579b3d8859ce"}
Jul 16 09:29:41.378929 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.378870    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd" podStartSLOduration=2.099463332 podStartE2EDuration="2.378853248s" totalImagesPullingTime="279.389916ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:29:41.376071694 +0000 UTC m=+2076.928104420" watchObservedRunningTime="2026-07-16 09:29:41.378853248 +0000 UTC m=+2076.930885974"
Jul 16 09:29:41.758945 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.758919    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:29:41.882252 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882155    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-certs\") pod \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") "
Jul 16 09:29:41.882252 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882208    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-podinfo\") pod \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") "
Jul 16 09:29:41.882493 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882259    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-socket\") pod \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") "
Jul 16 09:29:41.882493 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882286    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-envoy\") pod \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") "
Jul 16 09:29:41.882493 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882330    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-data\") pod \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") "
Jul 16 09:29:41.882493 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882397    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-token\") pod \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") "
Jul 16 09:29:41.882493 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882433    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lfpr\" (UniqueName: \"kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-kube-api-access-8lfpr\") pod \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") "
Jul 16 09:29:41.882493 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882480    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-credential-socket\") pod \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") "
Jul 16 09:29:41.882839 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882508    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b31e0f9-00a2-4283-aa33-201d0f63ef6e" (UID: "1b31e0f9-00a2-4283-aa33-201d0f63ef6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:29:41.882943 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882644    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b31e0f9-00a2-4283-aa33-201d0f63ef6e" (UID: "1b31e0f9-00a2-4283-aa33-201d0f63ef6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:29:41.882943 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882839    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b31e0f9-00a2-4283-aa33-201d0f63ef6e" (UID: "1b31e0f9-00a2-4283-aa33-201d0f63ef6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:29:41.883064 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882898    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b31e0f9-00a2-4283-aa33-201d0f63ef6e" (UID: "1b31e0f9-00a2-4283-aa33-201d0f63ef6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:29:41.883064 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.882569    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istiod-ca-cert\") pod \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\" (UID: \"1b31e0f9-00a2-4283-aa33-201d0f63ef6e\") "
Jul 16 09:29:41.883276 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.883259    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-credential-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:41.883348 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.883278    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istiod-ca-cert\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:41.883348 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.883287    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:41.883348 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.883295    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-workload-socket\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:41.883509 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.883335    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b31e0f9-00a2-4283-aa33-201d0f63ef6e" (UID: "1b31e0f9-00a2-4283-aa33-201d0f63ef6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:29:41.884819 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.884796    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b31e0f9-00a2-4283-aa33-201d0f63ef6e" (UID: "1b31e0f9-00a2-4283-aa33-201d0f63ef6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:29:41.884916 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.884815    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-kube-api-access-8lfpr" (OuterVolumeSpecName: "kube-api-access-8lfpr") pod "1b31e0f9-00a2-4283-aa33-201d0f63ef6e" (UID: "1b31e0f9-00a2-4283-aa33-201d0f63ef6e"). InnerVolumeSpecName "kube-api-access-8lfpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:29:41.884990 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.884970    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b31e0f9-00a2-4283-aa33-201d0f63ef6e" (UID: "1b31e0f9-00a2-4283-aa33-201d0f63ef6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:29:41.885030 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.884993    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b31e0f9-00a2-4283-aa33-201d0f63ef6e" (UID: "1b31e0f9-00a2-4283-aa33-201d0f63ef6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:29:41.984600 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.984561    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-envoy\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:41.984600 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.984593    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-data\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:41.984600 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.984605    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-token\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:41.984843 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.984619    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lfpr\" (UniqueName: \"kubernetes.io/projected/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-kube-api-access-8lfpr\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:41.984843 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:41.984631    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b31e0f9-00a2-4283-aa33-201d0f63ef6e-istio-podinfo\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:29:42.363544 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.363503    2570 generic.go:356] "Generic (PLEG): container finished" podID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerID="fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9" exitCode=0
Jul 16 09:29:42.363742 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.363573    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"
Jul 16 09:29:42.363742 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.363587    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" event={"ID":"1b31e0f9-00a2-4283-aa33-201d0f63ef6e","Type":"ContainerDied","Data":"fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9"}
Jul 16 09:29:42.363742 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.363657    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p" event={"ID":"1b31e0f9-00a2-4283-aa33-201d0f63ef6e","Type":"ContainerDied","Data":"91b048dc438a57f0033b2ea0ca15395aaa1b63acd71ff5f7d96ce1ec55273585"}
Jul 16 09:29:42.363742 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.363684    2570 scope.go:117] "RemoveContainer" containerID="fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9"
Jul 16 09:29:42.374194 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.374172    2570 scope.go:117] "RemoveContainer" containerID="264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342"
Jul 16 09:29:42.382711 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.382691    2570 scope.go:117] "RemoveContainer" containerID="fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9"
Jul 16 09:29:42.382982 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:29:42.382962    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9\": container with ID starting with fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9 not found: ID does not exist" containerID="fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9"
Jul 16 09:29:42.383057 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.382995    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9"} err="failed to get container status \"fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9\": rpc error: code = NotFound desc = could not find container \"fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9\": container with ID starting with fcbefce6f0b6d4ccb942d24c3cf90942b1b1736f6e6084c57ec8a9d893e6eec9 not found: ID does not exist"
Jul 16 09:29:42.383057 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.383019    2570 scope.go:117] "RemoveContainer" containerID="264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342"
Jul 16 09:29:42.383276 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:29:42.383256    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342\": container with ID starting with 264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342 not found: ID does not exist" containerID="264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342"
Jul 16 09:29:42.383321 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.383282    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342"} err="failed to get container status \"264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342\": rpc error: code = NotFound desc = could not find container \"264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342\": container with ID starting with 264f9c46fa67fc7fa3fdc76ed4ce8ddfc1f78bde39db3b0922a7fda3f1725342 not found: ID does not exist"
Jul 16 09:29:42.387429 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.387403    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"]
Jul 16 09:29:42.391255 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.391232    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-357950-openshift-default-6f6c596fbc-fpd4p"]
Jul 16 09:29:42.972396 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:42.972365    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" path="/var/lib/kubelet/pods/1b31e0f9-00a2-4283-aa33-201d0f63ef6e/volumes"
Jul 16 09:29:44.993543 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:44.993496    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:45.384672 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:45.384639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:45.768209 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:45.768099    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:45.880888 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:45.880844    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:47.370129 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.370098    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:29:47.528067 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.528012    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:47.626987 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.626870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:47.648099 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.648065    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"]
Jul 16 09:29:47.648762 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.648734    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy"
Jul 16 09:29:47.648762 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.648761    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy"
Jul 16 09:29:47.648961 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.648898    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy"
Jul 16 09:29:47.648961 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.648915    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy"
Jul 16 09:29:47.652608 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.652583    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:47.655297 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.655260    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-800be8-serving-cert\""
Jul 16 09:29:47.667141 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.667098    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"]
Jul 16 09:29:47.725518 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.725477    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:47.743668 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.743637    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vvff\" (UniqueName: \"kubernetes.io/projected/377a2b46-80af-444b-a167-8dd4e869bcf3-kube-api-access-8vvff\") pod \"maas-api-e2e-shared-b-800be8-bf54867cc-dwklt\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:47.743821 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.743762    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/377a2b46-80af-444b-a167-8dd4e869bcf3-maas-api-tls\") pod \"maas-api-e2e-shared-b-800be8-bf54867cc-dwklt\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:47.743821 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.743809    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/377a2b46-80af-444b-a167-8dd4e869bcf3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-800be8-bf54867cc-dwklt\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:47.845321 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.845279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/377a2b46-80af-444b-a167-8dd4e869bcf3-maas-api-tls\") pod \"maas-api-e2e-shared-b-800be8-bf54867cc-dwklt\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:47.845321 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.845329    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/377a2b46-80af-444b-a167-8dd4e869bcf3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-800be8-bf54867cc-dwklt\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:47.845659 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.845367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vvff\" (UniqueName: \"kubernetes.io/projected/377a2b46-80af-444b-a167-8dd4e869bcf3-kube-api-access-8vvff\") pod \"maas-api-e2e-shared-b-800be8-bf54867cc-dwklt\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:47.845659 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:29:47.845456    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-serving-cert: secret "maas-api-e2e-shared-b-800be8-serving-cert" not found
Jul 16 09:29:47.845659 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:29:47.845584    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377a2b46-80af-444b-a167-8dd4e869bcf3-maas-api-tls podName:377a2b46-80af-444b-a167-8dd4e869bcf3 nodeName:}" failed. No retries permitted until 2026-07-16 09:29:48.345560049 +0000 UTC m=+2083.897592772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/377a2b46-80af-444b-a167-8dd4e869bcf3-maas-api-tls") pod "maas-api-e2e-shared-b-800be8-bf54867cc-dwklt" (UID: "377a2b46-80af-444b-a167-8dd4e869bcf3") : secret "maas-api-e2e-shared-b-800be8-serving-cert" not found
Jul 16 09:29:47.846063 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.846034    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/377a2b46-80af-444b-a167-8dd4e869bcf3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-800be8-bf54867cc-dwklt\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:47.854359 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.854334    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vvff\" (UniqueName: \"kubernetes.io/projected/377a2b46-80af-444b-a167-8dd4e869bcf3-kube-api-access-8vvff\") pod \"maas-api-e2e-shared-b-800be8-bf54867cc-dwklt\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:47.986552 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:47.986441    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:48.222512 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:48.222480    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:48.322293 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:48.322256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:48.350692 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:48.350654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/377a2b46-80af-444b-a167-8dd4e869bcf3-maas-api-tls\") pod \"maas-api-e2e-shared-b-800be8-bf54867cc-dwklt\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:48.353125 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:48.353101    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/377a2b46-80af-444b-a167-8dd4e869bcf3-maas-api-tls\") pod \"maas-api-e2e-shared-b-800be8-bf54867cc-dwklt\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:48.565893 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:48.565852    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:48.715687 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:48.715653    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"]
Jul 16 09:29:48.717323 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:29:48.717294    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377a2b46_80af_444b_a167_8dd4e869bcf3.slice/crio-cca99ef053c5e14a55b8dbf381b35e5ea302909d42cfd362f2995119f6f2e2ba WatchSource:0}: Error finding container cca99ef053c5e14a55b8dbf381b35e5ea302909d42cfd362f2995119f6f2e2ba: Status 404 returned error can't find the container with id cca99ef053c5e14a55b8dbf381b35e5ea302909d42cfd362f2995119f6f2e2ba
Jul 16 09:29:49.403849 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:49.403808    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt" event={"ID":"377a2b46-80af-444b-a167-8dd4e869bcf3","Type":"ContainerStarted","Data":"7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01"}
Jul 16 09:29:49.404042 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:49.403883    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:29:49.404042 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:49.403911    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt" event={"ID":"377a2b46-80af-444b-a167-8dd4e869bcf3","Type":"ContainerStarted","Data":"cca99ef053c5e14a55b8dbf381b35e5ea302909d42cfd362f2995119f6f2e2ba"}
Jul 16 09:29:49.421760 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:49.421706    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt" podStartSLOduration=2.129495392 podStartE2EDuration="2.421689527s" totalImagesPullingTime="292.194135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:29:49.420017949 +0000 UTC m=+2084.972050676" watchObservedRunningTime="2026-07-16 09:29:49.421689527 +0000 UTC m=+2084.973722253"
Jul 16 09:29:49.676909 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:49.676826    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:49.777310 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:49.777276    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:53.162679 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:53.162639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:29:55.414125 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:29:55.414095    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:30:00.951317 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:00.951273    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:30:01.055990 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:01.055954    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:30:05.030496 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:05.030460    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:30:05.030985 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:05.030945    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:30:05.291966 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:05.291867    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:30:07.283560 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:07.283486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:30:07.383893 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:07.383854    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:30:09.008197 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:09.008156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:30:09.110791 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:09.110752    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:30:26.759048 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.759015    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"]
Jul 16 09:30:26.759446 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.759432    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy"
Jul 16 09:30:26.759446 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.759444    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b31e0f9-00a2-4283-aa33-201d0f63ef6e" containerName="istio-proxy"
Jul 16 09:30:26.762700 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.762683    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:26.765154 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.765126    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"kube-root-ca.crt\""
Jul 16 09:30:26.765154 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.765126    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"default-dockercfg-fgftr\""
Jul 16 09:30:26.766177 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.766154    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"openshift-service-ca.crt\""
Jul 16 09:30:26.766259 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.766230    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"auth-test-model-800be8-kserve-self-signed-certs\""
Jul 16 09:30:26.773758 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.773732    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"]
Jul 16 09:30:26.786685 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.786650    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:30:26.912960 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.912921    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-model-cache\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:26.913164 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.912973    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79hgl\" (UniqueName: \"kubernetes.io/projected/74f049b9-11dd-4a98-8cdc-f86474b58fe9-kube-api-access-79hgl\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:26.913164 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.913028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-home\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:26.913164 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.913046    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-dshm\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:26.913164 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.913113    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tls-certs\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:26.913164 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:26.913160    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tmp-dir\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.013766 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.013672    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-home\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.013766 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.013711    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-dshm\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.013996 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.013772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tls-certs\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.013996 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.013790    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tmp-dir\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.013996 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.013824    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-model-cache\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.013996 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.013868    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79hgl\" (UniqueName: \"kubernetes.io/projected/74f049b9-11dd-4a98-8cdc-f86474b58fe9-kube-api-access-79hgl\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.014233 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.014172    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-home\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.014292 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.014251    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-model-cache\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.014292 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.014266    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tmp-dir\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.016076 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.016049    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-dshm\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.016250 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.016232    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tls-certs\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.023083 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.023060    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79hgl\" (UniqueName: \"kubernetes.io/projected/74f049b9-11dd-4a98-8cdc-f86474b58fe9-kube-api-access-79hgl\") pod \"auth-test-model-800be8-kserve-66566dd755-lmplb\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") " pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.073819 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.073781    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:27.221465 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.221429    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"]
Jul 16 09:30:27.222270 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:30:27.222240    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74f049b9_11dd_4a98_8cdc_f86474b58fe9.slice/crio-f45ed217fbbde968a73ec37d4eaffc891b098aec809a0a6d26977b5a1b843d6c WatchSource:0}: Error finding container f45ed217fbbde968a73ec37d4eaffc891b098aec809a0a6d26977b5a1b843d6c: Status 404 returned error can't find the container with id f45ed217fbbde968a73ec37d4eaffc891b098aec809a0a6d26977b5a1b843d6c
Jul 16 09:30:27.600188 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.600148    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb" event={"ID":"74f049b9-11dd-4a98-8cdc-f86474b58fe9","Type":"ContainerStarted","Data":"d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77"}
Jul 16 09:30:27.600188 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.600200    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb" event={"ID":"74f049b9-11dd-4a98-8cdc-f86474b58fe9","Type":"ContainerStarted","Data":"f45ed217fbbde968a73ec37d4eaffc891b098aec809a0a6d26977b5a1b843d6c"}
Jul 16 09:30:27.618880 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:27.618825    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb" podStartSLOduration=1.618808938 podStartE2EDuration="1.618808938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:30:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:30:27.61691275 +0000 UTC m=+2123.168945477" watchObservedRunningTime="2026-07-16 09:30:27.618808938 +0000 UTC m=+2123.170841665"
Jul 16 09:30:37.074835 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:37.074796    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:37.075315 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:37.075056    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:37.087312 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:37.087281    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:37.661396 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:37.661366    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:30:49.864829 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:30:49.864790    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:31:19.226487 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:31:19.226366    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:32:24.915303 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:24.915259    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:32:25.761027 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:25.760988    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"]
Jul 16 09:32:25.783619 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:25.783582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:32:35.182439 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:35.182349    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:32:35.283566 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:35.283514    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:32:40.781743 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:40.781693    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb" podUID="74f049b9-11dd-4a98-8cdc-f86474b58fe9" containerName="main" containerID="cri-o://d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77" gracePeriod=45
Jul 16 09:32:41.049238 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.049207    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:32:41.193438 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.193399    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-dshm\") pod \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") "
Jul 16 09:32:41.193438 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.193441    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-model-cache\") pod \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") "
Jul 16 09:32:41.193712 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.193470    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tmp-dir\") pod \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") "
Jul 16 09:32:41.193712 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.193526    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tls-certs\") pod \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") "
Jul 16 09:32:41.193712 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.193599    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79hgl\" (UniqueName: \"kubernetes.io/projected/74f049b9-11dd-4a98-8cdc-f86474b58fe9-kube-api-access-79hgl\") pod \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") "
Jul 16 09:32:41.193712 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.193633    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-home\") pod \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\" (UID: \"74f049b9-11dd-4a98-8cdc-f86474b58fe9\") "
Jul 16 09:32:41.193935 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.193796    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-model-cache" (OuterVolumeSpecName: "model-cache") pod "74f049b9-11dd-4a98-8cdc-f86474b58fe9" (UID: "74f049b9-11dd-4a98-8cdc-f86474b58fe9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:32:41.193935 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.193810    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "74f049b9-11dd-4a98-8cdc-f86474b58fe9" (UID: "74f049b9-11dd-4a98-8cdc-f86474b58fe9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:32:41.194032 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.193950    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-model-cache\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:32:41.194032 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.193969    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tmp-dir\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:32:41.194032 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.194014    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-home" (OuterVolumeSpecName: "home") pod "74f049b9-11dd-4a98-8cdc-f86474b58fe9" (UID: "74f049b9-11dd-4a98-8cdc-f86474b58fe9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:32:41.195766 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.195740    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "74f049b9-11dd-4a98-8cdc-f86474b58fe9" (UID: "74f049b9-11dd-4a98-8cdc-f86474b58fe9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:32:41.195923 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.195872    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-dshm" (OuterVolumeSpecName: "dshm") pod "74f049b9-11dd-4a98-8cdc-f86474b58fe9" (UID: "74f049b9-11dd-4a98-8cdc-f86474b58fe9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:32:41.196204 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.196185    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74f049b9-11dd-4a98-8cdc-f86474b58fe9-kube-api-access-79hgl" (OuterVolumeSpecName: "kube-api-access-79hgl") pod "74f049b9-11dd-4a98-8cdc-f86474b58fe9" (UID: "74f049b9-11dd-4a98-8cdc-f86474b58fe9"). InnerVolumeSpecName "kube-api-access-79hgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:32:41.294735 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.294637    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-home\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:32:41.294735 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.294674    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74f049b9-11dd-4a98-8cdc-f86474b58fe9-dshm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:32:41.294735 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.294688    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74f049b9-11dd-4a98-8cdc-f86474b58fe9-tls-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:32:41.294735 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.294704    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79hgl\" (UniqueName: \"kubernetes.io/projected/74f049b9-11dd-4a98-8cdc-f86474b58fe9-kube-api-access-79hgl\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:32:41.295743 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.295710    2570 generic.go:356] "Generic (PLEG): container finished" podID="74f049b9-11dd-4a98-8cdc-f86474b58fe9" containerID="d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77" exitCode=0
Jul 16 09:32:41.295880 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.295771    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"
Jul 16 09:32:41.295880 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.295782    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb" event={"ID":"74f049b9-11dd-4a98-8cdc-f86474b58fe9","Type":"ContainerDied","Data":"d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77"}
Jul 16 09:32:41.295880 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.295823    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb" event={"ID":"74f049b9-11dd-4a98-8cdc-f86474b58fe9","Type":"ContainerDied","Data":"f45ed217fbbde968a73ec37d4eaffc891b098aec809a0a6d26977b5a1b843d6c"}
Jul 16 09:32:41.295880 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.295849    2570 scope.go:117] "RemoveContainer" containerID="d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77"
Jul 16 09:32:41.305650 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.305626    2570 scope.go:117] "RemoveContainer" containerID="d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77"
Jul 16 09:32:41.305923 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:32:41.305902    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77\": container with ID starting with d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77 not found: ID does not exist" containerID="d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77"
Jul 16 09:32:41.305979 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.305932    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77"} err="failed to get container status \"d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77\": rpc error: code = NotFound desc = could not find container \"d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77\": container with ID starting with d966b818ef5f6cfc19cfcd046a1562a985534a98e8be6e022199a79952fd6d77 not found: ID does not exist"
Jul 16 09:32:41.318575 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.318524    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"]
Jul 16 09:32:41.323321 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:41.323297    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/auth-test-model-800be8-kserve-66566dd755-lmplb"]
Jul 16 09:32:42.972661 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:32:42.972628    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74f049b9-11dd-4a98-8cdc-f86474b58fe9" path="/var/lib/kubelet/pods/74f049b9-11dd-4a98-8cdc-f86474b58fe9/volumes"
Jul 16 09:33:12.457156 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.457117    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"]
Jul 16 09:33:12.457618 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.457598    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74f049b9-11dd-4a98-8cdc-f86474b58fe9" containerName="main"
Jul 16 09:33:12.457671 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.457619    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="74f049b9-11dd-4a98-8cdc-f86474b58fe9" containerName="main"
Jul 16 09:33:12.457719 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.457709    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="74f049b9-11dd-4a98-8cdc-f86474b58fe9" containerName="main"
Jul 16 09:33:12.460751 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.460729    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.463151 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.463120    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"openshift-service-ca.crt\""
Jul 16 09:33:12.463292 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.463212    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"sub-test-model-800be8-kserve-self-signed-certs\""
Jul 16 09:33:12.463292 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.463221    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"default-dockercfg-fgftr\""
Jul 16 09:33:12.463292 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.463264    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"kube-root-ca.crt\""
Jul 16 09:33:12.469786 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.469759    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"]
Jul 16 09:33:12.486553 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.486501    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:33:12.601218 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.601183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tmp-dir\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.601395 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.601322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhj5h\" (UniqueName: \"kubernetes.io/projected/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-kube-api-access-jhj5h\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.601395 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.601370    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-home\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.601395 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.601390    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tls-certs\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.601571 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.601449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-dshm\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.601571 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.601464    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-model-cache\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.702384 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.702352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhj5h\" (UniqueName: \"kubernetes.io/projected/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-kube-api-access-jhj5h\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.702624 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.702393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-home\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.702624 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.702409    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tls-certs\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.702624 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.702455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-dshm\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.702624 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.702479    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-model-cache\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.702624 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.702551    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tmp-dir\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.702909 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.702833    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-home\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.702966 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.702947    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-model-cache\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.703006 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.702953    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tmp-dir\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.704855 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.704832    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-dshm\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.705129 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.705111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tls-certs\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.711170 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.711102    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhj5h\" (UniqueName: \"kubernetes.io/projected/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-kube-api-access-jhj5h\") pod \"sub-test-model-800be8-kserve-7d46fbfb7c-bpllv\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") " pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.770940 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.770889    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:12.917968 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:12.917939    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"]
Jul 16 09:33:12.919939 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:33:12.919910    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddc8f3a6_1041_422e_9f2e_1bb1da13b319.slice/crio-0af000cffe652af578b19c03a54fc77ec133aa65fb2fe0ede936b37a1f0d5f5c WatchSource:0}: Error finding container 0af000cffe652af578b19c03a54fc77ec133aa65fb2fe0ede936b37a1f0d5f5c: Status 404 returned error can't find the container with id 0af000cffe652af578b19c03a54fc77ec133aa65fb2fe0ede936b37a1f0d5f5c
Jul 16 09:33:13.479151 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:13.479110    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv" event={"ID":"ddc8f3a6-1041-422e-9f2e-1bb1da13b319","Type":"ContainerStarted","Data":"8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451"}
Jul 16 09:33:13.479151 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:13.479155    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv" event={"ID":"ddc8f3a6-1041-422e-9f2e-1bb1da13b319","Type":"ContainerStarted","Data":"0af000cffe652af578b19c03a54fc77ec133aa65fb2fe0ede936b37a1f0d5f5c"}
Jul 16 09:33:13.497250 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:13.497184    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv" podStartSLOduration=1.497166662 podStartE2EDuration="1.497166662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:33:13.495136488 +0000 UTC m=+2289.047169219" watchObservedRunningTime="2026-07-16 09:33:13.497166662 +0000 UTC m=+2289.049199387"
Jul 16 09:33:22.771195 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:22.771157    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:22.771611 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:22.771211    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:22.783501 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:22.783472    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:23.546411 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:23.546376    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:33:52.172874 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:52.172832    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:33:52.962000 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:52.961955    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"]
Jul 16 09:33:53.032778 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:53.032735    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:33:59.383116 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:33:59.383032    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:34:07.984584 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:07.984500    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv" podUID="ddc8f3a6-1041-422e-9f2e-1bb1da13b319" containerName="main" containerID="cri-o://8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451" gracePeriod=45
Jul 16 09:34:08.251747 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.251720    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:34:08.352893 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.352850    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-model-cache\") pod \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") "
Jul 16 09:34:08.353075 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.352909    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhj5h\" (UniqueName: \"kubernetes.io/projected/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-kube-api-access-jhj5h\") pod \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") "
Jul 16 09:34:08.353075 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.352935    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tls-certs\") pod \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") "
Jul 16 09:34:08.353075 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.352970    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tmp-dir\") pod \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") "
Jul 16 09:34:08.353075 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.352991    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-dshm\") pod \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") "
Jul 16 09:34:08.353075 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.353022    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-home\") pod \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\" (UID: \"ddc8f3a6-1041-422e-9f2e-1bb1da13b319\") "
Jul 16 09:34:08.353367 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.353187    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-model-cache" (OuterVolumeSpecName: "model-cache") pod "ddc8f3a6-1041-422e-9f2e-1bb1da13b319" (UID: "ddc8f3a6-1041-422e-9f2e-1bb1da13b319"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:34:08.353367 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.353280    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ddc8f3a6-1041-422e-9f2e-1bb1da13b319" (UID: "ddc8f3a6-1041-422e-9f2e-1bb1da13b319"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:34:08.353490 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.353397    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tmp-dir\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:34:08.353490 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.353419    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-model-cache\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:34:08.353490 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.353435    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-home" (OuterVolumeSpecName: "home") pod "ddc8f3a6-1041-422e-9f2e-1bb1da13b319" (UID: "ddc8f3a6-1041-422e-9f2e-1bb1da13b319"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:34:08.355228 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.355198    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ddc8f3a6-1041-422e-9f2e-1bb1da13b319" (UID: "ddc8f3a6-1041-422e-9f2e-1bb1da13b319"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:34:08.355339 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.355227    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-kube-api-access-jhj5h" (OuterVolumeSpecName: "kube-api-access-jhj5h") pod "ddc8f3a6-1041-422e-9f2e-1bb1da13b319" (UID: "ddc8f3a6-1041-422e-9f2e-1bb1da13b319"). InnerVolumeSpecName "kube-api-access-jhj5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:34:08.355339 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.355235    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-dshm" (OuterVolumeSpecName: "dshm") pod "ddc8f3a6-1041-422e-9f2e-1bb1da13b319" (UID: "ddc8f3a6-1041-422e-9f2e-1bb1da13b319"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:34:08.454316 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.454278    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhj5h\" (UniqueName: \"kubernetes.io/projected/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-kube-api-access-jhj5h\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:34:08.454316 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.454309    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-tls-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:34:08.454316 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.454320    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-dshm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:34:08.454316 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.454328    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddc8f3a6-1041-422e-9f2e-1bb1da13b319-home\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:34:08.774187 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.774154    2570 generic.go:356] "Generic (PLEG): container finished" podID="ddc8f3a6-1041-422e-9f2e-1bb1da13b319" containerID="8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451" exitCode=0
Jul 16 09:34:08.774369 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.774197    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"
Jul 16 09:34:08.774369 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.774202    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv" event={"ID":"ddc8f3a6-1041-422e-9f2e-1bb1da13b319","Type":"ContainerDied","Data":"8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451"}
Jul 16 09:34:08.774369 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.774230    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv" event={"ID":"ddc8f3a6-1041-422e-9f2e-1bb1da13b319","Type":"ContainerDied","Data":"0af000cffe652af578b19c03a54fc77ec133aa65fb2fe0ede936b37a1f0d5f5c"}
Jul 16 09:34:08.774369 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.774248    2570 scope.go:117] "RemoveContainer" containerID="8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451"
Jul 16 09:34:08.784079 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.784063    2570 scope.go:117] "RemoveContainer" containerID="8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451"
Jul 16 09:34:08.784336 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:34:08.784317    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451\": container with ID starting with 8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451 not found: ID does not exist" containerID="8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451"
Jul 16 09:34:08.784394 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.784350    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451"} err="failed to get container status \"8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451\": rpc error: code = NotFound desc = could not find container \"8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451\": container with ID starting with 8e276af7669a2af43c29430be08b710cb547bde4dde252b7a59f6f8cb61a0451 not found: ID does not exist"
Jul 16 09:34:08.797872 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.797839    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"]
Jul 16 09:34:08.802218 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.802193    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/sub-test-model-800be8-kserve-7d46fbfb7c-bpllv"]
Jul 16 09:34:08.972855 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:08.972815    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddc8f3a6-1041-422e-9f2e-1bb1da13b319" path="/var/lib/kubelet/pods/ddc8f3a6-1041-422e-9f2e-1bb1da13b319/volumes"
Jul 16 09:34:46.852481 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.852441    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"]
Jul 16 09:34:46.853139 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.853115    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc8f3a6-1041-422e-9f2e-1bb1da13b319" containerName="main"
Jul 16 09:34:46.853139 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.853141    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc8f3a6-1041-422e-9f2e-1bb1da13b319" containerName="main"
Jul 16 09:34:46.853309 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.853278    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc8f3a6-1041-422e-9f2e-1bb1da13b319" containerName="main"
Jul 16 09:34:46.856369 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.856348    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:46.859918 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.859891    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"default-dockercfg-fgftr\""
Jul 16 09:34:46.860038 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.859928    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"openshift-service-ca.crt\""
Jul 16 09:34:46.860038 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.859944    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"kube-root-ca.crt\""
Jul 16 09:34:46.860178 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.860081    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-800be8\"/\"rate-test-model-800be8-kserve-self-signed-certs\""
Jul 16 09:34:46.866849 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.866828    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"]
Jul 16 09:34:46.888108 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.888071    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:34:46.917918 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.917893    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-home\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:46.918066 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.917923    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tmp-dir\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:46.918066 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.917950    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-dshm\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:46.918146 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.918070    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tls-certs\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:46.918189 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.918140    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsg9j\" (UniqueName: \"kubernetes.io/projected/e22b9f12-dec9-4794-87bb-0ff23a750c9b-kube-api-access-nsg9j\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:46.918224 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:46.918210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-model-cache\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.019640 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.019601    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-model-cache\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.019640 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.019645    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-home\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.019903 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.019664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tmp-dir\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.019903 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.019767    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-dshm\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.019903 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.019865    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tls-certs\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.020071 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.019961    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsg9j\" (UniqueName: \"kubernetes.io/projected/e22b9f12-dec9-4794-87bb-0ff23a750c9b-kube-api-access-nsg9j\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.020130 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.020072    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-model-cache\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.020212 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.020186    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-home\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.020363 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.020343    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tmp-dir\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.022164 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.022139    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-dshm\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.022319 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.022302    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tls-certs\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.034251 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.034227    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsg9j\" (UniqueName: \"kubernetes.io/projected/e22b9f12-dec9-4794-87bb-0ff23a750c9b-kube-api-access-nsg9j\") pod \"rate-test-model-800be8-kserve-57dc47b9c5-r9mxl\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") " pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.167559 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.167439    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:47.319973 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.319944    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"]
Jul 16 09:34:47.321864 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:34:47.321834    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode22b9f12_dec9_4794_87bb_0ff23a750c9b.slice/crio-be2e649bc98b43ed23cf10f0c6e48a06179a66ff6504b5358a62a78feea49835 WatchSource:0}: Error finding container be2e649bc98b43ed23cf10f0c6e48a06179a66ff6504b5358a62a78feea49835: Status 404 returned error can't find the container with id be2e649bc98b43ed23cf10f0c6e48a06179a66ff6504b5358a62a78feea49835
Jul 16 09:34:47.980120 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.980082    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl" event={"ID":"e22b9f12-dec9-4794-87bb-0ff23a750c9b","Type":"ContainerStarted","Data":"cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a"}
Jul 16 09:34:47.980120 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:47.980125    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl" event={"ID":"e22b9f12-dec9-4794-87bb-0ff23a750c9b","Type":"ContainerStarted","Data":"be2e649bc98b43ed23cf10f0c6e48a06179a66ff6504b5358a62a78feea49835"}
Jul 16 09:34:48.002134 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:48.002066    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl" podStartSLOduration=2.002049557 podStartE2EDuration="2.002049557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:34:48.000518371 +0000 UTC m=+2383.552551117" watchObservedRunningTime="2026-07-16 09:34:48.002049557 +0000 UTC m=+2383.554082324"
Jul 16 09:34:50.608238 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:50.608192    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:34:50.709073 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:50.709036    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:34:57.168401 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:57.168357    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:57.168894 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:57.168417    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:57.181379 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:57.181355    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:34:58.045229 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:34:58.045200    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:35:01.757325 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:01.757274    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:01.858095 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:01.858047    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:05.061067 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:05.061036    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:35:05.064218 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:05.064196    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lm4_c1ea6fc6-f2f5-4f89-bc95-0ffae0954b31/ovn-acl-logging/0.log"
Jul 16 09:35:05.365893 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:05.365863    2570 scope.go:117] "RemoveContainer" containerID="b5cf16978a507c7fe0eda84d5afefc929d3ed53a86f6e4c7856ec3661eeaa842"
Jul 16 09:35:09.892702 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:09.892661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:09.996243 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:09.996204    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:28.361305 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:28.361209    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:29.299233 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:29.299196    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"]
Jul 16 09:35:29.311623 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:29.311591    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:44.320171 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.320104    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl" podUID="e22b9f12-dec9-4794-87bb-0ff23a750c9b" containerName="main" containerID="cri-o://cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a" gracePeriod=45
Jul 16 09:35:44.581469 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.581395    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:35:44.674934 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.674896    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tmp-dir\") pod \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") "
Jul 16 09:35:44.675110 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.674984    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-model-cache\") pod \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") "
Jul 16 09:35:44.675110 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.675006    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-home\") pod \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") "
Jul 16 09:35:44.675110 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.675020    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-dshm\") pod \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") "
Jul 16 09:35:44.675110 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.675035    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tls-certs\") pod \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") "
Jul 16 09:35:44.675312 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.675152    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsg9j\" (UniqueName: \"kubernetes.io/projected/e22b9f12-dec9-4794-87bb-0ff23a750c9b-kube-api-access-nsg9j\") pod \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\" (UID: \"e22b9f12-dec9-4794-87bb-0ff23a750c9b\") "
Jul 16 09:35:44.675312 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.675212    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e22b9f12-dec9-4794-87bb-0ff23a750c9b" (UID: "e22b9f12-dec9-4794-87bb-0ff23a750c9b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:35:44.675312 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.675279    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-model-cache" (OuterVolumeSpecName: "model-cache") pod "e22b9f12-dec9-4794-87bb-0ff23a750c9b" (UID: "e22b9f12-dec9-4794-87bb-0ff23a750c9b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:35:44.675312 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.675299    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-home" (OuterVolumeSpecName: "home") pod "e22b9f12-dec9-4794-87bb-0ff23a750c9b" (UID: "e22b9f12-dec9-4794-87bb-0ff23a750c9b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:35:44.675578 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.675516    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tmp-dir\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:35:44.675697 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.675583    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-model-cache\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:35:44.675697 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.675598    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-home\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:35:44.677190 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.677156    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-dshm" (OuterVolumeSpecName: "dshm") pod "e22b9f12-dec9-4794-87bb-0ff23a750c9b" (UID: "e22b9f12-dec9-4794-87bb-0ff23a750c9b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:35:44.677353 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.677209    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e22b9f12-dec9-4794-87bb-0ff23a750c9b-kube-api-access-nsg9j" (OuterVolumeSpecName: "kube-api-access-nsg9j") pod "e22b9f12-dec9-4794-87bb-0ff23a750c9b" (UID: "e22b9f12-dec9-4794-87bb-0ff23a750c9b"). InnerVolumeSpecName "kube-api-access-nsg9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:35:44.677353 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.677262    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e22b9f12-dec9-4794-87bb-0ff23a750c9b" (UID: "e22b9f12-dec9-4794-87bb-0ff23a750c9b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:35:44.776173 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.776131    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e22b9f12-dec9-4794-87bb-0ff23a750c9b-dshm\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:35:44.776173 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.776164    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22b9f12-dec9-4794-87bb-0ff23a750c9b-tls-certs\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:35:44.776173 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:44.776177    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsg9j\" (UniqueName: \"kubernetes.io/projected/e22b9f12-dec9-4794-87bb-0ff23a750c9b-kube-api-access-nsg9j\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:35:45.281462 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:45.281365    2570 generic.go:356] "Generic (PLEG): container finished" podID="e22b9f12-dec9-4794-87bb-0ff23a750c9b" containerID="cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a" exitCode=0
Jul 16 09:35:45.281462 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:45.281409    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"
Jul 16 09:35:45.281462 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:45.281449    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl" event={"ID":"e22b9f12-dec9-4794-87bb-0ff23a750c9b","Type":"ContainerDied","Data":"cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a"}
Jul 16 09:35:45.281746 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:45.281497    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl" event={"ID":"e22b9f12-dec9-4794-87bb-0ff23a750c9b","Type":"ContainerDied","Data":"be2e649bc98b43ed23cf10f0c6e48a06179a66ff6504b5358a62a78feea49835"}
Jul 16 09:35:45.281746 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:45.281514    2570 scope.go:117] "RemoveContainer" containerID="cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a"
Jul 16 09:35:45.290378 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:45.290359    2570 scope.go:117] "RemoveContainer" containerID="cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a"
Jul 16 09:35:45.290701 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:35:45.290681    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a\": container with ID starting with cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a not found: ID does not exist" containerID="cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a"
Jul 16 09:35:45.290763 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:45.290709    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a"} err="failed to get container status \"cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a\": rpc error: code = NotFound desc = could not find container \"cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a\": container with ID starting with cacea83bd97f723c1269d9d65fb423d8c3676ca8007fe5afc5c74b29a630c91a not found: ID does not exist"
Jul 16 09:35:45.298883 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:45.298859    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"]
Jul 16 09:35:45.305236 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:45.305214    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-800be8/rate-test-model-800be8-kserve-57dc47b9c5-r9mxl"]
Jul 16 09:35:46.973351 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:46.973313    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e22b9f12-dec9-4794-87bb-0ff23a750c9b" path="/var/lib/kubelet/pods/e22b9f12-dec9-4794-87bb-0ff23a750c9b/volumes"
Jul 16 09:35:49.034320 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:49.034284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:55.178127 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.178064    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"]
Jul 16 09:35:55.178716 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.178357    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd" podUID="a124ee3f-37ac-4341-aac8-aceab7db05f3" containerName="maas-api" containerID="cri-o://4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc" gracePeriod=30
Jul 16 09:35:55.206436 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.206396    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:55.637368 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.637337    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:35:55.778604 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.778501    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a124ee3f-37ac-4341-aac8-aceab7db05f3-maas-api-tls\") pod \"a124ee3f-37ac-4341-aac8-aceab7db05f3\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") "
Jul 16 09:35:55.778604 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.778570    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mxf6\" (UniqueName: \"kubernetes.io/projected/a124ee3f-37ac-4341-aac8-aceab7db05f3-kube-api-access-2mxf6\") pod \"a124ee3f-37ac-4341-aac8-aceab7db05f3\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") "
Jul 16 09:35:55.778807 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.778650    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a124ee3f-37ac-4341-aac8-aceab7db05f3-openshift-service-ca\") pod \"a124ee3f-37ac-4341-aac8-aceab7db05f3\" (UID: \"a124ee3f-37ac-4341-aac8-aceab7db05f3\") "
Jul 16 09:35:55.779046 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.779008    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a124ee3f-37ac-4341-aac8-aceab7db05f3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a124ee3f-37ac-4341-aac8-aceab7db05f3" (UID: "a124ee3f-37ac-4341-aac8-aceab7db05f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:35:55.780672 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.780642    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a124ee3f-37ac-4341-aac8-aceab7db05f3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a124ee3f-37ac-4341-aac8-aceab7db05f3" (UID: "a124ee3f-37ac-4341-aac8-aceab7db05f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:35:55.780770 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.780739    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a124ee3f-37ac-4341-aac8-aceab7db05f3-kube-api-access-2mxf6" (OuterVolumeSpecName: "kube-api-access-2mxf6") pod "a124ee3f-37ac-4341-aac8-aceab7db05f3" (UID: "a124ee3f-37ac-4341-aac8-aceab7db05f3"). InnerVolumeSpecName "kube-api-access-2mxf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:35:55.880229 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.880189    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a124ee3f-37ac-4341-aac8-aceab7db05f3-maas-api-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:35:55.880229 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.880222    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mxf6\" (UniqueName: \"kubernetes.io/projected/a124ee3f-37ac-4341-aac8-aceab7db05f3-kube-api-access-2mxf6\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:35:55.880229 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:55.880232    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a124ee3f-37ac-4341-aac8-aceab7db05f3-openshift-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:35:56.341964 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.341925    2570 generic.go:356] "Generic (PLEG): container finished" podID="a124ee3f-37ac-4341-aac8-aceab7db05f3" containerID="4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc" exitCode=0
Jul 16 09:35:56.342395 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.341974    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"
Jul 16 09:35:56.342395 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.342013    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd" event={"ID":"a124ee3f-37ac-4341-aac8-aceab7db05f3","Type":"ContainerDied","Data":"4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc"}
Jul 16 09:35:56.342395 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.342071    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd" event={"ID":"a124ee3f-37ac-4341-aac8-aceab7db05f3","Type":"ContainerDied","Data":"6d5c4a5b108c438fac4602d27f7be4fa38c925a02679f5e73784579b3d8859ce"}
Jul 16 09:35:56.342395 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.342103    2570 scope.go:117] "RemoveContainer" containerID="4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc"
Jul 16 09:35:56.351272 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.351252    2570 scope.go:117] "RemoveContainer" containerID="4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc"
Jul 16 09:35:56.351554 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:35:56.351517    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc\": container with ID starting with 4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc not found: ID does not exist" containerID="4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc"
Jul 16 09:35:56.351612 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.351569    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc"} err="failed to get container status \"4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc\": rpc error: code = NotFound desc = could not find container \"4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc\": container with ID starting with 4fa8e24b186dca43c44977c40977eb33b6ba57c8c3f6fca96b993677032b30fc not found: ID does not exist"
Jul 16 09:35:56.365943 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.365915    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"]
Jul 16 09:35:56.373947 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.373924    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-923c3a-658b497cb-lwbxd"]
Jul 16 09:35:56.375948 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.375910    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:56.973002 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:35:56.972968    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a124ee3f-37ac-4341-aac8-aceab7db05f3" path="/var/lib/kubelet/pods/a124ee3f-37ac-4341-aac8-aceab7db05f3/volumes"
Jul 16 09:36:00.102393 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:00.102351    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:00.984074 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:00.984019    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:01.045364 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:01.045324    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:01.293868 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:01.293774    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:01.544337 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:01.544244    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:02.043102 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:02.043042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:08.028983 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.028943    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"]
Jul 16 09:36:08.029416 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.029220    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt" podUID="377a2b46-80af-444b-a167-8dd4e869bcf3" containerName="maas-api" containerID="cri-o://7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01" gracePeriod=30
Jul 16 09:36:08.055776 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.055737    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:08.298317 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.298286    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:36:08.381770 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.381736    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:08.393761 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.393729    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vvff\" (UniqueName: \"kubernetes.io/projected/377a2b46-80af-444b-a167-8dd4e869bcf3-kube-api-access-8vvff\") pod \"377a2b46-80af-444b-a167-8dd4e869bcf3\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") "
Jul 16 09:36:08.393920 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.393845    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/377a2b46-80af-444b-a167-8dd4e869bcf3-openshift-service-ca\") pod \"377a2b46-80af-444b-a167-8dd4e869bcf3\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") "
Jul 16 09:36:08.393920 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.393885    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/377a2b46-80af-444b-a167-8dd4e869bcf3-maas-api-tls\") pod \"377a2b46-80af-444b-a167-8dd4e869bcf3\" (UID: \"377a2b46-80af-444b-a167-8dd4e869bcf3\") "
Jul 16 09:36:08.394306 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.394273    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/377a2b46-80af-444b-a167-8dd4e869bcf3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "377a2b46-80af-444b-a167-8dd4e869bcf3" (UID: "377a2b46-80af-444b-a167-8dd4e869bcf3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:36:08.395899 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.395867    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377a2b46-80af-444b-a167-8dd4e869bcf3-kube-api-access-8vvff" (OuterVolumeSpecName: "kube-api-access-8vvff") pod "377a2b46-80af-444b-a167-8dd4e869bcf3" (UID: "377a2b46-80af-444b-a167-8dd4e869bcf3"). InnerVolumeSpecName "kube-api-access-8vvff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:36:08.396019 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.395986    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/377a2b46-80af-444b-a167-8dd4e869bcf3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "377a2b46-80af-444b-a167-8dd4e869bcf3" (UID: "377a2b46-80af-444b-a167-8dd4e869bcf3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:36:08.405564 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.405522    2570 generic.go:356] "Generic (PLEG): container finished" podID="377a2b46-80af-444b-a167-8dd4e869bcf3" containerID="7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01" exitCode=0
Jul 16 09:36:08.405666 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.405579    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"
Jul 16 09:36:08.405666 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.405575    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt" event={"ID":"377a2b46-80af-444b-a167-8dd4e869bcf3","Type":"ContainerDied","Data":"7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01"}
Jul 16 09:36:08.405759 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.405699    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt" event={"ID":"377a2b46-80af-444b-a167-8dd4e869bcf3","Type":"ContainerDied","Data":"cca99ef053c5e14a55b8dbf381b35e5ea302909d42cfd362f2995119f6f2e2ba"}
Jul 16 09:36:08.405759 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.405725    2570 scope.go:117] "RemoveContainer" containerID="7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01"
Jul 16 09:36:08.417643 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.417627    2570 scope.go:117] "RemoveContainer" containerID="7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01"
Jul 16 09:36:08.417904 ip-10-0-135-178 kubenswrapper[2570]: E0716 09:36:08.417881    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01\": container with ID starting with 7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01 not found: ID does not exist" containerID="7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01"
Jul 16 09:36:08.417945 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.417912    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01"} err="failed to get container status \"7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01\": rpc error: code = NotFound desc = could not find container \"7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01\": container with ID starting with 7f6e929e296f8dfb64557a5ab06fe434dd4ef5b76956b031293b61a1a3f9ee01 not found: ID does not exist"
Jul 16 09:36:08.430250 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.430216    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"]
Jul 16 09:36:08.437457 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.437436    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-800be8-bf54867cc-dwklt"]
Jul 16 09:36:08.495691 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.495656    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/377a2b46-80af-444b-a167-8dd4e869bcf3-openshift-service-ca\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:36:08.495691 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.495689    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/377a2b46-80af-444b-a167-8dd4e869bcf3-maas-api-tls\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:36:08.495691 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.495701    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vvff\" (UniqueName: \"kubernetes.io/projected/377a2b46-80af-444b-a167-8dd4e869bcf3-kube-api-access-8vvff\") on node \"ip-10-0-135-178.ec2.internal\" DevicePath \"\""
Jul 16 09:36:08.971905 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:08.971869    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="377a2b46-80af-444b-a167-8dd4e869bcf3" path="/var/lib/kubelet/pods/377a2b46-80af-444b-a167-8dd4e869bcf3/volumes"
Jul 16 09:36:14.082808 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:14.082767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:14.183074 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:14.183037    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:14.392655 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:14.392565    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:14.664306 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:14.664206    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:15.103661 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:15.103627    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c97b7b54f-4lvg5_4efb561b-6a9a-4473-812b-33b1a0ac000d/authorino/0.log"
Jul 16 09:36:20.858241 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:20.858207    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9bbqn_88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb/manager/0.log"
Jul 16 09:36:20.995934 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:20.995909    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xj8nt_c7c390ef-809d-40ba-a6ef-885c6a040045/manager/0.log"
Jul 16 09:36:21.126189 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:21.126100    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75c958864b-nsp49_7c186f07-9333-41fd-af0b-97defa937164/manager/0.log"
Jul 16 09:36:21.250899 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:21.250861    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-85qgr_932442fd-1c9b-4fd4-9630-e2ddd1099d81/server/0.log"
Jul 16 09:36:21.389166 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:21.389069    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lzrvl_a3ebba46-0c51-4cd2-960d-a18daff31aa2/manager/0.log"
Jul 16 09:36:21.810616 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:21.810489    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b875787f8-cnl6g_17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab/copy-manifests/0.log"
Jul 16 09:36:21.829952 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:21.829913    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b875787f8-cnl6g_17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab/manager/0.log"
Jul 16 09:36:22.197321 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:22.197289    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-d9fc9cd7f-rd5fx_d0f0e1db-bfd2-4c07-bd18-545622e3608c/maas-api/0.log"
Jul 16 09:36:22.552042 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:22.551960    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-vr45f_dffad33f-6e4c-4022-9124-08d6f411ce8f/postgres/0.log"
Jul 16 09:36:23.993043 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:23.993011    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c97b7b54f-4lvg5_4efb561b-6a9a-4473-812b-33b1a0ac000d/authorino/0.log"
Jul 16 09:36:24.128065 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:24.127998    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xnrcp_58ab0f98-4196-4a30-a505-14b07cfc233d/manager/0.log"
Jul 16 09:36:24.264017 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:24.263921    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tlgz9_25b62c62-a888-49df-bf48-b50b6a6acaeb/manager/0.log"
Jul 16 09:36:24.393523 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:24.393479    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4n6r5_35e510b8-1f33-47d0-8752-2354f457dfc5/kuadrant-console-plugin/0.log"
Jul 16 09:36:24.522984 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:24.522892    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sfnzl_42a6c65f-1eb3-4b18-acd5-475f92f1e1d1/registry-server/0.log"
Jul 16 09:36:24.921726 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:24.921692    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lxsv4_5dbb0aca-bd30-40aa-98d4-d452fdb50e4c/manager/0.log"
Jul 16 09:36:25.723141 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:25.723105    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-856d68f954-nvhqr_3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0/kube-auth-proxy/0.log"
Jul 16 09:36:25.855235 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:25.855203    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjqvh_23c48a79-4380-40f6-ad2b-ab5beb81be3b/istio-proxy/1.log"
Jul 16 09:36:26.106473 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:26.106437    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-7v7p7_d46bf430-052a-4a6e-b3d4-05049d8a2fc1/payload-processing/0.log"
Jul 16 09:36:26.234670 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:26.234638    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d56f759d-97tbg_d5a16205-7466-42d6-9601-f698f14abcc6/router/0.log"
Jul 16 09:36:26.616567 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:26.616523    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5qphd_80e9280c-016c-423b-96b8-f00dd2637a46/main/0.log"
Jul 16 09:36:26.741960 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:26.741933    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-w2s6b_fd35d279-26ea-4b12-8c8c-4ab9361d6c9f/main/0.log"
Jul 16 09:36:27.096184 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:27.096146    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8vd4w_66624084-68c6-4fa5-b097-007a8c62b8c0/main/0.log"
Jul 16 09:36:33.103692 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:33.103644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:33.216764 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:33.216723    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:35.897634 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:35.897602    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-75242_4bcb10aa-9fbd-4739-9033-498353921729/global-pull-secret-syncer/0.log"
Jul 16 09:36:36.040652 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:36.040623    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5bwwx_dcc43300-1f1f-44a4-8919-b6384063d625/konnectivity-agent/0.log"
Jul 16 09:36:36.149079 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:36.148978    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-178.ec2.internal_102fbd48ff7ff0cfcd397c73fd966f70/haproxy/0.log"
Jul 16 09:36:41.594924 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:41.594886    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c97b7b54f-4lvg5_4efb561b-6a9a-4473-812b-33b1a0ac000d/authorino/0.log"
Jul 16 09:36:41.627728 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:41.627695    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xnrcp_58ab0f98-4196-4a30-a505-14b07cfc233d/manager/0.log"
Jul 16 09:36:41.651429 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:41.651389    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tlgz9_25b62c62-a888-49df-bf48-b50b6a6acaeb/manager/0.log"
Jul 16 09:36:41.676106 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:41.676079    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4n6r5_35e510b8-1f33-47d0-8752-2354f457dfc5/kuadrant-console-plugin/0.log"
Jul 16 09:36:41.726584 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:41.726553    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sfnzl_42a6c65f-1eb3-4b18-acd5-475f92f1e1d1/registry-server/0.log"
Jul 16 09:36:41.957956 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:41.957860    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lxsv4_5dbb0aca-bd30-40aa-98d4-d452fdb50e4c/manager/0.log"
Jul 16 09:36:43.735136 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:43.735100    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-4zzwv_f4fb791a-58d8-4a95-bdf9-d015d3666354/kube-state-metrics/0.log"
Jul 16 09:36:43.750598 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:43.750569    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-4zzwv_f4fb791a-58d8-4a95-bdf9-d015d3666354/kube-rbac-proxy-main/0.log"
Jul 16 09:36:43.771876 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:43.771848    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-4zzwv_f4fb791a-58d8-4a95-bdf9-d015d3666354/kube-rbac-proxy-self/0.log"
Jul 16 09:36:44.027096 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:44.027019    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2nvf_56d9a4bf-42b0-49c3-9891-57115ef96bda/node-exporter/0.log"
Jul 16 09:36:44.049512 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:44.049453    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2nvf_56d9a4bf-42b0-49c3-9891-57115ef96bda/kube-rbac-proxy/0.log"
Jul 16 09:36:44.071043 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:44.071017    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2nvf_56d9a4bf-42b0-49c3-9891-57115ef96bda/init-textfile/0.log"
Jul 16 09:36:44.342292 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:44.342261    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xx5bh_0dddeb8d-42fa-4d2d-9174-f625fd5585b0/prometheus-operator/0.log"
Jul 16 09:36:44.359967 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:44.359929    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xx5bh_0dddeb8d-42fa-4d2d-9174-f625fd5585b0/kube-rbac-proxy/0.log"
Jul 16 09:36:45.508103 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.508061    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"]
Jul 16 09:36:45.508650 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.508629    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e22b9f12-dec9-4794-87bb-0ff23a750c9b" containerName="main"
Jul 16 09:36:45.508736 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.508654    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e22b9f12-dec9-4794-87bb-0ff23a750c9b" containerName="main"
Jul 16 09:36:45.508736 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.508682    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a124ee3f-37ac-4341-aac8-aceab7db05f3" containerName="maas-api"
Jul 16 09:36:45.508736 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.508690    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a124ee3f-37ac-4341-aac8-aceab7db05f3" containerName="maas-api"
Jul 16 09:36:45.508736 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.508714    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377a2b46-80af-444b-a167-8dd4e869bcf3" containerName="maas-api"
Jul 16 09:36:45.508736 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.508724    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="377a2b46-80af-444b-a167-8dd4e869bcf3" containerName="maas-api"
Jul 16 09:36:45.508943 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.508819    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="377a2b46-80af-444b-a167-8dd4e869bcf3" containerName="maas-api"
Jul 16 09:36:45.508943 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.508829    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e22b9f12-dec9-4794-87bb-0ff23a750c9b" containerName="main"
Jul 16 09:36:45.508943 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.508840    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a124ee3f-37ac-4341-aac8-aceab7db05f3" containerName="maas-api"
Jul 16 09:36:45.512057 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.512036    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.514376 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.514356    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xjqh\"/\"openshift-service-ca.crt\""
Jul 16 09:36:45.514635 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.514612    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xjqh\"/\"kube-root-ca.crt\""
Jul 16 09:36:45.515250 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.515230    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8xjqh\"/\"default-dockercfg-lv2zr\""
Jul 16 09:36:45.522576 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.522546    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"]
Jul 16 09:36:45.544466 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.544429    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-podres\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.544714 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.544495    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-proc\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.544781 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.544765    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-sys\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.544846 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.544783    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssjth\" (UniqueName: \"kubernetes.io/projected/0aec1461-c76a-4850-9378-db8a4872eb4a-kube-api-access-ssjth\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.544846 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.544834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-lib-modules\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.645502 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.645456    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-proc\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.645502 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.645505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-sys\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.645750 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.645524    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssjth\" (UniqueName: \"kubernetes.io/projected/0aec1461-c76a-4850-9378-db8a4872eb4a-kube-api-access-ssjth\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.645750 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.645585    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-lib-modules\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.645750 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.645604    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-proc\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.645750 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.645611    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-sys\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.645750 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.645663    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-podres\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.645920 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.645795    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-podres\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.645920 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.645810    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0aec1461-c76a-4850-9378-db8a4872eb4a-lib-modules\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.654748 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.654716    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssjth\" (UniqueName: \"kubernetes.io/projected/0aec1461-c76a-4850-9378-db8a4872eb4a-kube-api-access-ssjth\") pod \"perf-node-gather-daemonset-b54c6\" (UID: \"0aec1461-c76a-4850-9378-db8a4872eb4a\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.778934 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.778843    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-4n9v5_8576da94-49b6-4d18-b03a-686eb7b48903/networking-console-plugin/0.log"
Jul 16 09:36:45.822995 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.822961    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:45.957870 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:45.957782    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"]
Jul 16 09:36:45.959804 ip-10-0-135-178 kubenswrapper[2570]: W0716 09:36:45.959773    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0aec1461_c76a_4850_9378_db8a4872eb4a.slice/crio-6ce12cf0d38917fdd6a16e6141995d050b7c7a5b202b4cec7fc5ba61663cfcfc WatchSource:0}: Error finding container 6ce12cf0d38917fdd6a16e6141995d050b7c7a5b202b4cec7fc5ba61663cfcfc: Status 404 returned error can't find the container with id 6ce12cf0d38917fdd6a16e6141995d050b7c7a5b202b4cec7fc5ba61663cfcfc
Jul 16 09:36:46.606716 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:46.606674    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6" event={"ID":"0aec1461-c76a-4850-9378-db8a4872eb4a","Type":"ContainerStarted","Data":"8baa681e8bf4ec7f3fde13841a710a556911c52e4f1d9d4a6578670609acd13d"}
Jul 16 09:36:46.607147 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:46.606739    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6" event={"ID":"0aec1461-c76a-4850-9378-db8a4872eb4a","Type":"ContainerStarted","Data":"6ce12cf0d38917fdd6a16e6141995d050b7c7a5b202b4cec7fc5ba61663cfcfc"}
Jul 16 09:36:46.607147 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:46.606778    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:46.624230 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:46.624170    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6" podStartSLOduration=1.624155148 podStartE2EDuration="1.624155148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:36:46.622455826 +0000 UTC m=+2502.174488555" watchObservedRunningTime="2026-07-16 09:36:46.624155148 +0000 UTC m=+2502.176187874"
Jul 16 09:36:46.847280 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:46.847247    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-849c9464f9-tcqw6_d3f535bb-27de-4d4d-8e55-dbcd6cc1a43b/console/0.log"
Jul 16 09:36:47.477140 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:47.477109    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-sfmc9_7f683e99-b047-420d-94da-a2657e6ad1be/volume-data-source-validator/0.log"
Jul 16 09:36:48.560614 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:48.560585    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jmg7x_c70363bf-a2fc-4ea1-8ec5-20fc52e40198/dns/0.log"
Jul 16 09:36:48.582126 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:48.582100    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jmg7x_c70363bf-a2fc-4ea1-8ec5-20fc52e40198/kube-rbac-proxy/0.log"
Jul 16 09:36:48.702140 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:48.702106    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s27fh_1c804ded-6c2b-48c6-b551-2cdde96f775a/dns-node-resolver/0.log"
Jul 16 09:36:49.312400 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:49.312364    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-774bcc56cf-k7mmz_28644155-198d-4b53-93d4-d27ceeba1619/registry/0.log"
Jul 16 09:36:49.334712 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:49.334678    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2mpmb_36d590a8-21ff-4ae1-912c-548319c0559c/node-ca/0.log"
Jul 16 09:36:50.473495 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:50.473463    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-856d68f954-nvhqr_3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0/kube-auth-proxy/0.log"
Jul 16 09:36:50.502488 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:50.502441    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjqvh_23c48a79-4380-40f6-ad2b-ab5beb81be3b/istio-proxy/0.log"
Jul 16 09:36:50.562829 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:50.562790    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjqvh_23c48a79-4380-40f6-ad2b-ab5beb81be3b/istio-proxy/1.log"
Jul 16 09:36:50.633158 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:50.633128    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-7v7p7_d46bf430-052a-4a6e-b3d4-05049d8a2fc1/payload-processing/0.log"
Jul 16 09:36:50.660322 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:50.660286    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d56f759d-97tbg_d5a16205-7466-42d6-9601-f698f14abcc6/router/0.log"
Jul 16 09:36:51.399008 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:51.398976    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n6ch9_0dae7c84-8ff6-4dc5-9be3-335624c6bec2/serve-healthcheck-canary/0.log"
Jul 16 09:36:51.957657 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:51.957623    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jvc28_da173879-80bb-4c14-bfa5-a87e770ebaee/kube-rbac-proxy/0.log"
Jul 16 09:36:51.979835 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:51.979804    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jvc28_da173879-80bb-4c14-bfa5-a87e770ebaee/exporter/0.log"
Jul 16 09:36:52.002080 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:52.002044    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jvc28_da173879-80bb-4c14-bfa5-a87e770ebaee/extractor/0.log"
Jul 16 09:36:52.621417 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:52.621390    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-b54c6"
Jul 16 09:36:54.165991 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:54.165958    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9bbqn_88710f4c-7d20-4da4-8dc8-c6cc5e37a9bb/manager/0.log"
Jul 16 09:36:54.400176 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:54.400143    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xj8nt_c7c390ef-809d-40ba-a6ef-885c6a040045/manager/0.log"
Jul 16 09:36:54.552807 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:54.552703    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75c958864b-nsp49_7c186f07-9333-41fd-af0b-97defa937164/manager/0.log"
Jul 16 09:36:54.575935 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:54.575908    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-85qgr_932442fd-1c9b-4fd4-9630-e2ddd1099d81/server/0.log"
Jul 16 09:36:54.678858 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:54.678825    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lzrvl_a3ebba46-0c51-4cd2-960d-a18daff31aa2/manager/0.log"
Jul 16 09:36:54.919256 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:54.919213    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b875787f8-cnl6g_17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab/manager/0.log"
Jul 16 09:36:54.938068 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:54.938039    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b875787f8-cnl6g_17a9fae7-0dab-4cc0-a0be-e0ea9f4e5bab/copy-manifests/0.log"
Jul 16 09:36:55.735154 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:55.735110    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-856d68f954-nvhqr_3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0/kube-auth-proxy/0.log"
Jul 16 09:36:55.762584 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:55.762517    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjqvh_23c48a79-4380-40f6-ad2b-ab5beb81be3b/istio-proxy/0.log"
Jul 16 09:36:55.823505 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:55.823474    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjqvh_23c48a79-4380-40f6-ad2b-ab5beb81be3b/istio-proxy/1.log"
Jul 16 09:36:55.874294 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:55.874259    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-7v7p7_d46bf430-052a-4a6e-b3d4-05049d8a2fc1/payload-processing/0.log"
Jul 16 09:36:55.896293 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:55.896261    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d56f759d-97tbg_d5a16205-7466-42d6-9601-f698f14abcc6/router/0.log"
Jul 16 09:36:57.378760 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:57.378725    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-856d68f954-nvhqr_3798e25c-5a83-4cc4-9bc2-b5bd496fb2a0/kube-auth-proxy/0.log"
Jul 16 09:36:57.403054 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:57.403024    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjqvh_23c48a79-4380-40f6-ad2b-ab5beb81be3b/istio-proxy/0.log"
Jul 16 09:36:57.462821 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:57.462781    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjqvh_23c48a79-4380-40f6-ad2b-ab5beb81be3b/istio-proxy/1.log"
Jul 16 09:36:57.518214 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:57.518169    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-7v7p7_d46bf430-052a-4a6e-b3d4-05049d8a2fc1/payload-processing/0.log"
Jul 16 09:36:57.535896 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:36:57.535863    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d56f759d-97tbg_d5a16205-7466-42d6-9601-f698f14abcc6/router/0.log"
Jul 16 09:37:03.228788 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:37:03.228709    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5g9k_72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2/kube-multus-additional-cni-plugins/0.log"
Jul 16 09:37:03.249445 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:37:03.249419    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5g9k_72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2/egress-router-binary-copy/0.log"
Jul 16 09:37:03.272152 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:37:03.272118    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5g9k_72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2/cni-plugins/0.log"
Jul 16 09:37:03.293787 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:37:03.293754    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5g9k_72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2/bond-cni-plugin/0.log"
Jul 16 09:37:03.317408 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:37:03.317372    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5g9k_72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2/routeoverride-cni/0.log"
Jul 16 09:37:03.339117 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:37:03.339082    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5g9k_72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2/whereabouts-cni-bincopy/0.log"
Jul 16 09:37:03.361184 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:37:03.361153    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5g9k_72c1d9a0-45e6-4b19-b06f-c0a2b3c267a2/whereabouts-cni/0.log"
Jul 16 09:37:03.572918 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:37:03.572881    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j7cl9_973d613a-c79d-4c0e-9945-0fcb9454fffb/kube-multus/0.log"
Jul 16 09:37:03.786579 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:37:03.786519    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l78hg_96702d5b-3be0-4729-9ddb-022b16b20cd1/network-metrics-daemon/0.log"
Jul 16 09:37:03.812440 ip-10-0-135-178 kubenswrapper[2570]: I0716 09:37:03.812409    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l78hg_96702d5b-3be0-4729-9ddb-022b16b20cd1/kube-rbac-proxy/0.log"