Jul 12 08:21:37.324153 ip-10-0-136-78 systemd[1]: Starting Kubernetes Kubelet...
Jul 12 08:21:37.642191 ip-10-0-136-78 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 08:21:37.642191 ip-10-0-136-78 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 12 08:21:37.642191 ip-10-0-136-78 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 08:21:37.642191 ip-10-0-136-78 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 12 08:21:37.642191 ip-10-0-136-78 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 08:21:37.643297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.642474    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649078    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649091    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649095    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649098    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649102    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649105    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649108    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649112    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649115    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649118    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649121    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649123    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649126    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649130    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649135    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649139    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649143    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649146    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649149    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:21:37.751944 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649159    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:21:37.714204 ip-10-0-136-78 systemd[1]: Started Kubernetes Kubelet.
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649162    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649165    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649168    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649170    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649174    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649177    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649180    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649183    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649187    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649191    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649195    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649199    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649202    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649204    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649207    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649209    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649212    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649215    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649217    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:21:37.754052 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649220    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649223    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649225    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649229    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649231    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649235    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649238    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649240    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649243    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649246    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649248    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649250    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649253    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649255    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649258    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649260    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649263    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649265    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649267    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649270    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:21:37.755311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649272    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649275    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649278    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649280    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649283    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649285    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649288    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649290    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649293    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649295    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649298    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649301    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649304    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649307    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649310    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649313    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649316    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649318    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649321    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:21:37.757361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649324    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649326    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649329    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649331    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649333    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649336    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649338    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649341    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649343    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649346    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649348    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649351    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649354    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649356    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649359    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649361    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649364    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649367    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649369    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649372    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:21:37.758335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.649374    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650124    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650132    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650135    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650138    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650140    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650143    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650146    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650149    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650151    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650155    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650157    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650160    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650163    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650165    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650168    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650170    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650173    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650175    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650178    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:21:37.760742 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650180    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650183    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650186    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650188    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650191    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650194    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650196    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650199    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650202    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650204    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650206    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650209    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650211    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650214    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650217    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650220    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650222    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650225    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650228    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650231    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:21:37.761713 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650233    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650235    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650240    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650244    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650247    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650250    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650252    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650255    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650259    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650262    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650265    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650267    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650270    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650273    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650277    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650280    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650283    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650285    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650288    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:21:37.765044 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650291    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650293    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650296    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650299    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650301    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650304    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650307    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650310    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650312    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650315    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650318    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650320    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650323    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650325    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650328    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650330    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650333    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650336    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650339    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650342    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:21:37.766061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650344    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650347    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650349    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650352    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650354    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650357    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650359    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650361    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650364    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650367    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650369    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650375    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650378    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650382    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650385    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650388    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650391    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650394    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650397    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:21:37.768897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650400    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650403    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650776    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650781    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650784    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650787    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650790    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650793    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650796    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650799    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650802    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650805    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650808    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650811    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650814    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650817    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650819    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650822    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650824    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650827    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:21:37.769960 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650829    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650832    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650835    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650837    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650842    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650861    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650867    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650870    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650873    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650876    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650879    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650882    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650885    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650887    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650892    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650895    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650899    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650902    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650905    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:21:37.773650 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650908    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650911    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650914    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650917    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650921    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650924    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650926    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650929    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650932    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650935    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650938    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650942    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650944    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650947    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650949    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650952    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650954    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650959    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650962    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650964    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:21:37.774602 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650967    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650970    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650972    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650975    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650978    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650982    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650985    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650987    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.650990    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651009    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651012    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651015    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651018    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651021    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651024    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651027    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651031    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651034    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651037    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:21:37.864055 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651040    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651042    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651045    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651047    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651050    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651052    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651054    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651057    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651059    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651062    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651066    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651068    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651071    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651074    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651076    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651079    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651081    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651084    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651087    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651089    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:21:37.864688 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651091    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651094    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651096    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651172    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651179    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651186    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651191    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651195    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651200    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651209    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651215    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651221    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651224    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651228    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651231    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651234    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651237    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651240    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651243    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651246    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651249    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651252    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651256    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651259    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 12 08:21:37.867523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651263    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651266    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651270    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651273    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651276    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651279    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651282    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651285    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651288    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651291    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651294    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651298    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651301    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651304    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651307    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651310    2583 flags.go:64] FLAG: --enable-server="true"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651313    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651323    2583 flags.go:64] FLAG: --event-burst="100"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651326    2583 flags.go:64] FLAG: --event-qps="50"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651329    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651338    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651341    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651345    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651348    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651350    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 12 08:21:37.868199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651354    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651356    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651359    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651362    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651365    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651369    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651372    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651375    2583 flags.go:64] FLAG: --feature-gates=""
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651378    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651419    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651428    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651432    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651436    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651440    2583 flags.go:64] FLAG: --help="false"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651444    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-136-78.ec2.internal"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651448    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651451    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651455    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651458    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651462    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651465    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651468    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651471    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 12 08:21:37.870940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651474    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651477    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651480    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651483    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651487    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651490    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651494    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651496    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651500    2583 flags.go:64] FLAG: --lock-file=""
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651502    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651506    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651509    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651519    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651522    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651525    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651528    2583 flags.go:64] FLAG: --logging-format="text"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651531    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651535    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651538    2583 flags.go:64] FLAG: --manifest-url=""
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651542    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651550    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651553    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651558    2583 flags.go:64] FLAG: --max-pods="110"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651561    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651564    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 12 08:21:37.871963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651567    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651570    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651573    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651576    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651579    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651590    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651593    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651596    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651599    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651602    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651608    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651611    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651614    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651617    2583 flags.go:64] FLAG: --port="10250"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651620    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651623    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d0b9e65a45c1a72c"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651626    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651630    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651633    2583 flags.go:64] FLAG: --register-node="true"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651635    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651640    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651643    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651646    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651648    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651652    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 12 08:21:37.875858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651655    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651658    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651662    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651665    2583 flags.go:64] FLAG: --runonce="false"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651668    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651671    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651674    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651677    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651680    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651683    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651685    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651688    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651691    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651694    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651697    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651700    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651703    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651706    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651708    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651715    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651718    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651721    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651728    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651733    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651736    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 12 08:21:37.876873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651739    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651742    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651746    2583 flags.go:64] FLAG: --v="2"
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651750    2583 flags.go:64] FLAG: --version="false"
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651754    2583 flags.go:64] FLAG: --vmodule=""
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651758    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.651761    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651905    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651911    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651915    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651919    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651923    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651926    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651929    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651932    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651934    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651937    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651940    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651942    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651945    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651947    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:21:37.881353 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651950    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651952    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651955    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651957    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651960    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651963    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651965    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651968    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651970    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651974    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651976    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651979    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651982    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651986    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651989    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651991    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651994    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651996    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.651999    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652002    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:21:37.882120 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652004    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652007    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652010    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652012    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652015    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652017    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652020    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652023    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652025    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652028    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652030    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652034    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652038    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652040    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652044    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652047    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652049    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652052    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652055    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:21:37.885221 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652058    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652060    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652064    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652068    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652071    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652073    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652077    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652080    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652082    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652084    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652087    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652090    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652092    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652095    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652098    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652100    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652104    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652106    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652109    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652111    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:21:37.886043 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652114    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652117    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652119    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652122    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652124    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652128    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652132    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652135    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652137    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652140    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652143    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652145    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652148    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652151    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652154    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652157    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652160    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652162    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652166    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:21:37.888707 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652168    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652171    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652173    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652176    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652179    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652182    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.652184    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.652685    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.660229    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.660246    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.660873    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.660880    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660938    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660944    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660947    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:21:37.889469 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660950    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660953    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660957    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660960    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660963    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660966    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660969    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660972    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660975    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660978    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660981    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660984    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660988    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660993    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660996    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.660999    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661003    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661006    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661009    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661012    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:21:37.893274 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661014    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661017    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661020    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661022    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661027    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661030    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661033    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661036    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661039    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661042    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661045    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661047    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661050    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661054    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661057    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661060    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661062    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661065    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661068    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:21:37.894023 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661070    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661073    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661076    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661078    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661081    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661084    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661089    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661091    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661094    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661098    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661100    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661103    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661106    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661109    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661112    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661116    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661119    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661122    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661124    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661127    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:21:37.987768 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661130    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661132    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661135    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661137    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661139    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661142    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661144    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661147    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661149    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661159    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661162    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661164    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661167    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661169    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661172    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661174    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661177    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661180    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661185    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:21:37.988489 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661189    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661192    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661196    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661198    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661201    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661204    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661206    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661209    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661212    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661214    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661217    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661219    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661222    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661225    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661227    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661230    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661232    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:21:37.989244 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661235    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.661240    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661356    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661360    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661365    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661369    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661372    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661374    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661378    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661380    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661383    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661386    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661388    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661391    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:21:37.993292 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661394    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661397    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661400    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661405    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661408    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661411    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661414    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661416    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661419    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661422    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661424    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661427    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661429    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661432    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661434    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661437    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661439    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661442    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661444    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661447    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:21:37.994374 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661449    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661452    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661454    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661457    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661459    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661462    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661464    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661467    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661469    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661472    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661474    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661477    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661479    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661483    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661486    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661490    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661492    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661495    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661497    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661500    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:21:37.995117 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661502    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661505    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661507    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661510    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661512    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661515    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661517    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661520    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661522    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661525    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661527    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661530    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661532    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661535    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661537    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661540    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661542    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661544    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661547    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661549    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:21:37.997332 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661552    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661554    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661557    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661559    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661562    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661566    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661568    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661573    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661576    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661578    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661582    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661584    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661587    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661589    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661591    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661594    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661597    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661599    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661601    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:21:37.998061 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661604    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661608    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661611    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661614    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661617    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661620    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661623    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:37.661626    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.661631    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.661737    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.663774    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.664928    2583 server.go:1019] "Starting client certificate rotation"
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.665027    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 08:21:38.000982 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.665068    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 08:21:38.001355 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.667118    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 08:21:38.001355 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.671268    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 08:21:38.001355 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.679483    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 12 08:21:38.001355 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.681584    2583 log.go:25] "Validated CRI v1 image API"
Jul 12 08:21:38.001355 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.685108    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 12 08:21:38.001355 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.687320    2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cb1ae78a-28c4-4db7-bb36-d5eaa880b946:/dev/nvme0n1p4 d8992f4b-848d-4ff0-a682-608ff322bd25:/dev/nvme0n1p3]
Jul 12 08:21:38.001355 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.687334    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.692148    2583 manager.go:216] Machine: {Timestamp:2026-07-12 08:21:37.690969252 +0000 UTC m=+0.270427721 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103999 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d58f919cab12259f90e1f89e3c71a SystemUUID:ec2d58f9-19ca-b122-59f9-0e1f89e3c71a BootID:2486d7e6-ea48-409b-bbdd-84cb72ce9703 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c1:5b:ac:db:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c1:5b:ac:db:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:f6:62:8f:5e:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.692245    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.692320    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.695190    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.695221    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.695906    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.695915    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.695923    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.696487    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.697928    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.700604    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.701873    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.702000    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.702027    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.702037    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.702051    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 12 08:21:38.092269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.702061    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.702069    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.702437    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.702459    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.704792    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.708468    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.708513    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.708683    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.708705    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.708714    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.708732    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.708744    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.708760    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.709144    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.709537    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.709551    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.709559    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.709579    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.709589    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.710216    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.710223    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.713273    2583 server.go:1268] "Started kubelet"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.713354    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.713369    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.713438    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.714573    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.715449    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.720450    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.720463    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:37.720546    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.720765    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2wn5x"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.720999    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721017    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721047    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721125    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721136    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:37.721328    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721392    2583 factory.go:55] Registering systemd factory
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721406    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721637    2583 factory.go:153] Registering CRI-O factory
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721651    2583 factory.go:223] Registration of the crio container factory successfully
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721699    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721719    2583 factory.go:103] Registering Raw factory
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.721734    2583 manager.go:1196] Started watching for new ooms in manager
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.722414    2583 manager.go:349] Starting recovery of all containers
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.727793    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2wn5x"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.733446    2583 manager.go:354] Recovery completed
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.739518    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.741546    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.741575    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.741589    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.742167    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 12 08:21:38.099966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.742177    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.742183    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.742196    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.742933    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.742961    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.742976    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.744249    2583 policy_none.go:49] "None policy: Start"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.744269    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.744282    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:37.746309    2583 policy_none.go:47] "Start"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:37.820636    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:37.920904    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.101780 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.021202    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.199891 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.121592    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.222517 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.222477    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.230668 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.230620    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 12 08:21:38.230770 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.230685    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 12 08:21:38.230827 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.230777    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 12 08:21:38.231476 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.231448    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 12 08:21:38.231476 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.231451    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 12 08:21:38.231919 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.230977    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-78.ec2.internal.18c17d1e94bbb146  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-78.ec2.internal,UID:ip-10-0-136-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-78.ec2.internal,},FirstTimestamp:2026-07-12 08:21:37.713246534 +0000 UTC m=+0.292705003,LastTimestamp:2026-07-12 08:21:37.713246534 +0000 UTC m=+0.292705003,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-78.ec2.internal,}"
Jul 12 08:21:38.253607 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.253589    2583 manager.go:337] "Starting Device Plugin manager"
Jul 12 08:21:38.253684 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.253628    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 12 08:21:38.253684 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.253642    2583 server.go:87] "Starting device plugin registration server"
Jul 12 08:21:38.253971 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.253953    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 12 08:21:38.254163 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.253972    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 12 08:21:38.254163 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.254091    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 12 08:21:38.254272 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.254200    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 12 08:21:38.254272 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.254213    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 12 08:21:38.254813 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.254793    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 12 08:21:38.254883 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.254842    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.356459 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.356426    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:21:38.358712 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.357636    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:21:38.358712 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.357677    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:21:38.358712 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.357688    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:21:38.358712 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.357714    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.360302 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.360281    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 12 08:21:38.361652 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.361633    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 12 08:21:38.361749 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.361680    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 12 08:21:38.361749 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.361708    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 12 08:21:38.361857 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.361750    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 12 08:21:38.364121 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.364100    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 08:21:38.366274 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.366258    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.366350 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.366279    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-78.ec2.internal\": node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.410535 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.410513    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.462764 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.462684    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal"]
Jul 12 08:21:38.462902 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.462768    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:21:38.463962 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.463943    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:21:38.464062 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.463979    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:21:38.464062 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.463995    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:21:38.466529 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.466511    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:21:38.466657 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.466638    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.466727 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.466675    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:21:38.467401 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.467383    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:21:38.467469 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.467417    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:21:38.467469 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.467432    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:21:38.467547 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.467383    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:21:38.467547 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.467493    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:21:38.467547 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.467509    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:21:38.469976 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.469961    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.470058 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.469991    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:21:38.470684 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.470669    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:21:38.470753 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.470695    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:21:38.470753 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.470706    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:21:38.493565 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.493545    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-78.ec2.internal\" not found" node="ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.498328 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.498312    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-78.ec2.internal\" not found" node="ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.510874 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.510847    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.525520 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.525501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fcbee3187c9e819c7a59d0fe5fd1b26c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal\" (UID: \"fcbee3187c9e819c7a59d0fe5fd1b26c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.525601 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.525530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcbee3187c9e819c7a59d0fe5fd1b26c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal\" (UID: \"fcbee3187c9e819c7a59d0fe5fd1b26c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.525601 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.525547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87370b001b85040879f54a70444f0d05-config\") pod \"kube-apiserver-proxy-ip-10-0-136-78.ec2.internal\" (UID: \"87370b001b85040879f54a70444f0d05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.613489 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.613450    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.626811 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.626785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fcbee3187c9e819c7a59d0fe5fd1b26c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal\" (UID: \"fcbee3187c9e819c7a59d0fe5fd1b26c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.626879 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.626818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcbee3187c9e819c7a59d0fe5fd1b26c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal\" (UID: \"fcbee3187c9e819c7a59d0fe5fd1b26c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.626879 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.626836    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87370b001b85040879f54a70444f0d05-config\") pod \"kube-apiserver-proxy-ip-10-0-136-78.ec2.internal\" (UID: \"87370b001b85040879f54a70444f0d05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.626964 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.626892    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87370b001b85040879f54a70444f0d05-config\") pod \"kube-apiserver-proxy-ip-10-0-136-78.ec2.internal\" (UID: \"87370b001b85040879f54a70444f0d05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.626964 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.626898    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fcbee3187c9e819c7a59d0fe5fd1b26c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal\" (UID: \"fcbee3187c9e819c7a59d0fe5fd1b26c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.626964 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.626929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcbee3187c9e819c7a59d0fe5fd1b26c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal\" (UID: \"fcbee3187c9e819c7a59d0fe5fd1b26c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.666326 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.666284    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 12 08:21:38.666861 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.666478    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 08:21:38.714280 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.714216    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.735314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.735282    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 08:16:38 +0000 UTC" deadline="2028-01-01 09:05:33.772538347 +0000 UTC"
Jul 12 08:21:38.735365 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.735309    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12912h43m55.03723207s"
Jul 12 08:21:38.799394 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.799345    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.801673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:38.801658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:38.814711 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.814691    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:38.916493 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:38.916445    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:39.023038 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.022956    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:39.123137 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.123097    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:39.223210 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.223173    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:39.324372 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.324264    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:39.403235 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.403209    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:21:39.405633 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.405612    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:21:39.405754 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.405644    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:21:39.405754 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.405659    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:21:39.424432 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.424404    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-78.ec2.internal\" not found"
Jul 12 08:21:39.431035 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.431019    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 08:21:39.491919 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:39.491391    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcbee3187c9e819c7a59d0fe5fd1b26c.slice/crio-042f1b4513e9c6075332cd52b9318905e6849f9379bb3b7072d86c7906653041 WatchSource:0}: Error finding container 042f1b4513e9c6075332cd52b9318905e6849f9379bb3b7072d86c7906653041: Status 404 returned error can't find the container with id 042f1b4513e9c6075332cd52b9318905e6849f9379bb3b7072d86c7906653041
Jul 12 08:21:39.493837 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.493816    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 08:21:39.500136 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.500121    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:21:39.507360 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:39.507332    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87370b001b85040879f54a70444f0d05.slice/crio-b22bcb1859275537bf493fc13227608e23220f40d80c5b67774ec3dd12e7338d WatchSource:0}: Error finding container b22bcb1859275537bf493fc13227608e23220f40d80c5b67774ec3dd12e7338d: Status 404 returned error can't find the container with id b22bcb1859275537bf493fc13227608e23220f40d80c5b67774ec3dd12e7338d
Jul 12 08:21:39.522135 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.522114    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:39.533898 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.533876    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 08:21:39.534814 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.534801    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal"
Jul 12 08:21:39.545280 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.545263    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 08:21:39.625495 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.625424    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 08:21:39.625597 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.625497    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 08:21:39.705252 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.705219    2583 apiserver.go:52] "Watching apiserver"
Jul 12 08:21:39.712529 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.712499    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 12 08:21:39.714247 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.714225    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-lbm6t","openshift-multus/network-metrics-daemon-2j6ld","openshift-network-operator/iptables-alerter-rrs6f","kube-system/konnectivity-agent-kq8rb","kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal","openshift-image-registry/node-ca-wdt85","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal","openshift-multus/multus-additional-cni-plugins-nd2bw","openshift-network-diagnostics/network-check-target-gtfpz","openshift-ovn-kubernetes/ovnkube-node-nl2br","kube-system/global-pull-secret-syncer-jxwt9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l","openshift-cluster-node-tuning-operator/tuned-m5ggs","openshift-dns/node-resolver-frrv5"]
Jul 12 08:21:39.717277 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.717261    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.719504 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.719487    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:39.719593 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.719552    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:39.720236 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.720204    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 12 08:21:39.720236 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.720218    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 12 08:21:39.720236 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.720222    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 12 08:21:39.720449 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.720222    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 12 08:21:39.720449 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.720219    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 12 08:21:39.720449 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.720383    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mxl4z\""
Jul 12 08:21:39.720864 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.720846    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 12 08:21:39.721539 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.721507    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 12 08:21:39.721808 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.721793    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:39.724332 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.724313    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:21:39.724676 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.724611    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 12 08:21:39.724747 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.724690    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 12 08:21:39.724865 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.724847    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:21:39.725511 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.725334    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x62k4\""
Jul 12 08:21:39.728116 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.727147    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-npj98\""
Jul 12 08:21:39.728116 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.727252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:39.728116 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.727829    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 12 08:21:39.728116 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.727903    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 12 08:21:39.729771 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.729753    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:39.730189 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.730169    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wvnp5\""
Jul 12 08:21:39.730364 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.730351    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 12 08:21:39.730429 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.730409    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 12 08:21:39.731858 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.731842    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c871963b-3941-42fb-8821-8064c666bea6-env-overrides\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.731916 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.731881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c871963b-3941-42fb-8821-8064c666bea6-ovnkube-script-lib\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.731985 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.731917    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-run-openvswitch\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.731985 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.731938    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-run-ovn-kubernetes\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.731985 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.731958    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-cni-bin\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732142 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732002    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e5d8b46-9014-47a7-b528-8ecccd573ce3-host-slash\") pod \"iptables-alerter-rrs6f\" (UID: \"4e5d8b46-9014-47a7-b528-8ecccd573ce3\") " pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:39.732142 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-run-ovn\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732142 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c871963b-3941-42fb-8821-8064c666bea6-ovnkube-config\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732142 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:39.732142 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732114    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-systemd-units\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732142 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-run-systemd\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-etc-openvswitch\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xr9d\" (UniqueName: \"kubernetes.io/projected/c871963b-3941-42fb-8821-8064c666bea6-kube-api-access-2xr9d\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ee8bff8-4db5-4454-987b-3efcfffbddd1-kubelet-config\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-run-netns\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732233    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-log-socket\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732266    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fhmg\" (UniqueName: \"kubernetes.io/projected/4e5d8b46-9014-47a7-b528-8ecccd573ce3-kube-api-access-6fhmg\") pod \"iptables-alerter-rrs6f\" (UID: \"4e5d8b46-9014-47a7-b528-8ecccd573ce3\") " pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732283    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ee8bff8-4db5-4454-987b-3efcfffbddd1-dbus\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732329    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732349    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732362    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-kubelet\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732387    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-slash\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c871963b-3941-42fb-8821-8064c666bea6-ovn-node-metrics-cert\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732439    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 12 08:21:39.732444 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4e5d8b46-9014-47a7-b528-8ecccd573ce3-iptables-alerter-script\") pod \"iptables-alerter-rrs6f\" (UID: \"4e5d8b46-9014-47a7-b528-8ecccd573ce3\") " pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:39.733212 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732440    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 12 08:21:39.733212 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.732461    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:21:39.733212 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732473    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-var-lib-openvswitch\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.733212 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-node-log\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.733212 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-cni-netd\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.733212 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732440    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5vz84\""
Jul 12 08:21:39.733212 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.732561    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 12 08:21:39.734266 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.734247    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 08:21:39.734778 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.734750    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.737183 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.737160    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:21:39.737314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.737295    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:39.737400 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.737378    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:39.737469 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.737452    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ktflc\""
Jul 12 08:21:39.737469 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.737460    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 12 08:21:39.739909 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.739889    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.742350 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.742331    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.742452 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.742422    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 12 08:21:39.742522 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.742333    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mxc8n\""
Jul 12 08:21:39.742777 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.742763    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 12 08:21:39.743098 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.743083    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 12 08:21:39.743169 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.743153    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 12 08:21:39.744795 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.744774    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.745026 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.745003    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 12 08:21:39.745756 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.745736    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6dqx5\""
Jul 12 08:21:39.745844 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.745742    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 12 08:21:39.747466 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.747440    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 12 08:21:39.747576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.747507    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sdhbf\""
Jul 12 08:21:39.747636 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.747602    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 12 08:21:39.747741 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.747722    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 12 08:21:39.759824 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.759807    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vn4mf"
Jul 12 08:21:39.767640 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.767622    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vn4mf"
Jul 12 08:21:39.822006 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.821981    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 12 08:21:39.833173 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-node-log\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.833173 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833173    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c871963b-3941-42fb-8821-8064c666bea6-env-overrides\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.833331 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c871963b-3941-42fb-8821-8064c666bea6-ovnkube-script-lib\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.833331 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f8d79a-5fb6-4aa9-9390-9ba97195452a-tmp-dir\") pod \"node-resolver-frrv5\" (UID: \"91f8d79a-5fb6-4aa9-9390-9ba97195452a\") " pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:39.833331 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833251    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-system-cni-dir\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.833331 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833265    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-node-log\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.833331 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-cni-bin\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.833331 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833298    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e5d8b46-9014-47a7-b528-8ecccd573ce3-host-slash\") pod \"iptables-alerter-rrs6f\" (UID: \"4e5d8b46-9014-47a7-b528-8ecccd573ce3\") " pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:39.833331 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-run\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833344    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-cni-bin\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-sys\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833390    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e5d8b46-9014-47a7-b528-8ecccd573ce3-host-slash\") pod \"iptables-alerter-rrs6f\" (UID: \"4e5d8b46-9014-47a7-b528-8ecccd573ce3\") " pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833403    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-var-lib-kubelet\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-var-lib-cni-multus\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833491    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-os-release\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833532    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-socket-dir-parent\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-conf-dir\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-systemd-units\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833621    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-etc-openvswitch\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr9d\" (UniqueName: \"kubernetes.io/projected/c871963b-3941-42fb-8821-8064c666bea6-kube-api-access-2xr9d\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.833663 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833651    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-systemd-units\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833673    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-systemd\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833706    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-etc-openvswitch\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833708    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91f8d79a-5fb6-4aa9-9390-9ba97195452a-hosts-file\") pod \"node-resolver-frrv5\" (UID: \"91f8d79a-5fb6-4aa9-9390-9ba97195452a\") " pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833749    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-cni-dir\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-daemon-config\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-run-netns\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833819    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c871963b-3941-42fb-8821-8064c666bea6-env-overrides\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-log-socket\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-log-socket\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833902    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-run-netns\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833930    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c871963b-3941-42fb-8821-8064c666bea6-ovnkube-script-lib\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833953    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-sysctl-conf\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.833998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-device-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-etc-selinux\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834074    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ee8bff8-4db5-4454-987b-3efcfffbddd1-dbus\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-tuned\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.834231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbwdw\" (UniqueName: \"kubernetes.io/projected/b85eed6f-96aa-48c8-90dd-f1c621b10bec-kube-api-access-pbwdw\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834238    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d9db5e4-204a-40f2-b622-15c6c10b3119-konnectivity-ca\") pod \"konnectivity-agent-kq8rb\" (UID: \"8d9db5e4-204a-40f2-b622-15c6c10b3119\") " pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834311    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834326    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ee8bff8-4db5-4454-987b-3efcfffbddd1-dbus\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834341    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-var-lib-cni-bin\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-os-release\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-socket-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c871963b-3941-42fb-8821-8064c666bea6-ovn-node-metrics-cert\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-var-lib-kubelet\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834512    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d2ca934-d6db-4d0a-84ef-239138d1e139-cni-binary-copy\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhcc2\" (UniqueName: \"kubernetes.io/projected/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-kube-api-access-qhcc2\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-cni-netd\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834595    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-kubernetes\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.835037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834602    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-cni-netd\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834620    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-cnibin\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-run-openvswitch\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834678    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-run-openvswitch\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834700    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-run-ovn-kubernetes\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d9db5e4-204a-40f2-b622-15c6c10b3119-agent-certs\") pod \"konnectivity-agent-kq8rb\" (UID: \"8d9db5e4-204a-40f2-b622-15c6c10b3119\") " pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834738    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-run-ovn-kubernetes\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834739    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834769    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/226a5392-db4a-451e-b2f3-180ccffb2a91-serviceca\") pod \"node-ca-wdt85\" (UID: \"226a5392-db4a-451e-b2f3-180ccffb2a91\") " pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834787    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-tmp\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lprkl\" (UniqueName: \"kubernetes.io/projected/91f8d79a-5fb6-4aa9-9390-9ba97195452a-kube-api-access-lprkl\") pod \"node-resolver-frrv5\" (UID: \"91f8d79a-5fb6-4aa9-9390-9ba97195452a\") " pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834823    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-hostroot\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834867    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-run-ovn\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834889    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c871963b-3941-42fb-8821-8064c666bea6-ovnkube-config\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834981    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-host\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.834945    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-run-ovn\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.835023    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:39.835658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-run-k8s-cni-cncf-io\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.835106    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret podName:0ee8bff8-4db5-4454-987b-3efcfffbddd1 nodeName:}" failed. No retries permitted until 2026-07-12 08:21:40.335076974 +0000 UTC m=+2.914535436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret") pod "global-pull-secret-syncer-jxwt9" (UID: "0ee8bff8-4db5-4454-987b-3efcfffbddd1") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835134    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-run-systemd\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ee8bff8-4db5-4454-987b-3efcfffbddd1-kubelet-config\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835181    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-run-systemd\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8s22\" (UniqueName: \"kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22\") pod \"network-check-target-gtfpz\" (UID: \"655e833b-1990-4889-807c-bb17379b81ac\") " pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-cnibin\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835243    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ee8bff8-4db5-4454-987b-3efcfffbddd1-kubelet-config\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835255    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-run-multus-certs\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835292    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d2ca934-d6db-4d0a-84ef-239138d1e139-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835325    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c871963b-3941-42fb-8821-8064c666bea6-ovnkube-config\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835325    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-registration-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835376    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-sys-fs\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835395    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fhmg\" (UniqueName: \"kubernetes.io/projected/4e5d8b46-9014-47a7-b528-8ecccd573ce3-kube-api-access-6fhmg\") pod \"iptables-alerter-rrs6f\" (UID: \"4e5d8b46-9014-47a7-b528-8ecccd573ce3\") " pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835502    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-modprobe-d\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-lib-modules\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.836342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-run-netns\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835619    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkg58\" (UniqueName: \"kubernetes.io/projected/da0503a0-bb72-4d84-91c1-bd05920452f2-kube-api-access-jkg58\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d2ca934-d6db-4d0a-84ef-239138d1e139-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpln9\" (UniqueName: \"kubernetes.io/projected/1d2ca934-d6db-4d0a-84ef-239138d1e139-kube-api-access-jpln9\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/226a5392-db4a-451e-b2f3-180ccffb2a91-host\") pod \"node-ca-wdt85\" (UID: \"226a5392-db4a-451e-b2f3-180ccffb2a91\") " pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdgnn\" (UniqueName: \"kubernetes.io/projected/226a5392-db4a-451e-b2f3-180ccffb2a91-kube-api-access-bdgnn\") pod \"node-ca-wdt85\" (UID: \"226a5392-db4a-451e-b2f3-180ccffb2a91\") " pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-etc-kubernetes\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835759    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-sysctl-d\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835823    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-kubelet\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-kubelet\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835849    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-slash\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4e5d8b46-9014-47a7-b528-8ecccd573ce3-iptables-alerter-script\") pod \"iptables-alerter-rrs6f\" (UID: \"4e5d8b46-9014-47a7-b528-8ecccd573ce3\") " pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835903    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-host-slash\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835913    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-sysconfig\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9wq7\" (UniqueName: \"kubernetes.io/projected/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-kube-api-access-r9wq7\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-system-cni-dir\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.836877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835965    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da0503a0-bb72-4d84-91c1-bd05920452f2-cni-binary-copy\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.837403 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.835996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-var-lib-openvswitch\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.837403 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.836084    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c871963b-3941-42fb-8821-8064c666bea6-var-lib-openvswitch\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.837403 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.836295    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4e5d8b46-9014-47a7-b528-8ecccd573ce3-iptables-alerter-script\") pod \"iptables-alerter-rrs6f\" (UID: \"4e5d8b46-9014-47a7-b528-8ecccd573ce3\") " pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:39.837789 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.837771    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c871963b-3941-42fb-8821-8064c666bea6-ovn-node-metrics-cert\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.870014 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.869991    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fhmg\" (UniqueName: \"kubernetes.io/projected/4e5d8b46-9014-47a7-b528-8ecccd573ce3-kube-api-access-6fhmg\") pod \"iptables-alerter-rrs6f\" (UID: \"4e5d8b46-9014-47a7-b528-8ecccd573ce3\") " pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:39.870096 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.870028    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xr9d\" (UniqueName: \"kubernetes.io/projected/c871963b-3941-42fb-8821-8064c666bea6-kube-api-access-2xr9d\") pod \"ovnkube-node-nl2br\" (UID: \"c871963b-3941-42fb-8821-8064c666bea6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:39.936733 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-sysctl-d\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.936733 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936685    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-sysconfig\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.936733 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9wq7\" (UniqueName: \"kubernetes.io/projected/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-kube-api-access-r9wq7\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-system-cni-dir\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da0503a0-bb72-4d84-91c1-bd05920452f2-cni-binary-copy\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-sysconfig\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936794    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f8d79a-5fb6-4aa9-9390-9ba97195452a-tmp-dir\") pod \"node-resolver-frrv5\" (UID: \"91f8d79a-5fb6-4aa9-9390-9ba97195452a\") " pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936836    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-system-cni-dir\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-sysctl-d\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936833    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-system-cni-dir\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936892    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-system-cni-dir\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-run\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936940    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-run\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-sys\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.936999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-var-lib-kubelet\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-var-lib-cni-multus\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937063    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-sys\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937074    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-os-release\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937069    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-var-lib-kubelet\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937104    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-socket-dir-parent\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-conf-dir\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937104    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-var-lib-cni-multus\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937143    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f8d79a-5fb6-4aa9-9390-9ba97195452a-tmp-dir\") pod \"node-resolver-frrv5\" (UID: \"91f8d79a-5fb6-4aa9-9390-9ba97195452a\") " pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937188    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-os-release\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937194    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-conf-dir\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937149    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-systemd\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-systemd\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937149    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-socket-dir-parent\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937233    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91f8d79a-5fb6-4aa9-9390-9ba97195452a-hosts-file\") pod \"node-resolver-frrv5\" (UID: \"91f8d79a-5fb6-4aa9-9390-9ba97195452a\") " pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-cni-dir\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937302    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-daemon-config\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-sysctl-conf\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.937647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937346    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91f8d79a-5fb6-4aa9-9390-9ba97195452a-hosts-file\") pod \"node-resolver-frrv5\" (UID: \"91f8d79a-5fb6-4aa9-9390-9ba97195452a\") " pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-device-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937363    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-cni-dir\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937370    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da0503a0-bb72-4d84-91c1-bd05920452f2-cni-binary-copy\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-etc-selinux\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937422    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-sysctl-conf\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937424    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-device-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-tuned\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbwdw\" (UniqueName: \"kubernetes.io/projected/b85eed6f-96aa-48c8-90dd-f1c621b10bec-kube-api-access-pbwdw\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d9db5e4-204a-40f2-b622-15c6c10b3119-konnectivity-ca\") pod \"konnectivity-agent-kq8rb\" (UID: \"8d9db5e4-204a-40f2-b622-15c6c10b3119\") " pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937536    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-etc-selinux\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937559    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937638    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.937814    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937875    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-var-lib-cni-bin\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937909    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-var-lib-cni-bin\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.938396 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.937926    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs podName:b85eed6f-96aa-48c8-90dd-f1c621b10bec nodeName:}" failed. No retries permitted until 2026-07-12 08:21:40.437902952 +0000 UTC m=+3.017361420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs") pod "network-metrics-daemon-2j6ld" (UID: "b85eed6f-96aa-48c8-90dd-f1c621b10bec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-os-release\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.937968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-socket-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-var-lib-kubelet\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d2ca934-d6db-4d0a-84ef-239138d1e139-cni-binary-copy\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhcc2\" (UniqueName: \"kubernetes.io/projected/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-kube-api-access-qhcc2\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938077    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-var-lib-kubelet\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938079    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-os-release\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-kubernetes\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-cnibin\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d9db5e4-204a-40f2-b622-15c6c10b3119-agent-certs\") pod \"konnectivity-agent-kq8rb\" (UID: \"8d9db5e4-204a-40f2-b622-15c6c10b3119\") " pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938163    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d9db5e4-204a-40f2-b622-15c6c10b3119-konnectivity-ca\") pod \"konnectivity-agent-kq8rb\" (UID: \"8d9db5e4-204a-40f2-b622-15c6c10b3119\") " pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938190    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-socket-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/226a5392-db4a-451e-b2f3-180ccffb2a91-serviceca\") pod \"node-ca-wdt85\" (UID: \"226a5392-db4a-451e-b2f3-180ccffb2a91\") " pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938239    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-cnibin\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-tmp\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lprkl\" (UniqueName: \"kubernetes.io/projected/91f8d79a-5fb6-4aa9-9390-9ba97195452a-kube-api-access-lprkl\") pod \"node-resolver-frrv5\" (UID: \"91f8d79a-5fb6-4aa9-9390-9ba97195452a\") " pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:39.939314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938333    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-hostroot\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938404    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-kubernetes\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-host\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938603    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-run-k8s-cni-cncf-io\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938632    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8s22\" (UniqueName: \"kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22\") pod \"network-check-target-gtfpz\" (UID: \"655e833b-1990-4889-807c-bb17379b81ac\") " pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938647    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-hostroot\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-cnibin\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938663    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da0503a0-bb72-4d84-91c1-bd05920452f2-multus-daemon-config\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938699    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d2ca934-d6db-4d0a-84ef-239138d1e139-cni-binary-copy\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938709    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-run-multus-certs\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d2ca934-d6db-4d0a-84ef-239138d1e139-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-run-multus-certs\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938794    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-registration-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-host\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938851    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-sys-fs\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-modprobe-d\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-cnibin\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-lib-modules\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.940150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-run-netns\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-run-k8s-cni-cncf-io\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.938999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkg58\" (UniqueName: \"kubernetes.io/projected/da0503a0-bb72-4d84-91c1-bd05920452f2-kube-api-access-jkg58\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939004    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-registration-dir\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939016    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-sys-fs\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d2ca934-d6db-4d0a-84ef-239138d1e139-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939085    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-host-run-netns\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpln9\" (UniqueName: \"kubernetes.io/projected/1d2ca934-d6db-4d0a-84ef-239138d1e139-kube-api-access-jpln9\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939102    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-lib-modules\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939096    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-modprobe-d\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/226a5392-db4a-451e-b2f3-180ccffb2a91-host\") pod \"node-ca-wdt85\" (UID: \"226a5392-db4a-451e-b2f3-180ccffb2a91\") " pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939286    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdgnn\" (UniqueName: \"kubernetes.io/projected/226a5392-db4a-451e-b2f3-180ccffb2a91-kube-api-access-bdgnn\") pod \"node-ca-wdt85\" (UID: \"226a5392-db4a-451e-b2f3-180ccffb2a91\") " pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-etc-kubernetes\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939321    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/226a5392-db4a-451e-b2f3-180ccffb2a91-host\") pod \"node-ca-wdt85\" (UID: \"226a5392-db4a-451e-b2f3-180ccffb2a91\") " pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939323    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d2ca934-d6db-4d0a-84ef-239138d1e139-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939402    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da0503a0-bb72-4d84-91c1-bd05920452f2-etc-kubernetes\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.940729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939541    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d2ca934-d6db-4d0a-84ef-239138d1e139-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.941288 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939647    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d2ca934-d6db-4d0a-84ef-239138d1e139-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.941288 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.939829    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/226a5392-db4a-451e-b2f3-180ccffb2a91-serviceca\") pod \"node-ca-wdt85\" (UID: \"226a5392-db4a-451e-b2f3-180ccffb2a91\") " pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:39.941288 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.940219    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-etc-tuned\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.941288 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.941218    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-tmp\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.941421 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.941291    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d9db5e4-204a-40f2-b622-15c6c10b3119-agent-certs\") pod \"konnectivity-agent-kq8rb\" (UID: \"8d9db5e4-204a-40f2-b622-15c6c10b3119\") " pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:21:39.948172 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.948123    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9wq7\" (UniqueName: \"kubernetes.io/projected/83a98b38-2c5d-48bb-9bae-b7c39cb70e4e-kube-api-access-r9wq7\") pod \"tuned-m5ggs\" (UID: \"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e\") " pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:39.948877 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.948839    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:21:39.948877 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.948863    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:21:39.948877 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.948877    2583 projected.go:196] Error preparing data for projected volume kube-api-access-c8s22 for pod openshift-network-diagnostics/network-check-target-gtfpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:39.949117 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:39.948996    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22 podName:655e833b-1990-4889-807c-bb17379b81ac nodeName:}" failed. No retries permitted until 2026-07-12 08:21:40.448977121 +0000 UTC m=+3.028435578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c8s22" (UniqueName: "kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22") pod "network-check-target-gtfpz" (UID: "655e833b-1990-4889-807c-bb17379b81ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:39.949191 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.949160    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbwdw\" (UniqueName: \"kubernetes.io/projected/b85eed6f-96aa-48c8-90dd-f1c621b10bec-kube-api-access-pbwdw\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:39.950302 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.950283    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhcc2\" (UniqueName: \"kubernetes.io/projected/17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db-kube-api-access-qhcc2\") pod \"aws-ebs-csi-driver-node-rct8l\" (UID: \"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:39.950771 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.950742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpln9\" (UniqueName: \"kubernetes.io/projected/1d2ca934-d6db-4d0a-84ef-239138d1e139-kube-api-access-jpln9\") pod \"multus-additional-cni-plugins-nd2bw\" (UID: \"1d2ca934-d6db-4d0a-84ef-239138d1e139\") " pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:39.951042 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.951023    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdgnn\" (UniqueName: \"kubernetes.io/projected/226a5392-db4a-451e-b2f3-180ccffb2a91-kube-api-access-bdgnn\") pod \"node-ca-wdt85\" (UID: \"226a5392-db4a-451e-b2f3-180ccffb2a91\") " pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:39.951155 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.951140    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkg58\" (UniqueName: \"kubernetes.io/projected/da0503a0-bb72-4d84-91c1-bd05920452f2-kube-api-access-jkg58\") pod \"multus-lbm6t\" (UID: \"da0503a0-bb72-4d84-91c1-bd05920452f2\") " pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:39.951213 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:39.951193    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lprkl\" (UniqueName: \"kubernetes.io/projected/91f8d79a-5fb6-4aa9-9390-9ba97195452a-kube-api-access-lprkl\") pod \"node-resolver-frrv5\" (UID: \"91f8d79a-5fb6-4aa9-9390-9ba97195452a\") " pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:40.029288 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.029254    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:21:40.038024 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.038001    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrs6f"
Jul 12 08:21:40.042343 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:40.042313    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc871963b_3941_42fb_8821_8064c666bea6.slice/crio-53719fb5b04129c9a520031138fedc70b49f651ef65cc00cf0110f82eea3d636 WatchSource:0}: Error finding container 53719fb5b04129c9a520031138fedc70b49f651ef65cc00cf0110f82eea3d636: Status 404 returned error can't find the container with id 53719fb5b04129c9a520031138fedc70b49f651ef65cc00cf0110f82eea3d636
Jul 12 08:21:40.044306 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.044290    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:21:40.047191 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:40.047169    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e5d8b46_9014_47a7_b528_8ecccd573ce3.slice/crio-c5f14312c7e4f3c141342a9f6e3c97f613885494a9b010f14f489dc4c75ef4c8 WatchSource:0}: Error finding container c5f14312c7e4f3c141342a9f6e3c97f613885494a9b010f14f489dc4c75ef4c8: Status 404 returned error can't find the container with id c5f14312c7e4f3c141342a9f6e3c97f613885494a9b010f14f489dc4c75ef4c8
Jul 12 08:21:40.050062 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.050032    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-frrv5"
Jul 12 08:21:40.053747 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:40.053719    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d9db5e4_204a_40f2_b622_15c6c10b3119.slice/crio-9137e6d26e23ed704af5105cab276631175756b95138f77cfd6062f7742d85ac WatchSource:0}: Error finding container 9137e6d26e23ed704af5105cab276631175756b95138f77cfd6062f7742d85ac: Status 404 returned error can't find the container with id 9137e6d26e23ed704af5105cab276631175756b95138f77cfd6062f7742d85ac
Jul 12 08:21:40.055160 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.055126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wdt85"
Jul 12 08:21:40.062528 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.062507    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m5ggs"
Jul 12 08:21:40.067241 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.067220    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lbm6t"
Jul 12 08:21:40.067991 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:40.067951    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f8d79a_5fb6_4aa9_9390_9ba97195452a.slice/crio-9852b39e198702d84f369746b90396dfc1eeb951a8b1ec4bed9b1c926b9bfea5 WatchSource:0}: Error finding container 9852b39e198702d84f369746b90396dfc1eeb951a8b1ec4bed9b1c926b9bfea5: Status 404 returned error can't find the container with id 9852b39e198702d84f369746b90396dfc1eeb951a8b1ec4bed9b1c926b9bfea5
Jul 12 08:21:40.071908 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:40.071886    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226a5392_db4a_451e_b2f3_180ccffb2a91.slice/crio-cbf93bb6c4bb29141c0835ccb6c012441830547f85d7d3687bf7d2a6964950dc WatchSource:0}: Error finding container cbf93bb6c4bb29141c0835ccb6c012441830547f85d7d3687bf7d2a6964950dc: Status 404 returned error can't find the container with id cbf93bb6c4bb29141c0835ccb6c012441830547f85d7d3687bf7d2a6964950dc
Jul 12 08:21:40.075082 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.075025    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nd2bw"
Jul 12 08:21:40.077361 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:40.077337    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a98b38_2c5d_48bb_9bae_b7c39cb70e4e.slice/crio-713c856de89066212d237f820078223377b1bf88e52c4679dd93d0bd1ccf7a93 WatchSource:0}: Error finding container 713c856de89066212d237f820078223377b1bf88e52c4679dd93d0bd1ccf7a93: Status 404 returned error can't find the container with id 713c856de89066212d237f820078223377b1bf88e52c4679dd93d0bd1ccf7a93
Jul 12 08:21:40.079752 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.079731    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l"
Jul 12 08:21:40.081049 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:40.081026    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda0503a0_bb72_4d84_91c1_bd05920452f2.slice/crio-3c349c4fa0d5ce25a1d83d1be9196dff5ed1a3918e476e750a135a4954a9d71c WatchSource:0}: Error finding container 3c349c4fa0d5ce25a1d83d1be9196dff5ed1a3918e476e750a135a4954a9d71c: Status 404 returned error can't find the container with id 3c349c4fa0d5ce25a1d83d1be9196dff5ed1a3918e476e750a135a4954a9d71c
Jul 12 08:21:40.092730 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:21:40.092706    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f2d22b_e9dc_4c7d_9acc_b53a18cfa5db.slice/crio-72f5f31a5c0face543a04dc6e62b971006312d339a893c6f8680293522ba7be3 WatchSource:0}: Error finding container 72f5f31a5c0face543a04dc6e62b971006312d339a893c6f8680293522ba7be3: Status 404 returned error can't find the container with id 72f5f31a5c0face543a04dc6e62b971006312d339a893c6f8680293522ba7be3
Jul 12 08:21:40.343804 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.343682    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:40.344000 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:40.343848    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:40.344000 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:40.343935    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret podName:0ee8bff8-4db5-4454-987b-3efcfffbddd1 nodeName:}" failed. No retries permitted until 2026-07-12 08:21:41.343915461 +0000 UTC m=+3.923373920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret") pod "global-pull-secret-syncer-jxwt9" (UID: "0ee8bff8-4db5-4454-987b-3efcfffbddd1") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:40.367933 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.367853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l" event={"ID":"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db","Type":"ContainerStarted","Data":"72f5f31a5c0face543a04dc6e62b971006312d339a893c6f8680293522ba7be3"}
Jul 12 08:21:40.369413 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.369388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lbm6t" event={"ID":"da0503a0-bb72-4d84-91c1-bd05920452f2","Type":"ContainerStarted","Data":"3c349c4fa0d5ce25a1d83d1be9196dff5ed1a3918e476e750a135a4954a9d71c"}
Jul 12 08:21:40.370710 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.370687    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wdt85" event={"ID":"226a5392-db4a-451e-b2f3-180ccffb2a91","Type":"ContainerStarted","Data":"cbf93bb6c4bb29141c0835ccb6c012441830547f85d7d3687bf7d2a6964950dc"}
Jul 12 08:21:40.371923 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.371903    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-frrv5" event={"ID":"91f8d79a-5fb6-4aa9-9390-9ba97195452a","Type":"ContainerStarted","Data":"9852b39e198702d84f369746b90396dfc1eeb951a8b1ec4bed9b1c926b9bfea5"}
Jul 12 08:21:40.373148 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.373122    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal" event={"ID":"fcbee3187c9e819c7a59d0fe5fd1b26c","Type":"ContainerStarted","Data":"042f1b4513e9c6075332cd52b9318905e6849f9379bb3b7072d86c7906653041"}
Jul 12 08:21:40.374604 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.374556    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nd2bw" event={"ID":"1d2ca934-d6db-4d0a-84ef-239138d1e139","Type":"ContainerStarted","Data":"9b99c23a1b3abaf58d4d47c6eed7c9cfd82776d731f246aa1d1873ba9b8c8c0e"}
Jul 12 08:21:40.375992 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.375965    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m5ggs" event={"ID":"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e","Type":"ContainerStarted","Data":"713c856de89066212d237f820078223377b1bf88e52c4679dd93d0bd1ccf7a93"}
Jul 12 08:21:40.377215 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.377192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kq8rb" event={"ID":"8d9db5e4-204a-40f2-b622-15c6c10b3119","Type":"ContainerStarted","Data":"9137e6d26e23ed704af5105cab276631175756b95138f77cfd6062f7742d85ac"}
Jul 12 08:21:40.378544 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.378512    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrs6f" event={"ID":"4e5d8b46-9014-47a7-b528-8ecccd573ce3","Type":"ContainerStarted","Data":"c5f14312c7e4f3c141342a9f6e3c97f613885494a9b010f14f489dc4c75ef4c8"}
Jul 12 08:21:40.379804 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.379777    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" event={"ID":"c871963b-3941-42fb-8821-8064c666bea6","Type":"ContainerStarted","Data":"53719fb5b04129c9a520031138fedc70b49f651ef65cc00cf0110f82eea3d636"}
Jul 12 08:21:40.381048 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.381026    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal" event={"ID":"87370b001b85040879f54a70444f0d05","Type":"ContainerStarted","Data":"b22bcb1859275537bf493fc13227608e23220f40d80c5b67774ec3dd12e7338d"}
Jul 12 08:21:40.444867 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.444826    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:40.445024 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:40.444970    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:40.445108 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:40.445040    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs podName:b85eed6f-96aa-48c8-90dd-f1c621b10bec nodeName:}" failed. No retries permitted until 2026-07-12 08:21:41.445021025 +0000 UTC m=+4.024479482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs") pod "network-metrics-daemon-2j6ld" (UID: "b85eed6f-96aa-48c8-90dd-f1c621b10bec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:40.545953 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.545588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8s22\" (UniqueName: \"kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22\") pod \"network-check-target-gtfpz\" (UID: \"655e833b-1990-4889-807c-bb17379b81ac\") " pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:40.545953 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:40.545772    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:21:40.545953 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:40.545795    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:21:40.545953 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:40.545808    2583 projected.go:196] Error preparing data for projected volume kube-api-access-c8s22 for pod openshift-network-diagnostics/network-check-target-gtfpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:40.545953 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:40.545896    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22 podName:655e833b-1990-4889-807c-bb17379b81ac nodeName:}" failed. No retries permitted until 2026-07-12 08:21:41.545876306 +0000 UTC m=+4.125334768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8s22" (UniqueName: "kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22") pod "network-check-target-gtfpz" (UID: "655e833b-1990-4889-807c-bb17379b81ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:40.771724 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.771595    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 08:16:40 +0000 UTC" deadline="2028-01-01 10:39:16.240488931 +0000 UTC"
Jul 12 08:21:40.771724 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:40.771662    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12914h17m35.468831783s"
Jul 12 08:21:41.353696 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:41.353659    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:41.353903 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.353845    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:41.354032 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.353931    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret podName:0ee8bff8-4db5-4454-987b-3efcfffbddd1 nodeName:}" failed. No retries permitted until 2026-07-12 08:21:43.353910553 +0000 UTC m=+5.933369029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret") pod "global-pull-secret-syncer-jxwt9" (UID: "0ee8bff8-4db5-4454-987b-3efcfffbddd1") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:41.362372 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:41.362342    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:41.362528 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.362501    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:41.362617 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:41.362602    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:41.362708 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.362687    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:41.362808 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:41.362793    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:41.362898 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.362877    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:21:41.455126 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:41.455065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:41.455308 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.455215    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:41.455308 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.455289    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs podName:b85eed6f-96aa-48c8-90dd-f1c621b10bec nodeName:}" failed. No retries permitted until 2026-07-12 08:21:43.455269166 +0000 UTC m=+6.034727626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs") pod "network-metrics-daemon-2j6ld" (UID: "b85eed6f-96aa-48c8-90dd-f1c621b10bec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:41.555661 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:41.555619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8s22\" (UniqueName: \"kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22\") pod \"network-check-target-gtfpz\" (UID: \"655e833b-1990-4889-807c-bb17379b81ac\") " pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:41.555915 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.555879    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:21:41.556015 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.555923    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:21:41.556015 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.555938    2583 projected.go:196] Error preparing data for projected volume kube-api-access-c8s22 for pod openshift-network-diagnostics/network-check-target-gtfpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:41.556015 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:41.556001    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22 podName:655e833b-1990-4889-807c-bb17379b81ac nodeName:}" failed. No retries permitted until 2026-07-12 08:21:43.555982153 +0000 UTC m=+6.135440616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8s22" (UniqueName: "kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22") pod "network-check-target-gtfpz" (UID: "655e833b-1990-4889-807c-bb17379b81ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:41.772195 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:41.772095    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 08:16:40 +0000 UTC" deadline="2028-02-14 08:47:29.621536457 +0000 UTC"
Jul 12 08:21:41.772195 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:41.772143    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13968h25m47.849398113s"
Jul 12 08:21:43.362276 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:43.361979    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:43.362276 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:43.361998    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:43.362802 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:43.362027    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:43.362802 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.362468    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:43.363037 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.362939    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:43.363037 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.363028    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:21:43.373229 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:43.372922    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:43.373229 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.373131    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:43.373229 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.373205    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret podName:0ee8bff8-4db5-4454-987b-3efcfffbddd1 nodeName:}" failed. No retries permitted until 2026-07-12 08:21:47.37318547 +0000 UTC m=+9.952643927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret") pod "global-pull-secret-syncer-jxwt9" (UID: "0ee8bff8-4db5-4454-987b-3efcfffbddd1") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:43.474215 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:43.474174    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:43.474470 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.474360    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:43.474470 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.474429    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs podName:b85eed6f-96aa-48c8-90dd-f1c621b10bec nodeName:}" failed. No retries permitted until 2026-07-12 08:21:47.474409809 +0000 UTC m=+10.053868270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs") pod "network-metrics-daemon-2j6ld" (UID: "b85eed6f-96aa-48c8-90dd-f1c621b10bec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:43.575235 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:43.574611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8s22\" (UniqueName: \"kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22\") pod \"network-check-target-gtfpz\" (UID: \"655e833b-1990-4889-807c-bb17379b81ac\") " pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:43.575235 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.574771    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:21:43.575235 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.574792    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:21:43.575235 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.574804    2583 projected.go:196] Error preparing data for projected volume kube-api-access-c8s22 for pod openshift-network-diagnostics/network-check-target-gtfpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:43.575235 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:43.574890    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22 podName:655e833b-1990-4889-807c-bb17379b81ac nodeName:}" failed. No retries permitted until 2026-07-12 08:21:47.574869573 +0000 UTC m=+10.154328065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8s22" (UniqueName: "kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22") pod "network-check-target-gtfpz" (UID: "655e833b-1990-4889-807c-bb17379b81ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:45.362310 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:45.362275    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:45.362800 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:45.362318    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:45.362800 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:45.362420    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:45.362941 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:45.362911    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:45.363004 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:45.362973    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:45.363059 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:45.363045    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:21:47.362679 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:47.362647    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:47.363165 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.362792    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:47.363165 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:47.362965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:47.363165 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.363093    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:47.363165 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:47.363128    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:47.363386 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.363205    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:21:47.408913 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:47.408774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:47.409081 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.408939    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:47.409081 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.409006    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret podName:0ee8bff8-4db5-4454-987b-3efcfffbddd1 nodeName:}" failed. No retries permitted until 2026-07-12 08:21:55.408985007 +0000 UTC m=+17.988443480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret") pod "global-pull-secret-syncer-jxwt9" (UID: "0ee8bff8-4db5-4454-987b-3efcfffbddd1") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:47.510018 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:47.509974    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:47.510186 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.510113    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:47.510186 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.510180    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs podName:b85eed6f-96aa-48c8-90dd-f1c621b10bec nodeName:}" failed. No retries permitted until 2026-07-12 08:21:55.510160369 +0000 UTC m=+18.089618824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs") pod "network-metrics-daemon-2j6ld" (UID: "b85eed6f-96aa-48c8-90dd-f1c621b10bec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:47.610727 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:47.610678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8s22\" (UniqueName: \"kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22\") pod \"network-check-target-gtfpz\" (UID: \"655e833b-1990-4889-807c-bb17379b81ac\") " pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:47.610967 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.610817    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:21:47.610967 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.610834    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:21:47.610967 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.610859    2583 projected.go:196] Error preparing data for projected volume kube-api-access-c8s22 for pod openshift-network-diagnostics/network-check-target-gtfpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:47.610967 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:47.610921    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22 podName:655e833b-1990-4889-807c-bb17379b81ac nodeName:}" failed. No retries permitted until 2026-07-12 08:21:55.610902042 +0000 UTC m=+18.190360502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8s22" (UniqueName: "kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22") pod "network-check-target-gtfpz" (UID: "655e833b-1990-4889-807c-bb17379b81ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:49.362257 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:49.362222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:49.362257 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:49.362262    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:49.362781 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:49.362221    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:49.362781 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:49.362361    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:49.362781 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:49.362420    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:21:49.362781 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:49.362483    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:51.362038 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:51.362006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:51.362038 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:51.362030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:51.362506 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:51.362006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:51.362506 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:51.362122    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:51.362506 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:51.362201    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:21:51.362506 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:51.362294    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:53.362869 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:53.362817    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:53.363309 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:53.362818    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:53.363309 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:53.362945    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:53.363309 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:53.363030    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:21:53.363309 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:53.362818    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:53.363309 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:53.363139    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:55.361965 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:55.361927    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:55.361965 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:55.361953    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:55.362369 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:55.361966    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:55.362369 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.362033    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:21:55.362369 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.362117    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:55.362369 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.362164    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:55.473833 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:55.473789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:55.474099 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.473942    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:55.474099 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.474011    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret podName:0ee8bff8-4db5-4454-987b-3efcfffbddd1 nodeName:}" failed. No retries permitted until 2026-07-12 08:22:11.473996292 +0000 UTC m=+34.053454752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret") pod "global-pull-secret-syncer-jxwt9" (UID: "0ee8bff8-4db5-4454-987b-3efcfffbddd1") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:21:55.575091 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:55.574997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:55.575267 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.575168    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:55.575267 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.575247    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs podName:b85eed6f-96aa-48c8-90dd-f1c621b10bec nodeName:}" failed. No retries permitted until 2026-07-12 08:22:11.575226802 +0000 UTC m=+34.154685272 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs") pod "network-metrics-daemon-2j6ld" (UID: "b85eed6f-96aa-48c8-90dd-f1c621b10bec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:21:55.675861 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:55.675814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8s22\" (UniqueName: \"kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22\") pod \"network-check-target-gtfpz\" (UID: \"655e833b-1990-4889-807c-bb17379b81ac\") " pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:55.676035 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.675963    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:21:55.676035 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.675980    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:21:55.676035 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.675990    2583 projected.go:196] Error preparing data for projected volume kube-api-access-c8s22 for pod openshift-network-diagnostics/network-check-target-gtfpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:55.676211 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:55.676041    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22 podName:655e833b-1990-4889-807c-bb17379b81ac nodeName:}" failed. No retries permitted until 2026-07-12 08:22:11.67602736 +0000 UTC m=+34.255485819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8s22" (UniqueName: "kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22") pod "network-check-target-gtfpz" (UID: "655e833b-1990-4889-807c-bb17379b81ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:21:57.362337 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:57.362267    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:57.362779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:57.362368    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:57.362779 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:57.362372    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:57.362779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:57.362384    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:57.362779 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:57.362468    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:21:57.362779 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:57.362559    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:59.362259 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:59.362221    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:21:59.362715 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:59.362227    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:21:59.362715 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:59.362388    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:21:59.362715 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:21:59.362234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:21:59.362715 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:59.362450    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:21:59.362715 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:21:59.362490    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:00.435368 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.434869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lbm6t" event={"ID":"da0503a0-bb72-4d84-91c1-bd05920452f2","Type":"ContainerStarted","Data":"154f1626db84baa988d16c1c1a728fc98a5436977c2d432d0786e60a62ceb178"}
Jul 12 08:22:00.437072 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.436974    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m5ggs" event={"ID":"83a98b38-2c5d-48bb-9bae-b7c39cb70e4e","Type":"ContainerStarted","Data":"d0f3c833f49ac34a4a81b058d555a4635026e70a71e526f4884e237a61198717"}
Jul 12 08:22:00.439457 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.439441    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:22:00.439776 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.439758    2583 generic.go:356] "Generic (PLEG): container finished" podID="c871963b-3941-42fb-8821-8064c666bea6" containerID="f0351a852e89505541e56c3543178b4827b619f7267256ba5edad04f9439952c" exitCode=1
Jul 12 08:22:00.439841 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.439828    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" event={"ID":"c871963b-3941-42fb-8821-8064c666bea6","Type":"ContainerStarted","Data":"f12d755df59d8663a466cab49031e5b23a102300c452652195681412e1cb35cb"}
Jul 12 08:22:00.439987 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.439903    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" event={"ID":"c871963b-3941-42fb-8821-8064c666bea6","Type":"ContainerDied","Data":"f0351a852e89505541e56c3543178b4827b619f7267256ba5edad04f9439952c"}
Jul 12 08:22:00.439987 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.439948    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" event={"ID":"c871963b-3941-42fb-8821-8064c666bea6","Type":"ContainerStarted","Data":"5ec3d5aaf690fea5857c5526d1deccde7865391e5133c0ec852bb7c935ed9704"}
Jul 12 08:22:00.441326 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.441305    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal" event={"ID":"87370b001b85040879f54a70444f0d05","Type":"ContainerStarted","Data":"01bde9a6f32dcd05f2b3315cd420755a1ad39048e8802d1b6eb7c19a0e2e2e05"}
Jul 12 08:22:00.470396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.470356    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m5ggs" podStartSLOduration=2.694000973 podStartE2EDuration="22.470343356s" totalImagesPullingTime="19.776342383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:00.470336442 +0000 UTC m=+23.049794920" watchObservedRunningTime="2026-07-12 08:22:00.470343356 +0000 UTC m=+23.049801840"
Jul 12 08:22:00.470526 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.470477    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lbm6t" podStartSLOduration=2.426446024 podStartE2EDuration="22.470471719s" totalImagesPullingTime="20.044025695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:00.452723751 +0000 UTC m=+23.032182230" watchObservedRunningTime="2026-07-12 08:22:00.470471719 +0000 UTC m=+23.049930195"
Jul 12 08:22:00.486158 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:00.486121    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-78.ec2.internal" podStartSLOduration=21.486109336 podStartE2EDuration="21.486109336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:00.485966048 +0000 UTC m=+23.065424536" watchObservedRunningTime="2026-07-12 08:22:00.486109336 +0000 UTC m=+23.065567811"
Jul 12 08:22:01.362455 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.362285    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:01.362619 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.362310    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:01.362619 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:01.362562    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:01.362619 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.362310    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:01.362782 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:01.362644    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:01.362782 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:01.362741    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:01.445484 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.445389    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wdt85" event={"ID":"226a5392-db4a-451e-b2f3-180ccffb2a91","Type":"ContainerStarted","Data":"9da53af331b4a77d94e579b4ec3f7bef4f7e775d8da01147f2ea3addd4558741"}
Jul 12 08:22:01.447086 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.447033    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-frrv5" event={"ID":"91f8d79a-5fb6-4aa9-9390-9ba97195452a","Type":"ContainerStarted","Data":"78fbf2ebf27ce4736206eda1308e5b2bf8f838b2d13cd5ca01d1e32481f3aded"}
Jul 12 08:22:01.448771 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.448743    2583 generic.go:356] "Generic (PLEG): container finished" podID="fcbee3187c9e819c7a59d0fe5fd1b26c" containerID="cf04e4bebb3d6889620a5d509f7f4d1084fcae67e4ed4e96d816f9ff0f7dc4a7" exitCode=0
Jul 12 08:22:01.448894 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.448819    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal" event={"ID":"fcbee3187c9e819c7a59d0fe5fd1b26c","Type":"ContainerDied","Data":"cf04e4bebb3d6889620a5d509f7f4d1084fcae67e4ed4e96d816f9ff0f7dc4a7"}
Jul 12 08:22:01.450588 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.450552    2583 generic.go:356] "Generic (PLEG): container finished" podID="1d2ca934-d6db-4d0a-84ef-239138d1e139" containerID="ae05d5973297d2c1e22c416179d20efd2172f83f8084df975d093b1d9af96a3c" exitCode=0
Jul 12 08:22:01.450691 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.450603    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nd2bw" event={"ID":"1d2ca934-d6db-4d0a-84ef-239138d1e139","Type":"ContainerDied","Data":"ae05d5973297d2c1e22c416179d20efd2172f83f8084df975d093b1d9af96a3c"}
Jul 12 08:22:01.452366 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.452329    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kq8rb" event={"ID":"8d9db5e4-204a-40f2-b622-15c6c10b3119","Type":"ContainerStarted","Data":"68a7ae7cda6dfe4f43b7a46e38bf873c10c02b38a4f45d0fe8b22fe2598c0c8f"}
Jul 12 08:22:01.454089 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.454048    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrs6f" event={"ID":"4e5d8b46-9014-47a7-b528-8ecccd573ce3","Type":"ContainerStarted","Data":"34c4e00da645e61b5212e90be48a6e8b232e291aed6edcda39dc96b413f6f7f4"}
Jul 12 08:22:01.457317 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.457290    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:22:01.457750 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.457715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" event={"ID":"c871963b-3941-42fb-8821-8064c666bea6","Type":"ContainerStarted","Data":"94305f212b63f56dab68898a89461a36b961e40a7eb0fbee512d6975f1f22e23"}
Jul 12 08:22:01.457843 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.457789    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" event={"ID":"c871963b-3941-42fb-8821-8064c666bea6","Type":"ContainerStarted","Data":"df05f287d9492fce6529b7487a603f52b1deb9e837034d6736a84bd28b515ff3"}
Jul 12 08:22:01.457843 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.457838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" event={"ID":"c871963b-3941-42fb-8821-8064c666bea6","Type":"ContainerStarted","Data":"90dacde9e5c525e0fdea3db70677799746fc34de001da3103e5c3fc22977050e"}
Jul 12 08:22:01.459375 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.459350    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l" event={"ID":"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db","Type":"ContainerStarted","Data":"272ef2e7ae0253fcbb3ce1f8216f5aad36169677c4a69c7f1c0bf07883363900"}
Jul 12 08:22:01.459905 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.459860    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wdt85" podStartSLOduration=12.316861628 podStartE2EDuration="23.4598292s" totalImagesPullingTime="11.142967572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:01.459339018 +0000 UTC m=+24.038797497" watchObservedRunningTime="2026-07-12 08:22:01.4598292 +0000 UTC m=+24.039287680"
Jul 12 08:22:01.491963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.491924    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rrs6f" podStartSLOduration=3.706520833 podStartE2EDuration="23.491915775s" totalImagesPullingTime="19.785394942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:01.491751682 +0000 UTC m=+24.071210159" watchObservedRunningTime="2026-07-12 08:22:01.491915775 +0000 UTC m=+24.071374253"
Jul 12 08:22:01.506452 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.506414    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kq8rb" podStartSLOduration=3.705995631 podStartE2EDuration="23.50640518s" totalImagesPullingTime="19.800409549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:01.505946025 +0000 UTC m=+24.085404503" watchObservedRunningTime="2026-07-12 08:22:01.50640518 +0000 UTC m=+24.085863658"
Jul 12 08:22:01.537161 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.537123    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-frrv5" podStartSLOduration=8.297660407 podStartE2EDuration="23.537111335s" totalImagesPullingTime="15.239450928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:01.537038885 +0000 UTC m=+24.116497363" watchObservedRunningTime="2026-07-12 08:22:01.537111335 +0000 UTC m=+24.116569812"
Jul 12 08:22:01.926945 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:01.926908    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 12 08:22:02.267724 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:02.267562    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T08:22:01.926927777Z","UUID":"5646816f-bdf2-4d63-8d1a-8ee9215ef0c2","Handler":null,"Name":"","Endpoint":""}
Jul 12 08:22:02.269096 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:02.269071    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 12 08:22:02.269222 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:02.269110    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 12 08:22:02.464263 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:02.464198    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal" event={"ID":"fcbee3187c9e819c7a59d0fe5fd1b26c","Type":"ContainerStarted","Data":"faf33b25432f4d44720114e987b37d0ed75f8fbc8daa4ed59f09ac5530cbe086"}
Jul 12 08:22:02.466651 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:02.466598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l" event={"ID":"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db","Type":"ContainerStarted","Data":"7bbaa48fb3ef623027086ce0150420ec7751b7bbd5fac9da709fc8eee9bdad7c"}
Jul 12 08:22:02.483634 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:02.483586    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-78.ec2.internal" podStartSLOduration=23.483569356 podStartE2EDuration="23.483569356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:02.483334201 +0000 UTC m=+25.062792694" watchObservedRunningTime="2026-07-12 08:22:02.483569356 +0000 UTC m=+25.063027836"
Jul 12 08:22:02.619131 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:02.619053    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:22:02.619866 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:02.619833    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:22:02.869661 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:02.869585    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-frrv5_91f8d79a-5fb6-4aa9-9390-9ba97195452a/dns-node-resolver/0.log"
Jul 12 08:22:03.362350 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:03.362320    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:03.362513 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:03.362354    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:03.362513 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:03.362356    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:03.362513 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:03.362455    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:03.362655 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:03.362533    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:03.362655 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:03.362585    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:03.471568 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:03.471506    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:22:03.471992 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:03.471844    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" event={"ID":"c871963b-3941-42fb-8821-8064c666bea6","Type":"ContainerStarted","Data":"fa3c696f81fdb40df847f149e82c0fe657b74449378fbf19689b4d9c6eae27c9"}
Jul 12 08:22:03.473684 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:03.473653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l" event={"ID":"17f2d22b-e9dc-4c7d-9acc-b53a18cfa5db","Type":"ContainerStarted","Data":"91c3e2361be109031e20b7d6b5b153b94ea2abdb7ce757f3d900440bb7fcd6c3"}
Jul 12 08:22:04.244884 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:04.244680    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wdt85_226a5392-db4a-451e-b2f3-180ccffb2a91/node-ca/0.log"
Jul 12 08:22:04.476078 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:04.476054    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 12 08:22:05.362078 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:05.362004    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:05.362237 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:05.362017    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:05.362237 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:05.362126    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:05.362237 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:05.362017    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:05.362400 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:05.362231    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:05.362400 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:05.362316    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:06.482172 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:06.481936    2583 generic.go:356] "Generic (PLEG): container finished" podID="1d2ca934-d6db-4d0a-84ef-239138d1e139" containerID="d47690920dd592f24fdb232f491c40f0ae2efd21b0687397ba41dc90f4d30a3a" exitCode=0
Jul 12 08:22:06.482172 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:06.482016    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nd2bw" event={"ID":"1d2ca934-d6db-4d0a-84ef-239138d1e139","Type":"ContainerDied","Data":"d47690920dd592f24fdb232f491c40f0ae2efd21b0687397ba41dc90f4d30a3a"}
Jul 12 08:22:06.485870 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:06.485839    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:22:06.486207 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:06.486184    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" event={"ID":"c871963b-3941-42fb-8821-8064c666bea6","Type":"ContainerStarted","Data":"20290c3d876614e128494b90e0332146a39e4a0f2438f6c69f2e051c9b1f8033"}
Jul 12 08:22:06.486449 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:06.486432    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:22:06.486599 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:06.486583    2583 scope.go:117] "RemoveContainer" containerID="f0351a852e89505541e56c3543178b4827b619f7267256ba5edad04f9439952c"
Jul 12 08:22:06.502233 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:06.502213    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:22:06.508388 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:06.508347    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rct8l" podStartSLOduration=6.270758548 podStartE2EDuration="28.508334274s" totalImagesPullingTime="22.237575726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:03.491295103 +0000 UTC m=+26.070753592" watchObservedRunningTime="2026-07-12 08:22:06.508334274 +0000 UTC m=+29.087792752"
Jul 12 08:22:07.362057 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.362021    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:07.362057 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.362062    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:07.362382 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.362063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:07.362382 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:07.362142    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:07.362382 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:07.362215    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:07.362382 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:07.362291    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:07.491575 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.491548    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:22:07.492016 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.491891    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" event={"ID":"c871963b-3941-42fb-8821-8064c666bea6","Type":"ContainerStarted","Data":"eb6ae9010f185e5b58507b70b35c8e0a154ccf7cd00fb87acc2dda7037599eb6"}
Jul 12 08:22:07.492119 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.492098    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:22:07.492261 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.492175    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:22:07.507004 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.506981    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:22:07.521736 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.521693    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br" podStartSLOduration=9.643125011 podStartE2EDuration="29.521680602s" totalImagesPullingTime="19.878555591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:07.52137123 +0000 UTC m=+30.100829710" watchObservedRunningTime="2026-07-12 08:22:07.521680602 +0000 UTC m=+30.101139079"
Jul 12 08:22:07.799776 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.799738    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:22:07.799927 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.799906    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 12 08:22:07.800365 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:07.800342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kq8rb"
Jul 12 08:22:08.496088 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:08.496058    2583 generic.go:356] "Generic (PLEG): container finished" podID="1d2ca934-d6db-4d0a-84ef-239138d1e139" containerID="9557478b4b1a7ef5686be1c31d70c3d29251300071a6e8bb42460b23c4b63fde" exitCode=0
Jul 12 08:22:08.496565 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:08.496142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nd2bw" event={"ID":"1d2ca934-d6db-4d0a-84ef-239138d1e139","Type":"ContainerDied","Data":"9557478b4b1a7ef5686be1c31d70c3d29251300071a6e8bb42460b23c4b63fde"}
Jul 12 08:22:09.362481 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:09.362443    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:09.362658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:09.362448    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:09.362658 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:09.362544    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:09.362658 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:09.362636    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:09.362820 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:09.362448    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:09.362820 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:09.362751    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:10.502468 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:10.502430    2583 generic.go:356] "Generic (PLEG): container finished" podID="1d2ca934-d6db-4d0a-84ef-239138d1e139" containerID="5cfd563bd8f31de39b9728e351711830017258a03c9e78ca1ff31763d137ec2d" exitCode=0
Jul 12 08:22:10.502842 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:10.502488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nd2bw" event={"ID":"1d2ca934-d6db-4d0a-84ef-239138d1e139","Type":"ContainerDied","Data":"5cfd563bd8f31de39b9728e351711830017258a03c9e78ca1ff31763d137ec2d"}
Jul 12 08:22:11.362378 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:11.362348    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:11.362564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:11.362397    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:11.362564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:11.362409    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:11.362564 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.362467    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:11.362667 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.362557    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:11.362667 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.362623    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:11.495502 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:11.495469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:11.495637 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.495580    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:22:11.495637 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.495628    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret podName:0ee8bff8-4db5-4454-987b-3efcfffbddd1 nodeName:}" failed. No retries permitted until 2026-07-12 08:22:43.495616009 +0000 UTC m=+66.075074464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret") pod "global-pull-secret-syncer-jxwt9" (UID: "0ee8bff8-4db5-4454-987b-3efcfffbddd1") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:22:11.596382 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:11.596352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:11.596930 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.596475    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:22:11.596930 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.596549    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs podName:b85eed6f-96aa-48c8-90dd-f1c621b10bec nodeName:}" failed. No retries permitted until 2026-07-12 08:22:43.59652933 +0000 UTC m=+66.175987786 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs") pod "network-metrics-daemon-2j6ld" (UID: "b85eed6f-96aa-48c8-90dd-f1c621b10bec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:22:11.697410 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:11.697324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8s22\" (UniqueName: \"kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22\") pod \"network-check-target-gtfpz\" (UID: \"655e833b-1990-4889-807c-bb17379b81ac\") " pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:11.697568 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.697505    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:22:11.697568 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.697532    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:22:11.697568 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.697544    2583 projected.go:196] Error preparing data for projected volume kube-api-access-c8s22 for pod openshift-network-diagnostics/network-check-target-gtfpz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:22:11.697725 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:11.697608    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22 podName:655e833b-1990-4889-807c-bb17379b81ac nodeName:}" failed. No retries permitted until 2026-07-12 08:22:43.697589051 +0000 UTC m=+66.277047522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8s22" (UniqueName: "kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22") pod "network-check-target-gtfpz" (UID: "655e833b-1990-4889-807c-bb17379b81ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:22:13.362207 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:13.362171    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:13.362668 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:13.362226    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:13.362668 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:13.362300    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:13.362668 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:13.362320    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:13.362668 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:13.362400    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:13.362668 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:13.362484    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:15.362641 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:15.362599    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:15.363035 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:15.362657    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:15.363035 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:15.362607    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:15.363035 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:15.362727    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:15.363035 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:15.362776    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:15.363035 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:15.362875    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:15.516801 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:15.516718    2583 generic.go:356] "Generic (PLEG): container finished" podID="1d2ca934-d6db-4d0a-84ef-239138d1e139" containerID="3495a4ac3be2e1c4416ceab5a27eca3cbc712f8e0ae5d3bb6573b879e5c5af3a" exitCode=0
Jul 12 08:22:15.516801 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:15.516783    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nd2bw" event={"ID":"1d2ca934-d6db-4d0a-84ef-239138d1e139","Type":"ContainerDied","Data":"3495a4ac3be2e1c4416ceab5a27eca3cbc712f8e0ae5d3bb6573b879e5c5af3a"}
Jul 12 08:22:16.522263 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:16.522084    2583 generic.go:356] "Generic (PLEG): container finished" podID="1d2ca934-d6db-4d0a-84ef-239138d1e139" containerID="9626e66a4a9de4a06d524376283dc69052eb0645cf71198ea4820b13f2090b20" exitCode=0
Jul 12 08:22:16.522263 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:16.522164    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nd2bw" event={"ID":"1d2ca934-d6db-4d0a-84ef-239138d1e139","Type":"ContainerDied","Data":"9626e66a4a9de4a06d524376283dc69052eb0645cf71198ea4820b13f2090b20"}
Jul 12 08:22:17.362557 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:17.362524    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:17.362557 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:17.362555    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:17.362772 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:17.362523    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:17.362772 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:17.362631    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:17.362772 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:17.362734    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:17.362914 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:17.362808    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:17.528297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:17.528262    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nd2bw" event={"ID":"1d2ca934-d6db-4d0a-84ef-239138d1e139","Type":"ContainerStarted","Data":"4cd015435a8002d7a068bfd92b80a295e81cbcc26d9bcdab931ad64fc65f82df"}
Jul 12 08:22:17.549917 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:17.549842    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nd2bw" podStartSLOduration=8.426415126 podStartE2EDuration="39.549827705s" totalImagesPullingTime="31.123412579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:17.549347035 +0000 UTC m=+40.128805515" watchObservedRunningTime="2026-07-12 08:22:17.549827705 +0000 UTC m=+40.129286183"
Jul 12 08:22:19.362257 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:19.362216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:19.362257 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:19.362258    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:19.362713 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:19.362314    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:19.362713 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:19.362324    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:19.362713 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:19.362406    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:19.362713 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:19.362458    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:21.362110 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:21.362074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:21.362507 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:21.362074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:21.362507 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:21.362195    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:21.362507 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:21.362252    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:21.362507 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:21.362074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:21.362507 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:21.362365    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:23.362417 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:23.362383    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:23.362417 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:23.362408    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:23.363039 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:23.362383    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:23.363039 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:23.362509    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:23.363039 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:23.362606    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:23.363039 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:23.362677    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:25.361982 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:25.361942    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:25.362359 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:25.361993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:25.362359 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:25.362058    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:25.362359 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:25.361993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:25.362359 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:25.362094    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:25.362359 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:25.362161    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:27.362811 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:27.362774    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:27.363297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:27.362783    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:27.363297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:27.362900    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:27.363297 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:27.362899    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:27.363297 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:27.362970    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:27.363297 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:27.363056    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:28.775031 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:28.774997    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jxwt9"]
Jul 12 08:22:28.775833 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:28.775117    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:28.775833 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:28.775246    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:28.779398 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:28.779342    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2j6ld"]
Jul 12 08:22:28.779554 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:28.779473    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:28.779864 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:28.779590    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:28.779864 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:28.779470    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gtfpz"]
Jul 12 08:22:28.779864 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:28.779740    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:28.780042 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:28.779907    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:30.362992 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:30.362899    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:30.362992 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:30.362922    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:30.362992 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:30.362922    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:30.363508 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:30.363024    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:30.363508 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:30.363081    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:30.363508 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:30.363198    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:32.363144 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:32.362953    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:32.363658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:32.362957    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:32.363658 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:32.363229    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfpz" podUID="655e833b-1990-4889-807c-bb17379b81ac"
Jul 12 08:22:32.363658 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:32.363297    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxwt9" podUID="0ee8bff8-4db5-4454-987b-3efcfffbddd1"
Jul 12 08:22:32.363658 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:32.363026    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:32.363658 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:32.363404    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2j6ld" podUID="b85eed6f-96aa-48c8-90dd-f1c621b10bec"
Jul 12 08:22:33.698213 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.698181    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-78.ec2.internal" event="NodeReady"
Jul 12 08:22:33.698650 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.698320    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 12 08:22:33.739476 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.739445    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wg6wn"]
Jul 12 08:22:33.743302 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.743280    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4nqdp"]
Jul 12 08:22:33.743425 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.743404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.745941 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.745903    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 12 08:22:33.745941 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.745920    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9lnkq\""
Jul 12 08:22:33.746121 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.745903    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 12 08:22:33.746121 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.746110    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4nqdp"
Jul 12 08:22:33.748278 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.748256    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 12 08:22:33.748411 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.748399    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 12 08:22:33.748584 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.748568    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x9vpt\""
Jul 12 08:22:33.748629 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.748601    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 12 08:22:33.752067 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.752045    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wg6wn"]
Jul 12 08:22:33.755153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.755134    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4nqdp"]
Jul 12 08:22:33.764729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.764705    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zz8qc"]
Jul 12 08:22:33.767632 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.767614    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.770106 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.770087    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 12 08:22:33.770217 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.770128    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qlrjx\""
Jul 12 08:22:33.770294 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.770245    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 12 08:22:33.770472 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.770451    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 12 08:22:33.771088 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.771062    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 12 08:22:33.777580 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.777554    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zz8qc"]
Jul 12 08:22:33.853248 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c4e6ba3-2696-4312-a489-3e8f80c8759e-config-volume\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.853248 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfjmk\" (UniqueName: \"kubernetes.io/projected/ea3b4eee-35c1-44a6-a21e-2cd9378dc08b-kube-api-access-kfjmk\") pod \"ingress-canary-4nqdp\" (UID: \"ea3b4eee-35c1-44a6-a21e-2cd9378dc08b\") " pod="openshift-ingress-canary/ingress-canary-4nqdp"
Jul 12 08:22:33.853248 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853232    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c4e6ba3-2696-4312-a489-3e8f80c8759e-metrics-tls\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.853513 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxhc8\" (UniqueName: \"kubernetes.io/projected/97ba9557-ae0b-4311-a800-c8aacf79ce00-kube-api-access-bxhc8\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.853513 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853345    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr54p\" (UniqueName: \"kubernetes.io/projected/0c4e6ba3-2696-4312-a489-3e8f80c8759e-kube-api-access-nr54p\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.853513 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ba9557-ae0b-4311-a800-c8aacf79ce00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.853513 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853423    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea3b4eee-35c1-44a6-a21e-2cd9378dc08b-cert\") pod \"ingress-canary-4nqdp\" (UID: \"ea3b4eee-35c1-44a6-a21e-2cd9378dc08b\") " pod="openshift-ingress-canary/ingress-canary-4nqdp"
Jul 12 08:22:33.853513 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ba9557-ae0b-4311-a800-c8aacf79ce00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.853513 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853500    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97ba9557-ae0b-4311-a800-c8aacf79ce00-crio-socket\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.853690 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97ba9557-ae0b-4311-a800-c8aacf79ce00-data-volume\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.853690 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.853540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4e6ba3-2696-4312-a489-3e8f80c8759e-tmp-dir\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.954449 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954419    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea3b4eee-35c1-44a6-a21e-2cd9378dc08b-cert\") pod \"ingress-canary-4nqdp\" (UID: \"ea3b4eee-35c1-44a6-a21e-2cd9378dc08b\") " pod="openshift-ingress-canary/ingress-canary-4nqdp"
Jul 12 08:22:33.954564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954453    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ba9557-ae0b-4311-a800-c8aacf79ce00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.954564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954484    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97ba9557-ae0b-4311-a800-c8aacf79ce00-crio-socket\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.954564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954504    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97ba9557-ae0b-4311-a800-c8aacf79ce00-data-volume\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.954564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4e6ba3-2696-4312-a489-3e8f80c8759e-tmp-dir\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.954564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c4e6ba3-2696-4312-a489-3e8f80c8759e-config-volume\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.954564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfjmk\" (UniqueName: \"kubernetes.io/projected/ea3b4eee-35c1-44a6-a21e-2cd9378dc08b-kube-api-access-kfjmk\") pod \"ingress-canary-4nqdp\" (UID: \"ea3b4eee-35c1-44a6-a21e-2cd9378dc08b\") " pod="openshift-ingress-canary/ingress-canary-4nqdp"
Jul 12 08:22:33.954888 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c4e6ba3-2696-4312-a489-3e8f80c8759e-metrics-tls\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.954888 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97ba9557-ae0b-4311-a800-c8aacf79ce00-crio-socket\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.954888 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxhc8\" (UniqueName: \"kubernetes.io/projected/97ba9557-ae0b-4311-a800-c8aacf79ce00-kube-api-access-bxhc8\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.954888 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr54p\" (UniqueName: \"kubernetes.io/projected/0c4e6ba3-2696-4312-a489-3e8f80c8759e-kube-api-access-nr54p\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.954888 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ba9557-ae0b-4311-a800-c8aacf79ce00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.955094 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954937    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97ba9557-ae0b-4311-a800-c8aacf79ce00-data-volume\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.955094 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.954941    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4e6ba3-2696-4312-a489-3e8f80c8759e-tmp-dir\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.955307 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.955277    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c4e6ba3-2696-4312-a489-3e8f80c8759e-config-volume\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.955410 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.955281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97ba9557-ae0b-4311-a800-c8aacf79ce00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.958794 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.958774    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea3b4eee-35c1-44a6-a21e-2cd9378dc08b-cert\") pod \"ingress-canary-4nqdp\" (UID: \"ea3b4eee-35c1-44a6-a21e-2cd9378dc08b\") " pod="openshift-ingress-canary/ingress-canary-4nqdp"
Jul 12 08:22:33.958794 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.958787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97ba9557-ae0b-4311-a800-c8aacf79ce00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:33.958989 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.958787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c4e6ba3-2696-4312-a489-3e8f80c8759e-metrics-tls\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.962427 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.962400    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfjmk\" (UniqueName: \"kubernetes.io/projected/ea3b4eee-35c1-44a6-a21e-2cd9378dc08b-kube-api-access-kfjmk\") pod \"ingress-canary-4nqdp\" (UID: \"ea3b4eee-35c1-44a6-a21e-2cd9378dc08b\") " pod="openshift-ingress-canary/ingress-canary-4nqdp"
Jul 12 08:22:33.962981 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.962961    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr54p\" (UniqueName: \"kubernetes.io/projected/0c4e6ba3-2696-4312-a489-3e8f80c8759e-kube-api-access-nr54p\") pod \"dns-default-wg6wn\" (UID: \"0c4e6ba3-2696-4312-a489-3e8f80c8759e\") " pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:33.963191 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:33.963173    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxhc8\" (UniqueName: \"kubernetes.io/projected/97ba9557-ae0b-4311-a800-c8aacf79ce00-kube-api-access-bxhc8\") pod \"insights-runtime-extractor-zz8qc\" (UID: \"97ba9557-ae0b-4311-a800-c8aacf79ce00\") " pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:34.054381 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.054345    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:34.061008 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.060735    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4nqdp"
Jul 12 08:22:34.075871 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.075824    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zz8qc"
Jul 12 08:22:34.211137 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.211108    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wg6wn"]
Jul 12 08:22:34.217656 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:34.217624    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4e6ba3_2696_4312_a489_3e8f80c8759e.slice/crio-b9191e1533e1bc70f0755519c034d63783aafeb9cd00e9dad3ec0528af88f9ca WatchSource:0}: Error finding container b9191e1533e1bc70f0755519c034d63783aafeb9cd00e9dad3ec0528af88f9ca: Status 404 returned error can't find the container with id b9191e1533e1bc70f0755519c034d63783aafeb9cd00e9dad3ec0528af88f9ca
Jul 12 08:22:34.224962 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.224933    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4nqdp"]
Jul 12 08:22:34.228767 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:34.228740    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3b4eee_35c1_44a6_a21e_2cd9378dc08b.slice/crio-30450d2f1df4f4a59556b1a83ddc0c0e0e0f063fb2387dc8fe81f7b9f669411c WatchSource:0}: Error finding container 30450d2f1df4f4a59556b1a83ddc0c0e0e0f063fb2387dc8fe81f7b9f669411c: Status 404 returned error can't find the container with id 30450d2f1df4f4a59556b1a83ddc0c0e0e0f063fb2387dc8fe81f7b9f669411c
Jul 12 08:22:34.244454 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.244424    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zz8qc"]
Jul 12 08:22:34.247820 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:34.247793    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ba9557_ae0b_4311_a800_c8aacf79ce00.slice/crio-337ce3672f253d083a7ea815cb071b7debb1c96327e4b8dabc3b70202945038e WatchSource:0}: Error finding container 337ce3672f253d083a7ea815cb071b7debb1c96327e4b8dabc3b70202945038e: Status 404 returned error can't find the container with id 337ce3672f253d083a7ea815cb071b7debb1c96327e4b8dabc3b70202945038e
Jul 12 08:22:34.362985 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.362947    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:34.363193 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.362954    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:34.363193 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.362963    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:34.368079 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.366483    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 08:22:34.368079 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.367105    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 08:22:34.368079 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.367417    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 08:22:34.368079 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.367426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 08:22:34.368079 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.367558    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8cc5r\""
Jul 12 08:22:34.368079 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.367646    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d6mvs\""
Jul 12 08:22:34.570193 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.570091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zz8qc" event={"ID":"97ba9557-ae0b-4311-a800-c8aacf79ce00","Type":"ContainerStarted","Data":"337ce3672f253d083a7ea815cb071b7debb1c96327e4b8dabc3b70202945038e"}
Jul 12 08:22:34.571506 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.571477    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4nqdp" event={"ID":"ea3b4eee-35c1-44a6-a21e-2cd9378dc08b","Type":"ContainerStarted","Data":"30450d2f1df4f4a59556b1a83ddc0c0e0e0f063fb2387dc8fe81f7b9f669411c"}
Jul 12 08:22:34.572873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:34.572799    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wg6wn" event={"ID":"0c4e6ba3-2696-4312-a489-3e8f80c8759e","Type":"ContainerStarted","Data":"b9191e1533e1bc70f0755519c034d63783aafeb9cd00e9dad3ec0528af88f9ca"}
Jul 12 08:22:39.513277 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:39.513194    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nl2br"
Jul 12 08:22:39.589040 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:39.589002    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wg6wn" event={"ID":"0c4e6ba3-2696-4312-a489-3e8f80c8759e","Type":"ContainerStarted","Data":"a0d2737d33ff691975c468fffe339e83299fb96743261d7eb5ebfa964c4a4249"}
Jul 12 08:22:39.590271 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:39.590247    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4nqdp" event={"ID":"ea3b4eee-35c1-44a6-a21e-2cd9378dc08b","Type":"ContainerStarted","Data":"df9e5891bcac927dc3b3dc11f0a6988a9ba5170f9ec70e3eefe286f53065d1d4"}
Jul 12 08:22:39.607793 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:39.607607    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4nqdp" podStartSLOduration=1.570757403 podStartE2EDuration="6.607586052s" totalImagesPullingTime="5.036828649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:39.607142829 +0000 UTC m=+62.186601319" watchObservedRunningTime="2026-07-12 08:22:39.607586052 +0000 UTC m=+62.187044532"
Jul 12 08:22:40.259721 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.259688    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gqslb"]
Jul 12 08:22:40.277685 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.277649    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gqslb"]
Jul 12 08:22:40.277903 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.277784    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.280485 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.280453    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 12 08:22:40.280636 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.280608    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 12 08:22:40.282068 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.280721    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 12 08:22:40.282068 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.281535    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-r7p4p\""
Jul 12 08:22:40.282068 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.281832    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 12 08:22:40.282303 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.282177    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 12 08:22:40.309224 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.309178    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/741b9f63-c233-4752-94ba-f347961a892a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.309402 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.309239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/741b9f63-c233-4752-94ba-f347961a892a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.309402 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.309288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfxrf\" (UniqueName: \"kubernetes.io/projected/741b9f63-c233-4752-94ba-f347961a892a-kube-api-access-kfxrf\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.309402 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.309312    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/741b9f63-c233-4752-94ba-f347961a892a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.410674 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.410642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/741b9f63-c233-4752-94ba-f347961a892a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.410842 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.410687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfxrf\" (UniqueName: \"kubernetes.io/projected/741b9f63-c233-4752-94ba-f347961a892a-kube-api-access-kfxrf\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.410842 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.410712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/741b9f63-c233-4752-94ba-f347961a892a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.410842 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:40.410795    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 12 08:22:40.411043 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:40.410900    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/741b9f63-c233-4752-94ba-f347961a892a-prometheus-operator-tls podName:741b9f63-c233-4752-94ba-f347961a892a nodeName:}" failed. No retries permitted until 2026-07-12 08:22:40.91088221 +0000 UTC m=+63.490340669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/741b9f63-c233-4752-94ba-f347961a892a-prometheus-operator-tls") pod "prometheus-operator-64785b6675-gqslb" (UID: "741b9f63-c233-4752-94ba-f347961a892a") : secret "prometheus-operator-tls" not found
Jul 12 08:22:40.411043 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.410930    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/741b9f63-c233-4752-94ba-f347961a892a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.411508 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.411489    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/741b9f63-c233-4752-94ba-f347961a892a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.413042 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.413025    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/741b9f63-c233-4752-94ba-f347961a892a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.419173 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.419150    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfxrf\" (UniqueName: \"kubernetes.io/projected/741b9f63-c233-4752-94ba-f347961a892a-kube-api-access-kfxrf\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.594815 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.594739    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wg6wn" event={"ID":"0c4e6ba3-2696-4312-a489-3e8f80c8759e","Type":"ContainerStarted","Data":"3a52fa71bed6def1c1df0fc68dc6c4827b9358caa2ac9484042cb6bf01349f40"}
Jul 12 08:22:40.595234 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.595216    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:40.596333 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.596309    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zz8qc" event={"ID":"97ba9557-ae0b-4311-a800-c8aacf79ce00","Type":"ContainerStarted","Data":"7d11bdc677fd81c618cab11a97a9ba4b8be268d9b07c6df1e456708f3bca7604"}
Jul 12 08:22:40.915364 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.915335    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/741b9f63-c233-4752-94ba-f347961a892a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:40.917775 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:40.917746    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/741b9f63-c233-4752-94ba-f347961a892a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gqslb\" (UID: \"741b9f63-c233-4752-94ba-f347961a892a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:41.188548 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:41.188454    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb"
Jul 12 08:22:41.351641 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:41.351579    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wg6wn" podStartSLOduration=3.33291256 podStartE2EDuration="8.351555592s" totalImagesPullingTime="5.018643032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:40.616078924 +0000 UTC m=+63.195537415" watchObservedRunningTime="2026-07-12 08:22:41.351555592 +0000 UTC m=+63.931014071"
Jul 12 08:22:41.352121 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:41.352095    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gqslb"]
Jul 12 08:22:41.355547 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:41.355518    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741b9f63_c233_4752_94ba_f347961a892a.slice/crio-23ef8e4c6d8e4b956f191e808f903fe447a933bfe73cea883e96b175b15ee2f6 WatchSource:0}: Error finding container 23ef8e4c6d8e4b956f191e808f903fe447a933bfe73cea883e96b175b15ee2f6: Status 404 returned error can't find the container with id 23ef8e4c6d8e4b956f191e808f903fe447a933bfe73cea883e96b175b15ee2f6
Jul 12 08:22:41.602416 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:41.602330    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zz8qc" event={"ID":"97ba9557-ae0b-4311-a800-c8aacf79ce00","Type":"ContainerStarted","Data":"8f2c8b7bdbe30bb3c5dbddd3130b8868f4062423c0642f3a6426c71b0f9c587b"}
Jul 12 08:22:41.603612 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:41.603575    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb" event={"ID":"741b9f63-c233-4752-94ba-f347961a892a","Type":"ContainerStarted","Data":"23ef8e4c6d8e4b956f191e808f903fe447a933bfe73cea883e96b175b15ee2f6"}
Jul 12 08:22:43.542971 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.542939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:43.545484 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.545461    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 08:22:43.555962 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.555937    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee8bff8-4db5-4454-987b-3efcfffbddd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxwt9\" (UID: \"0ee8bff8-4db5-4454-987b-3efcfffbddd1\") " pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:43.614034 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.613981    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb" event={"ID":"741b9f63-c233-4752-94ba-f347961a892a","Type":"ContainerStarted","Data":"89fade7e7a669d27385cb0ee259aba30d09189afec22d7010c4c3da2baf275d8"}
Jul 12 08:22:43.614207 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.614118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb" event={"ID":"741b9f63-c233-4752-94ba-f347961a892a","Type":"ContainerStarted","Data":"f36344a5e0ac225d75342a2ae7e2460b9d4be56c3801a2f501b359588298a442"}
Jul 12 08:22:43.620187 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.620131    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zz8qc" event={"ID":"97ba9557-ae0b-4311-a800-c8aacf79ce00","Type":"ContainerStarted","Data":"90a4b5fd07d842f409a56fcd051f3afe6f1b21807c17cc9cee3ef79e66d23239"}
Jul 12 08:22:43.631197 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.631144    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-gqslb" podStartSLOduration=1.5889330689999999 podStartE2EDuration="3.631128851s" totalImagesPullingTime="2.042195782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:43.630875742 +0000 UTC m=+66.210334221" watchObservedRunningTime="2026-07-12 08:22:43.631128851 +0000 UTC m=+66.210587329"
Jul 12 08:22:43.643302 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.643263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:43.645882 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.645844    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 08:22:43.651241 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.651196    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zz8qc" podStartSLOduration=1.642736486 podStartE2EDuration="10.651181527s" totalImagesPullingTime="9.008445041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:22:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:43.650979889 +0000 UTC m=+66.230438378" watchObservedRunningTime="2026-07-12 08:22:43.651181527 +0000 UTC m=+66.230640004"
Jul 12 08:22:43.656033 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.656016    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b85eed6f-96aa-48c8-90dd-f1c621b10bec-metrics-certs\") pod \"network-metrics-daemon-2j6ld\" (UID: \"b85eed6f-96aa-48c8-90dd-f1c621b10bec\") " pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:43.674230 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.674199    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxwt9"
Jul 12 08:22:43.688294 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.688273    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8cc5r\""
Jul 12 08:22:43.696409 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.696372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2j6ld"
Jul 12 08:22:43.744222 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.744187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8s22\" (UniqueName: \"kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22\") pod \"network-check-target-gtfpz\" (UID: \"655e833b-1990-4889-807c-bb17379b81ac\") " pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:43.747275 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.747172    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 08:22:43.758637 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.758402    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 08:22:43.769090 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.769043    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8s22\" (UniqueName: \"kubernetes.io/projected/655e833b-1990-4889-807c-bb17379b81ac-kube-api-access-c8s22\") pod \"network-check-target-gtfpz\" (UID: \"655e833b-1990-4889-807c-bb17379b81ac\") " pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:43.802321 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.802174    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jxwt9"]
Jul 12 08:22:43.804825 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:43.804794    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee8bff8_4db5_4454_987b_3efcfffbddd1.slice/crio-697ed0d2d4cbc8e4567b84bf523c34e41ac6afd63af38f5a4c187d498324317e WatchSource:0}: Error finding container 697ed0d2d4cbc8e4567b84bf523c34e41ac6afd63af38f5a4c187d498324317e: Status 404 returned error can't find the container with id 697ed0d2d4cbc8e4567b84bf523c34e41ac6afd63af38f5a4c187d498324317e
Jul 12 08:22:43.819185 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.819166    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2j6ld"]
Jul 12 08:22:43.821216 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:43.821196    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85eed6f_96aa_48c8_90dd_f1c621b10bec.slice/crio-d0db74fedf9671ac6324006165c38c518913e5216cc8b68c0b18aa1eea5d2d3c WatchSource:0}: Error finding container d0db74fedf9671ac6324006165c38c518913e5216cc8b68c0b18aa1eea5d2d3c: Status 404 returned error can't find the container with id d0db74fedf9671ac6324006165c38c518913e5216cc8b68c0b18aa1eea5d2d3c
Jul 12 08:22:43.982485 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.982414    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d6mvs\""
Jul 12 08:22:43.990377 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:43.990359    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:44.109236 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:44.109209    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gtfpz"]
Jul 12 08:22:44.112441 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:44.112413    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655e833b_1990_4889_807c_bb17379b81ac.slice/crio-1f3f87c754ba131ff3cf9c199ac6f31fe9b0ef8b6bd09d31b16ca03066f1923e WatchSource:0}: Error finding container 1f3f87c754ba131ff3cf9c199ac6f31fe9b0ef8b6bd09d31b16ca03066f1923e: Status 404 returned error can't find the container with id 1f3f87c754ba131ff3cf9c199ac6f31fe9b0ef8b6bd09d31b16ca03066f1923e
Jul 12 08:22:44.625283 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:44.625197    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2j6ld" event={"ID":"b85eed6f-96aa-48c8-90dd-f1c621b10bec","Type":"ContainerStarted","Data":"d0db74fedf9671ac6324006165c38c518913e5216cc8b68c0b18aa1eea5d2d3c"}
Jul 12 08:22:44.626536 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:44.626506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gtfpz" event={"ID":"655e833b-1990-4889-807c-bb17379b81ac","Type":"ContainerStarted","Data":"1f3f87c754ba131ff3cf9c199ac6f31fe9b0ef8b6bd09d31b16ca03066f1923e"}
Jul 12 08:22:44.628383 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:44.628353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jxwt9" event={"ID":"0ee8bff8-4db5-4454-987b-3efcfffbddd1","Type":"ContainerStarted","Data":"697ed0d2d4cbc8e4567b84bf523c34e41ac6afd63af38f5a4c187d498324317e"}
Jul 12 08:22:45.631773 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.631696    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-89bjc"]
Jul 12 08:22:45.635190 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.635153    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2j6ld" event={"ID":"b85eed6f-96aa-48c8-90dd-f1c621b10bec","Type":"ContainerStarted","Data":"52f0177026d12b6b1454404f8beb0f18377b255bcbffa817617fd0bea6068706"}
Jul 12 08:22:45.635350 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.635207    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2j6ld" event={"ID":"b85eed6f-96aa-48c8-90dd-f1c621b10bec","Type":"ContainerStarted","Data":"1781111482fb75c94247504e225e953abb160bafb3553542899cfe0d38da9153"}
Jul 12 08:22:45.635350 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.635211    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.635976 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.635953    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4spxs"]
Jul 12 08:22:45.638366 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.638048    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 12 08:22:45.638366 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.638297    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nlvd2\""
Jul 12 08:22:45.639286 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.639262    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 12 08:22:45.639445 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.639307    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 12 08:22:45.643726 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.643704    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.646477 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.646323    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nhgpz\""
Jul 12 08:22:45.646477 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.646334    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 12 08:22:45.646645 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.646498    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 12 08:22:45.646812 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.646793    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 12 08:22:45.648535 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.648513    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-89bjc"]
Jul 12 08:22:45.678425 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.678364    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2j6ld" podStartSLOduration=66.727847515 podStartE2EDuration="1m7.678343714s" totalImagesPullingTime="950.496199ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:45.676904241 +0000 UTC m=+68.256362720" watchObservedRunningTime="2026-07-12 08:22:45.678343714 +0000 UTC m=+68.257802194"
Jul 12 08:22:45.760015 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.759976    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-accelerators-collector-config\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.760182 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760024    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.760182 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760058    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef721109-271f-4004-9892-ce40a3723c14-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.760182 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-textfile\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.760360 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-wtmp\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.760360 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760249    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-sys\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.760360 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760278    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef721109-271f-4004-9892-ce40a3723c14-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.760517 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.760517 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.760517 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760468    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-root\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.760517 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-metrics-client-ca\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.760712 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760532    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5gnp\" (UniqueName: \"kubernetes.io/projected/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-kube-api-access-x5gnp\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.760712 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6mrr\" (UniqueName: \"kubernetes.io/projected/ef721109-271f-4004-9892-ce40a3723c14-kube-api-access-n6mrr\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.760712 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760586    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-tls\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.760712 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.760622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.861610 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861576    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.861779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.861779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861660    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-root\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.861779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861685    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-metrics-client-ca\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.861779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861713    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5gnp\" (UniqueName: \"kubernetes.io/projected/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-kube-api-access-x5gnp\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.861779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6mrr\" (UniqueName: \"kubernetes.io/projected/ef721109-271f-4004-9892-ce40a3723c14-kube-api-access-n6mrr\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.861779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861755    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-root\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.862094 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-tls\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.862094 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.862094 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861937    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-accelerators-collector-config\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.862094 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.861972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.862094 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862046    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef721109-271f-4004-9892-ce40a3723c14-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.862094 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-textfile\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.862330 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-wtmp\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.862330 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-sys\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.862330 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862155    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef721109-271f-4004-9892-ce40a3723c14-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.862330 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862279    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-metrics-client-ca\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.862478 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862455    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.862590 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862573    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef721109-271f-4004-9892-ce40a3723c14-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.862623 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862601    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-wtmp\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.862866 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862830    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef721109-271f-4004-9892-ce40a3723c14-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.862907 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862835    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-textfile\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.862949 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.862933    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-sys\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.863083 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:45.863064    2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 12 08:22:45.863151 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:22:45.863140    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-tls podName:ef721109-271f-4004-9892-ce40a3723c14 nodeName:}" failed. No retries permitted until 2026-07-12 08:22:46.363118949 +0000 UTC m=+68.942577425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-89bjc" (UID: "ef721109-271f-4004-9892-ce40a3723c14") : secret "kube-state-metrics-tls" not found
Jul 12 08:22:45.863424 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.863365    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-accelerators-collector-config\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.864215 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.864194    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.864478 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.864451    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-node-exporter-tls\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.865049 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.864982    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.871582 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.871540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5gnp\" (UniqueName: \"kubernetes.io/projected/58e09f08-d0ed-4f3e-ae2f-33890ddf223d-kube-api-access-x5gnp\") pod \"node-exporter-4spxs\" (UID: \"58e09f08-d0ed-4f3e-ae2f-33890ddf223d\") " pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.872333 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.872296    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6mrr\" (UniqueName: \"kubernetes.io/projected/ef721109-271f-4004-9892-ce40a3723c14-kube-api-access-n6mrr\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:45.956373 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:45.956341    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4spxs"
Jul 12 08:22:45.970483 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:45.970458    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e09f08_d0ed_4f3e_ae2f_33890ddf223d.slice/crio-9985a4a858695b840af27729aa4ac7ebf51d7df4ef1cf81539a27caef70832bc WatchSource:0}: Error finding container 9985a4a858695b840af27729aa4ac7ebf51d7df4ef1cf81539a27caef70832bc: Status 404 returned error can't find the container with id 9985a4a858695b840af27729aa4ac7ebf51d7df4ef1cf81539a27caef70832bc
Jul 12 08:22:46.366877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:46.366786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:46.369711 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:46.369686    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef721109-271f-4004-9892-ce40a3723c14-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-89bjc\" (UID: \"ef721109-271f-4004-9892-ce40a3723c14\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:46.548258 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:46.548222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc"
Jul 12 08:22:46.643870 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:46.643767    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4spxs" event={"ID":"58e09f08-d0ed-4f3e-ae2f-33890ddf223d","Type":"ContainerStarted","Data":"9985a4a858695b840af27729aa4ac7ebf51d7df4ef1cf81539a27caef70832bc"}
Jul 12 08:22:47.579737 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.579702    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c77f7985d-jwdlg"]
Jul 12 08:22:47.604699 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.604664    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c77f7985d-jwdlg"]
Jul 12 08:22:47.604888 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.604804    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.608510 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.608477    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 12 08:22:47.608986 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.608963    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 12 08:22:47.609106 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.608984    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 12 08:22:47.609307 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.609286    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2gbkm1o96tjba\""
Jul 12 08:22:47.609401 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.609287    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 12 08:22:47.609401 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.609295    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jnnjf\""
Jul 12 08:22:47.609401 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.609315    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 12 08:22:47.679868 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.679815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.680297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.679882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-tls\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.680297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.679934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.680297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.679992    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-grpc-tls\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.680297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.680037    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtcbw\" (UniqueName: \"kubernetes.io/projected/0da482da-fa8d-435d-9921-53cd61678c9d-kube-api-access-qtcbw\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.680297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.680080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.680297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.680100    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.680297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.680197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0da482da-fa8d-435d-9921-53cd61678c9d-metrics-client-ca\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.781585 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.781543    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.781755 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.781596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-tls\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.781755 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.781625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.781755 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.781661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-grpc-tls\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.781755 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.781702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtcbw\" (UniqueName: \"kubernetes.io/projected/0da482da-fa8d-435d-9921-53cd61678c9d-kube-api-access-qtcbw\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.781755 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.781735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.782018 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.781761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.782018 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.781810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0da482da-fa8d-435d-9921-53cd61678c9d-metrics-client-ca\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.782582 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.782554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0da482da-fa8d-435d-9921-53cd61678c9d-metrics-client-ca\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.785179 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.785024    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.785179 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.785026    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.785335 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.785195    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.785335 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.785216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-grpc-tls\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.785335 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.785220    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-tls\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.785335 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.785298    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0da482da-fa8d-435d-9921-53cd61678c9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.789940 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.789919    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtcbw\" (UniqueName: \"kubernetes.io/projected/0da482da-fa8d-435d-9921-53cd61678c9d-kube-api-access-qtcbw\") pod \"thanos-querier-c77f7985d-jwdlg\" (UID: \"0da482da-fa8d-435d-9921-53cd61678c9d\") " pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:47.917093 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:47.917025    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:49.362865 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.362817    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-89bjc"]
Jul 12 08:22:49.365441 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:49.365392    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef721109_271f_4004_9892_ce40a3723c14.slice/crio-f1bb7873a586687624975bcd1faf6c1f53d3b402a1455f8f9d5e8e20fc37f84a WatchSource:0}: Error finding container f1bb7873a586687624975bcd1faf6c1f53d3b402a1455f8f9d5e8e20fc37f84a: Status 404 returned error can't find the container with id f1bb7873a586687624975bcd1faf6c1f53d3b402a1455f8f9d5e8e20fc37f84a
Jul 12 08:22:49.379809 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.379781    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c77f7985d-jwdlg"]
Jul 12 08:22:49.385098 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:49.385064    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da482da_fa8d_435d_9921_53cd61678c9d.slice/crio-15b2ad62352b33f325984e4ec174af63a6f57a93c5ccdf6d727704a6e4ea3ea2 WatchSource:0}: Error finding container 15b2ad62352b33f325984e4ec174af63a6f57a93c5ccdf6d727704a6e4ea3ea2: Status 404 returned error can't find the container with id 15b2ad62352b33f325984e4ec174af63a6f57a93c5ccdf6d727704a6e4ea3ea2
Jul 12 08:22:49.654966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.654934    2583 generic.go:356] "Generic (PLEG): container finished" podID="58e09f08-d0ed-4f3e-ae2f-33890ddf223d" containerID="f2bec581e39fae825230a69cd96950691f2d8fa333cf942689f391f6c4f8391e" exitCode=0
Jul 12 08:22:49.655121 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.655025    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4spxs" event={"ID":"58e09f08-d0ed-4f3e-ae2f-33890ddf223d","Type":"ContainerDied","Data":"f2bec581e39fae825230a69cd96950691f2d8fa333cf942689f391f6c4f8391e"}
Jul 12 08:22:49.656301 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.656279    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg" event={"ID":"0da482da-fa8d-435d-9921-53cd61678c9d","Type":"ContainerStarted","Data":"15b2ad62352b33f325984e4ec174af63a6f57a93c5ccdf6d727704a6e4ea3ea2"}
Jul 12 08:22:49.657740 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.657716    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jxwt9" event={"ID":"0ee8bff8-4db5-4454-987b-3efcfffbddd1","Type":"ContainerStarted","Data":"eebe05d4e1942f80b6f70a2dce5572bed75d5cd57fe6071057fea8a0e09bc70a"}
Jul 12 08:22:49.658867 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.658830    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc" event={"ID":"ef721109-271f-4004-9892-ce40a3723c14","Type":"ContainerStarted","Data":"f1bb7873a586687624975bcd1faf6c1f53d3b402a1455f8f9d5e8e20fc37f84a"}
Jul 12 08:22:49.660434 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.660411    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gtfpz" event={"ID":"655e833b-1990-4889-807c-bb17379b81ac","Type":"ContainerStarted","Data":"1cbe9c2592438d988e9c6607a698edb340b3c4c7b9f43afe2aae823ede7952c2"}
Jul 12 08:22:49.660541 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.660521    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:22:49.688256 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.688119    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jxwt9" podStartSLOduration=66.294780577 podStartE2EDuration="1m11.688102926s" totalImagesPullingTime="5.393322349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:49.687733878 +0000 UTC m=+72.267192360" watchObservedRunningTime="2026-07-12 08:22:49.688102926 +0000 UTC m=+72.267561401"
Jul 12 08:22:49.701497 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.701459    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gtfpz" podStartSLOduration=66.604740854 podStartE2EDuration="1m11.701447093s" totalImagesPullingTime="5.096706239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:49.701135626 +0000 UTC m=+72.280594105" watchObservedRunningTime="2026-07-12 08:22:49.701447093 +0000 UTC m=+72.280905570"
Jul 12 08:22:49.909280 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.909204    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"]
Jul 12 08:22:49.912169 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.912153    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:49.914899 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.914872    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 12 08:22:49.915011 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.914935    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9t5s2\""
Jul 12 08:22:49.915011 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.914936    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 12 08:22:49.915011 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.914990    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 12 08:22:49.915011 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.914944    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 12 08:22:49.915266 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.915250    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dr6q8fv0ru13s\""
Jul 12 08:22:49.922647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:49.922622    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"]
Jul 12 08:22:50.001348 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.001313    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-audit-log\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.001348 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.001351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.001585 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.001381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-secret-metrics-server-tls\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.001585 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.001477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-secret-metrics-server-client-certs\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.001585 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.001510    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-metrics-server-audit-profiles\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.001696 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.001583    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-client-ca-bundle\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.001696 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.001608    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-799rs\" (UniqueName: \"kubernetes.io/projected/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-kube-api-access-799rs\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.102031 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.101990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.102031 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.102039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-secret-metrics-server-tls\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.102282 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.102077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-secret-metrics-server-client-certs\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.102282 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.102101    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-metrics-server-audit-profiles\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.102282 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.102151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-client-ca-bundle\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.102282 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.102177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-799rs\" (UniqueName: \"kubernetes.io/projected/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-kube-api-access-799rs\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.102282 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.102222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-audit-log\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.103327 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.102625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-audit-log\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.103327 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.102899    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.103327 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.103284    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-metrics-server-audit-profiles\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.105375 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.105350    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-client-ca-bundle\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.105480 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.105395    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-secret-metrics-server-tls\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.105480 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.105445    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-secret-metrics-server-client-certs\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.109834 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.109812    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-799rs\" (UniqueName: \"kubernetes.io/projected/a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f-kube-api-access-799rs\") pod \"metrics-server-59c4c8ddcf-7mtsq\" (UID: \"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f\") " pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.225411 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.225375    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:22:50.389474 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.389436    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"]
Jul 12 08:22:50.393673 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:50.393642    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94a97d2_c1a1_4cf0_9b10_12f9e50dcd8f.slice/crio-74995ecb25e67eab3068b5e8e3bf453708085c83487bdba2126575dc1307a39c WatchSource:0}: Error finding container 74995ecb25e67eab3068b5e8e3bf453708085c83487bdba2126575dc1307a39c: Status 404 returned error can't find the container with id 74995ecb25e67eab3068b5e8e3bf453708085c83487bdba2126575dc1307a39c
Jul 12 08:22:50.668674 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.668536    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4spxs" event={"ID":"58e09f08-d0ed-4f3e-ae2f-33890ddf223d","Type":"ContainerStarted","Data":"6cbba9b2f05359f7e8870f63ef00f38595e1fb8e9bb9d97420a0d129e252b00e"}
Jul 12 08:22:50.668674 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.668615    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4spxs" event={"ID":"58e09f08-d0ed-4f3e-ae2f-33890ddf223d","Type":"ContainerStarted","Data":"79a8edc9081a9cf6207be4f52828074740bc996e9b816522a1c3da32e25e6175"}
Jul 12 08:22:50.670433 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.670321    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq" event={"ID":"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f","Type":"ContainerStarted","Data":"74995ecb25e67eab3068b5e8e3bf453708085c83487bdba2126575dc1307a39c"}
Jul 12 08:22:50.688682 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:50.688629    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4spxs" podStartSLOduration=2.386363465 podStartE2EDuration="5.688612892s" totalImagesPullingTime="3.226965118s" totalInitContainerRuntime="75.284309ms" isStatefulPod=true podCreationTimestamp="2026-07-12 08:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:50.688018837 +0000 UTC m=+73.267477339" watchObservedRunningTime="2026-07-12 08:22:50.688612892 +0000 UTC m=+73.268071427"
Jul 12 08:22:51.322159 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.322076    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dfd9565cf-g2kxs"]
Jul 12 08:22:51.325527 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.325492    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.329734 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.329701    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 12 08:22:51.330821 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.330798    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 12 08:22:51.331329 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.331309    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 12 08:22:51.331578 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.331517    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 12 08:22:51.331639 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.331587    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 12 08:22:51.331699 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.331652    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 12 08:22:51.332090 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.332072    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 12 08:22:51.332381 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.332353    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-65qxs\""
Jul 12 08:22:51.342527 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.342292    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 12 08:22:51.353242 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.353178    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfd9565cf-g2kxs"]
Jul 12 08:22:51.413432 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.413394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-config\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.413920 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.413461    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-oauth-serving-cert\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.413920 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.413505    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-oauth-config\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.413920 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.413533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdnvn\" (UniqueName: \"kubernetes.io/projected/0c91c753-4ab0-4ebb-a61b-92a051b463ea-kube-api-access-gdnvn\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.413920 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.413574    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-serving-cert\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.413920 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.413598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-trusted-ca-bundle\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.413920 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.413628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-service-ca\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.514810 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.514763    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-oauth-serving-cert\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.515353 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.515304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-oauth-config\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.515474 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.515373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdnvn\" (UniqueName: \"kubernetes.io/projected/0c91c753-4ab0-4ebb-a61b-92a051b463ea-kube-api-access-gdnvn\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.515474 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.515426    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-serving-cert\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.515474 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.515452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-trusted-ca-bundle\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.515618 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.515489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-service-ca\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.515618 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.515542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-config\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.515715 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.515643    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-oauth-serving-cert\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.516877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.516783    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-service-ca\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.516877 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.516862    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-trusted-ca-bundle\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.517718 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.517429    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-config\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.518175 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.518146    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-oauth-config\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.519342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.519319    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-serving-cert\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.524084 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.524044    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdnvn\" (UniqueName: \"kubernetes.io/projected/0c91c753-4ab0-4ebb-a61b-92a051b463ea-kube-api-access-gdnvn\") pod \"console-5dfd9565cf-g2kxs\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") " pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.611198 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.611119    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wg6wn"
Jul 12 08:22:51.643550 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.642997    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:22:51.680449 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.680409    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc" event={"ID":"ef721109-271f-4004-9892-ce40a3723c14","Type":"ContainerStarted","Data":"10c21a524e83fc98f79796d397524addee607edc906d0c07dd8ca9b9e49e1a8a"}
Jul 12 08:22:51.680627 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.680488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc" event={"ID":"ef721109-271f-4004-9892-ce40a3723c14","Type":"ContainerStarted","Data":"21b358d18d81b47937f56b42c0008e3cdec4549d49bee9b4b959685f9c5faba8"}
Jul 12 08:22:51.680627 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:51.680536    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc" event={"ID":"ef721109-271f-4004-9892-ce40a3723c14","Type":"ContainerStarted","Data":"7b00e90503553b1914f3bc91aee3edde6c46c9222b0329ce3e953f574cf2f56e"}
Jul 12 08:22:52.630334 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:52.630285    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-89bjc" podStartSLOduration=5.958663319 podStartE2EDuration="7.630267724s" totalImagesPullingTime="1.671604405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:51.703339719 +0000 UTC m=+74.282798199" watchObservedRunningTime="2026-07-12 08:22:52.630267724 +0000 UTC m=+75.209726202"
Jul 12 08:22:52.630703 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:52.630582    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfd9565cf-g2kxs"]
Jul 12 08:22:52.635281 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:22:52.635252    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c91c753_4ab0_4ebb_a61b_92a051b463ea.slice/crio-40d497747d59874e90756fbbc9f46ee3842427125ba270d1d12383c5a6256639 WatchSource:0}: Error finding container 40d497747d59874e90756fbbc9f46ee3842427125ba270d1d12383c5a6256639: Status 404 returned error can't find the container with id 40d497747d59874e90756fbbc9f46ee3842427125ba270d1d12383c5a6256639
Jul 12 08:22:52.688564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:52.687298    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg" event={"ID":"0da482da-fa8d-435d-9921-53cd61678c9d","Type":"ContainerStarted","Data":"9b5bd831722987f1be15eb4d38d2c55a51f4c4442a3f9346db424c37b9169de5"}
Jul 12 08:22:52.688564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:52.687386    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg" event={"ID":"0da482da-fa8d-435d-9921-53cd61678c9d","Type":"ContainerStarted","Data":"6c69dc4ebb0544bfa27ee556bf5e5f269b00abfd247bbe7061912348e1ec458f"}
Jul 12 08:22:52.689389 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:52.689354    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq" event={"ID":"a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f","Type":"ContainerStarted","Data":"1d0edbe36a6a424a018bf28df4f4eb13a0c0e2ee0ff3ed9b97dbc7febc91a2b2"}
Jul 12 08:22:52.690829 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:52.690789    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfd9565cf-g2kxs" event={"ID":"0c91c753-4ab0-4ebb-a61b-92a051b463ea","Type":"ContainerStarted","Data":"40d497747d59874e90756fbbc9f46ee3842427125ba270d1d12383c5a6256639"}
Jul 12 08:22:52.707004 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:52.706955    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq" podStartSLOduration=1.60964925 podStartE2EDuration="3.706935163s" totalImagesPullingTime="2.097285913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:52.706595253 +0000 UTC m=+75.286053725" watchObservedRunningTime="2026-07-12 08:22:52.706935163 +0000 UTC m=+75.286393640"
Jul 12 08:22:53.699024 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:53.698946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg" event={"ID":"0da482da-fa8d-435d-9921-53cd61678c9d","Type":"ContainerStarted","Data":"afc8f36e69b51aae9ada4cf9d02b93d63d3e222539486e095950c15f9cacbc50"}
Jul 12 08:22:53.699473 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:53.699086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg" event={"ID":"0da482da-fa8d-435d-9921-53cd61678c9d","Type":"ContainerStarted","Data":"59217fd493caefdbf2f0d2f469e1d02f42517ff26d73883cb6802d17b4767977"}
Jul 12 08:22:53.699473 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:53.699135    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg" event={"ID":"0da482da-fa8d-435d-9921-53cd61678c9d","Type":"ContainerStarted","Data":"d365524d001ddfe20f7275591401643807347989e4e5bce4c3d7037e825e13cf"}
Jul 12 08:22:53.699473 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:53.699175    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg" event={"ID":"0da482da-fa8d-435d-9921-53cd61678c9d","Type":"ContainerStarted","Data":"a220492807fc03f7c01e4a1db9b440859dce4c5da3a64a817558ae82e9a2af64"}
Jul 12 08:22:54.704432 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:54.704397    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:22:55.709687 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:55.709649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfd9565cf-g2kxs" event={"ID":"0c91c753-4ab0-4ebb-a61b-92a051b463ea","Type":"ContainerStarted","Data":"fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d"}
Jul 12 08:22:55.728065 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:22:55.728006    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg" podStartSLOduration=4.9527078 podStartE2EDuration="8.727984794s" totalImagesPullingTime="3.775276994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:22:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:53.723111935 +0000 UTC m=+76.302570415" watchObservedRunningTime="2026-07-12 08:22:55.727984794 +0000 UTC m=+78.307443273"
Jul 12 08:23:00.716138 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:00.716025    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c77f7985d-jwdlg"
Jul 12 08:23:00.740907 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:00.740825    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dfd9565cf-g2kxs" podStartSLOduration=6.797423589 podStartE2EDuration="9.74081105s" totalImagesPullingTime="2.943387461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:22:55.729337522 +0000 UTC m=+78.308796000" watchObservedRunningTime="2026-07-12 08:23:00.74081105 +0000 UTC m=+83.320269541"
Jul 12 08:23:01.644129 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:01.644092    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:23:01.644336 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:01.644174    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:23:01.649744 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:01.649716    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:23:01.736584 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:01.736555    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:23:10.225911 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:10.225875    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:23:10.226367 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:10.225972    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:23:17.313342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:17.313309    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4nqdp_ea3b4eee-35c1-44a6-a21e-2cd9378dc08b/serve-healthcheck-canary/0.log"
Jul 12 08:23:20.672903 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:20.672872    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gtfpz"
Jul 12 08:23:30.234268 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:30.234137    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:23:30.243267 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:23:30.243237    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-59c4c8ddcf-7mtsq"
Jul 12 08:24:09.909995 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.909957    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7978b4897d-jdqrx"]
Jul 12 08:24:09.913454 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.913432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:09.916253 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.916230    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 12 08:24:09.916447 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.916296    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 12 08:24:09.916575 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.916375    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 12 08:24:09.916575 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.916375    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 12 08:24:09.916575 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.916536    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6rtfh\""
Jul 12 08:24:09.917648 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.917625    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 12 08:24:09.921674 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.921647    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 12 08:24:09.923673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.923648    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7978b4897d-jdqrx"]
Jul 12 08:24:09.991189 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.991160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-serving-certs-ca-bundle\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:09.991189 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.991194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-metrics-client-ca\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:09.991394 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.991218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:09.991394 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.991241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-telemeter-client-tls\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:09.991394 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.991297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-secret-telemeter-client\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:09.991394 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.991354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:09.991394 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.991370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-federate-client-tls\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:09.991394 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:09.991384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4gdq\" (UniqueName: \"kubernetes.io/projected/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-kube-api-access-j4gdq\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.092720 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.092666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.092720 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.092727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-telemeter-client-tls\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.093021 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.092752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-secret-telemeter-client\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.093021 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.092773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.093021 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.092792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-federate-client-tls\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.093021 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.092810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4gdq\" (UniqueName: \"kubernetes.io/projected/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-kube-api-access-j4gdq\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.093021 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.092907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-serving-certs-ca-bundle\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.093021 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.092935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-metrics-client-ca\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.093712 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.093685    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-serving-certs-ca-bundle\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.093826 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.093752    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-metrics-client-ca\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.093826 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.093763    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.096007 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.095977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.096117 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.096101    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-secret-telemeter-client\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.096160 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.096117    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-federate-client-tls\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.096199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.096167    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-telemeter-client-tls\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.101097 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.101070    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4gdq\" (UniqueName: \"kubernetes.io/projected/6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c-kube-api-access-j4gdq\") pod \"telemeter-client-7978b4897d-jdqrx\" (UID: \"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c\") " pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.226445 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.226353    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx"
Jul 12 08:24:10.354451 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.354177    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7978b4897d-jdqrx"]
Jul 12 08:24:10.356379 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:24:10.356353    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea0e14c_ac31_4e37_b8cf_a635d9c39f3c.slice/crio-75981dd10df50ebfe5ffd04db1f2e32b1e603649250d5137bb6e05f7b8da14a7 WatchSource:0}: Error finding container 75981dd10df50ebfe5ffd04db1f2e32b1e603649250d5137bb6e05f7b8da14a7: Status 404 returned error can't find the container with id 75981dd10df50ebfe5ffd04db1f2e32b1e603649250d5137bb6e05f7b8da14a7
Jul 12 08:24:10.972484 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:10.972443    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx" event={"ID":"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c","Type":"ContainerStarted","Data":"75981dd10df50ebfe5ffd04db1f2e32b1e603649250d5137bb6e05f7b8da14a7"}
Jul 12 08:24:12.982207 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:12.982165    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx" event={"ID":"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c","Type":"ContainerStarted","Data":"eacfff97b3614376c9809f7de431f339198f7194296a87528ee16d8adb99022a"}
Jul 12 08:24:13.987307 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:13.987274    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx" event={"ID":"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c","Type":"ContainerStarted","Data":"00b9bcb5e1f050653986765e53a71c57d7fd691fdda5d1cedc5147f5416e3868"}
Jul 12 08:24:13.987764 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:13.987331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx" event={"ID":"6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c","Type":"ContainerStarted","Data":"a5d4dc967f3c8460371a7b8eb13c3170f8250a75e52f69e23f90ec04ce19ed58"}
Jul 12 08:24:14.008806 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.008764    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7978b4897d-jdqrx" podStartSLOduration=2.090411989 podStartE2EDuration="5.008748008s" totalImagesPullingTime="2.918336019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:24:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:24:14.00655215 +0000 UTC m=+156.586010629" watchObservedRunningTime="2026-07-12 08:24:14.008748008 +0000 UTC m=+156.588206485"
Jul 12 08:24:14.726800 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.726767    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cb994d686-z272k"]
Jul 12 08:24:14.730010 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.729990    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.740257 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.740233    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb994d686-z272k"]
Jul 12 08:24:14.830058 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.830028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-service-ca\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.830192 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.830066    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-trusted-ca-bundle\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.830192 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.830128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvk9j\" (UniqueName: \"kubernetes.io/projected/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-kube-api-access-jvk9j\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.830192 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.830167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-oauth-config\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.830334 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.830206    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-serving-cert\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.830334 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.830232    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-config\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.830334 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.830249    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-oauth-serving-cert\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.931301 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.931263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-service-ca\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.931471 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.931306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-trusted-ca-bundle\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.931471 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.931334    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvk9j\" (UniqueName: \"kubernetes.io/projected/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-kube-api-access-jvk9j\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.931471 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.931364    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-oauth-config\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.931471 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.931402    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-serving-cert\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.931471 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.931437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-config\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.931471 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.931459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-oauth-serving-cert\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.932253 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.932228    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-oauth-serving-cert\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.932357 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.932271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-trusted-ca-bundle\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.932357 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.932271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-config\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.932726 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.932705    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-service-ca\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.933989 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.933968    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-serving-cert\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.934248 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.934228    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-oauth-config\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:14.938744 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:14.938721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvk9j\" (UniqueName: \"kubernetes.io/projected/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-kube-api-access-jvk9j\") pod \"console-7cb994d686-z272k\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") " pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:15.040285 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:15.040194    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:15.199541 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:15.199506    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb994d686-z272k"]
Jul 12 08:24:15.203421 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:24:15.203394    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0953d6ca_dfa1_4fec_aad1_50ab3e0d601c.slice/crio-1391ccf9855631e2ad30c1f77fba88e267fb1a43e87a7705df3ce49f5a346d28 WatchSource:0}: Error finding container 1391ccf9855631e2ad30c1f77fba88e267fb1a43e87a7705df3ce49f5a346d28: Status 404 returned error can't find the container with id 1391ccf9855631e2ad30c1f77fba88e267fb1a43e87a7705df3ce49f5a346d28
Jul 12 08:24:15.996124 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:15.996093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb994d686-z272k" event={"ID":"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c","Type":"ContainerStarted","Data":"15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858"}
Jul 12 08:24:15.996282 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:15.996145    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb994d686-z272k" event={"ID":"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c","Type":"ContainerStarted","Data":"1391ccf9855631e2ad30c1f77fba88e267fb1a43e87a7705df3ce49f5a346d28"}
Jul 12 08:24:16.013164 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:16.013119    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cb994d686-z272k" podStartSLOduration=2.013105085 podStartE2EDuration="2.013105085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:24:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:24:16.011865544 +0000 UTC m=+158.591324014" watchObservedRunningTime="2026-07-12 08:24:16.013105085 +0000 UTC m=+158.592563561"
Jul 12 08:24:22.562313 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.562283    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb994d686-z272k"]
Jul 12 08:24:22.595894 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.595865    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fcb48bc76-ssstx"]
Jul 12 08:24:22.599138 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.599120    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.610641 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.610620    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fcb48bc76-ssstx"]
Jul 12 08:24:22.686448 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.686414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-trusted-ca-bundle\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.686621 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.686456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-config\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.686621 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.686482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-oauth-serving-cert\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.686621 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.686513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whzc7\" (UniqueName: \"kubernetes.io/projected/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-kube-api-access-whzc7\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.686621 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.686552    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-service-ca\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.686621 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.686600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-oauth-config\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.686798 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.686632    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-serving-cert\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.787335 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.787295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-trusted-ca-bundle\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.787501 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.787343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-config\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.787501 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.787369    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-oauth-serving-cert\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.787501 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.787396    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whzc7\" (UniqueName: \"kubernetes.io/projected/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-kube-api-access-whzc7\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.787501 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.787437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-service-ca\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.787642 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.787514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-oauth-config\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.787749 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.787724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-serving-cert\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.788091 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.788070    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-config\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.788242 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.788222    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-oauth-serving-cert\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.788304 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.788275    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-service-ca\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.788304 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.788274    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-trusted-ca-bundle\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.790115 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.790092    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-serving-cert\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.790205 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.790115    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-oauth-config\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.796694 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.796676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whzc7\" (UniqueName: \"kubernetes.io/projected/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-kube-api-access-whzc7\") pod \"console-7fcb48bc76-ssstx\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") " pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:22.908475 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:22.908449    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:23.035117 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:23.035094    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fcb48bc76-ssstx"]
Jul 12 08:24:23.037902 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:24:23.037870    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5f21fa_ad87_416e_88e2_8f8be7c9aeb7.slice/crio-a138e44f4881238013b833a1da90750bb3d71226c40a9b1251ae52a8c4b029a1 WatchSource:0}: Error finding container a138e44f4881238013b833a1da90750bb3d71226c40a9b1251ae52a8c4b029a1: Status 404 returned error can't find the container with id a138e44f4881238013b833a1da90750bb3d71226c40a9b1251ae52a8c4b029a1
Jul 12 08:24:24.025931 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:24.025895    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fcb48bc76-ssstx" event={"ID":"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7","Type":"ContainerStarted","Data":"5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6"}
Jul 12 08:24:24.026334 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:24.025949    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fcb48bc76-ssstx" event={"ID":"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7","Type":"ContainerStarted","Data":"a138e44f4881238013b833a1da90750bb3d71226c40a9b1251ae52a8c4b029a1"}
Jul 12 08:24:24.043139 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:24.043094    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fcb48bc76-ssstx" podStartSLOduration=2.043080038 podStartE2EDuration="2.043080038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:24:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:24:24.042128986 +0000 UTC m=+166.621587464" watchObservedRunningTime="2026-07-12 08:24:24.043080038 +0000 UTC m=+166.622538527"
Jul 12 08:24:25.041629 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:25.041594    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:32.909321 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:32.909239    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:32.909321 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:32.909295    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:32.914135 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:32.914114    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:33.063122 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:33.063099    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:24:33.109393 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:33.109368    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfd9565cf-g2kxs"]
Jul 12 08:24:47.582066 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.582020    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cb994d686-z272k" podUID="0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" containerName="console" containerID="cri-o://15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858" gracePeriod=15
Jul 12 08:24:47.823042 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.823014    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:47.987337 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987307    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-oauth-serving-cert\") pod \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") "
Jul 12 08:24:47.987510 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987350    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-oauth-config\") pod \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") "
Jul 12 08:24:47.987510 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987368    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-serving-cert\") pod \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") "
Jul 12 08:24:47.987510 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987385    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-trusted-ca-bundle\") pod \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") "
Jul 12 08:24:47.987510 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987426    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvk9j\" (UniqueName: \"kubernetes.io/projected/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-kube-api-access-jvk9j\") pod \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") "
Jul 12 08:24:47.987510 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987456    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-service-ca\") pod \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") "
Jul 12 08:24:47.987510 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987482    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-config\") pod \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\" (UID: \"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c\") "
Jul 12 08:24:47.987909 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987880    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" (UID: "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:24:47.988095 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987887    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" (UID: "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:24:47.988095 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987957    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-service-ca" (OuterVolumeSpecName: "service-ca") pod "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" (UID: "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:24:47.988095 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.987974    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-config" (OuterVolumeSpecName: "console-config") pod "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" (UID: "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:24:47.989651 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.989623    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" (UID: "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:24:47.989771 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.989668    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" (UID: "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:24:47.989771 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:47.989679    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-kube-api-access-jvk9j" (OuterVolumeSpecName: "kube-api-access-jvk9j") pod "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" (UID: "0953d6ca-dfa1-4fec-aad1-50ab3e0d601c"). InnerVolumeSpecName "kube-api-access-jvk9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:24:48.093149 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.089625    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvk9j\" (UniqueName: \"kubernetes.io/projected/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-kube-api-access-jvk9j\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:48.093149 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.089671    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-service-ca\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:48.093149 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.089686    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-config\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:48.093149 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.089699    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-oauth-serving-cert\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:48.093149 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.089713    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-oauth-config\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:48.093149 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.089732    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-console-serving-cert\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:48.093149 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.089745    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c-trusted-ca-bundle\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:48.111189 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.111154    2583 generic.go:356] "Generic (PLEG): container finished" podID="0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" containerID="15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858" exitCode=0
Jul 12 08:24:48.111303 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.111201    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb994d686-z272k" event={"ID":"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c","Type":"ContainerDied","Data":"15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858"}
Jul 12 08:24:48.111303 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.111213    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb994d686-z272k"
Jul 12 08:24:48.111303 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.111278    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb994d686-z272k" event={"ID":"0953d6ca-dfa1-4fec-aad1-50ab3e0d601c","Type":"ContainerDied","Data":"1391ccf9855631e2ad30c1f77fba88e267fb1a43e87a7705df3ce49f5a346d28"}
Jul 12 08:24:48.111402 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.111316    2583 scope.go:117] "RemoveContainer" containerID="15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858"
Jul 12 08:24:48.119372 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.119353    2583 scope.go:117] "RemoveContainer" containerID="15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858"
Jul 12 08:24:48.119606 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:24:48.119588    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858\": container with ID starting with 15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858 not found: ID does not exist" containerID="15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858"
Jul 12 08:24:48.119657 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.119611    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858"} err="failed to get container status \"15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858\": rpc error: code = NotFound desc = could not find container \"15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858\": container with ID starting with 15e9eb678718ef30a39b6af8b39d0b832b784042c0625a0a9d5c11162bff7858 not found: ID does not exist"
Jul 12 08:24:48.131269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.131248    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb994d686-z272k"]
Jul 12 08:24:48.134827 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.134805    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cb994d686-z272k"]
Jul 12 08:24:48.366966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:48.366897    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" path="/var/lib/kubelet/pods/0953d6ca-dfa1-4fec-aad1-50ab3e0d601c/volumes"
Jul 12 08:24:58.128929 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.128879    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dfd9565cf-g2kxs" podUID="0c91c753-4ab0-4ebb-a61b-92a051b463ea" containerName="console" containerID="cri-o://fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d" gracePeriod=15
Jul 12 08:24:58.364155 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.364120    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:24:58.455447 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.455420    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-oauth-config\") pod \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") "
Jul 12 08:24:58.455447 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.455447    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-serving-cert\") pod \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") "
Jul 12 08:24:58.455641 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.455467    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-service-ca\") pod \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") "
Jul 12 08:24:58.455641 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.455508    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-config\") pod \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") "
Jul 12 08:24:58.455715 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.455659    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-oauth-serving-cert\") pod \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") "
Jul 12 08:24:58.455760 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.455721    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-trusted-ca-bundle\") pod \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") "
Jul 12 08:24:58.455760 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.455753    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdnvn\" (UniqueName: \"kubernetes.io/projected/0c91c753-4ab0-4ebb-a61b-92a051b463ea-kube-api-access-gdnvn\") pod \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\" (UID: \"0c91c753-4ab0-4ebb-a61b-92a051b463ea\") "
Jul 12 08:24:58.455903 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.455863    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c91c753-4ab0-4ebb-a61b-92a051b463ea" (UID: "0c91c753-4ab0-4ebb-a61b-92a051b463ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:24:58.456125 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.456016    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-service-ca\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:58.456125 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.456027    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-config" (OuterVolumeSpecName: "console-config") pod "0c91c753-4ab0-4ebb-a61b-92a051b463ea" (UID: "0c91c753-4ab0-4ebb-a61b-92a051b463ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:24:58.456263 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.456147    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c91c753-4ab0-4ebb-a61b-92a051b463ea" (UID: "0c91c753-4ab0-4ebb-a61b-92a051b463ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:24:58.456263 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.456159    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c91c753-4ab0-4ebb-a61b-92a051b463ea" (UID: "0c91c753-4ab0-4ebb-a61b-92a051b463ea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:24:58.457655 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.457625    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c91c753-4ab0-4ebb-a61b-92a051b463ea" (UID: "0c91c753-4ab0-4ebb-a61b-92a051b463ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:24:58.457745 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.457669    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c91c753-4ab0-4ebb-a61b-92a051b463ea-kube-api-access-gdnvn" (OuterVolumeSpecName: "kube-api-access-gdnvn") pod "0c91c753-4ab0-4ebb-a61b-92a051b463ea" (UID: "0c91c753-4ab0-4ebb-a61b-92a051b463ea"). InnerVolumeSpecName "kube-api-access-gdnvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:24:58.457745 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.457703    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c91c753-4ab0-4ebb-a61b-92a051b463ea" (UID: "0c91c753-4ab0-4ebb-a61b-92a051b463ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:24:58.557288 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.557259    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdnvn\" (UniqueName: \"kubernetes.io/projected/0c91c753-4ab0-4ebb-a61b-92a051b463ea-kube-api-access-gdnvn\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:58.557288 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.557285    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-oauth-config\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:58.557288 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.557294    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-serving-cert\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:58.557478 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.557304    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-console-config\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:58.557478 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.557312    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-oauth-serving-cert\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:58.557478 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:58.557320    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c91c753-4ab0-4ebb-a61b-92a051b463ea-trusted-ca-bundle\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:24:59.151771 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:59.151738    2583 generic.go:356] "Generic (PLEG): container finished" podID="0c91c753-4ab0-4ebb-a61b-92a051b463ea" containerID="fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d" exitCode=0
Jul 12 08:24:59.152244 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:59.151788    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfd9565cf-g2kxs"
Jul 12 08:24:59.152244 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:59.151820    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfd9565cf-g2kxs" event={"ID":"0c91c753-4ab0-4ebb-a61b-92a051b463ea","Type":"ContainerDied","Data":"fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d"}
Jul 12 08:24:59.152244 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:59.151886    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfd9565cf-g2kxs" event={"ID":"0c91c753-4ab0-4ebb-a61b-92a051b463ea","Type":"ContainerDied","Data":"40d497747d59874e90756fbbc9f46ee3842427125ba270d1d12383c5a6256639"}
Jul 12 08:24:59.152244 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:59.151910    2583 scope.go:117] "RemoveContainer" containerID="fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d"
Jul 12 08:24:59.160055 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:59.160039    2583 scope.go:117] "RemoveContainer" containerID="fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d"
Jul 12 08:24:59.160302 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:24:59.160285    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d\": container with ID starting with fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d not found: ID does not exist" containerID="fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d"
Jul 12 08:24:59.160342 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:59.160309    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d"} err="failed to get container status \"fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d\": rpc error: code = NotFound desc = could not find container \"fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d\": container with ID starting with fb1c1433563dfe65fac9c270e4c93f9592d7b47f86c8a89f05ec735493d85e1d not found: ID does not exist"
Jul 12 08:24:59.173807 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:59.173776    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfd9565cf-g2kxs"]
Jul 12 08:24:59.179322 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:24:59.179302    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dfd9565cf-g2kxs"]
Jul 12 08:25:00.366668 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:00.366636    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c91c753-4ab0-4ebb-a61b-92a051b463ea" path="/var/lib/kubelet/pods/0c91c753-4ab0-4ebb-a61b-92a051b463ea/volumes"
Jul 12 08:25:56.041223 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.041188    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"]
Jul 12 08:25:56.041673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.041472    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c91c753-4ab0-4ebb-a61b-92a051b463ea" containerName="console"
Jul 12 08:25:56.041673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.041483    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c91c753-4ab0-4ebb-a61b-92a051b463ea" containerName="console"
Jul 12 08:25:56.041673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.041498    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" containerName="console"
Jul 12 08:25:56.041673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.041504    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" containerName="console"
Jul 12 08:25:56.041673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.041554    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c91c753-4ab0-4ebb-a61b-92a051b463ea" containerName="console"
Jul 12 08:25:56.041673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.041562    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0953d6ca-dfa1-4fec-aad1-50ab3e0d601c" containerName="console"
Jul 12 08:25:56.045824 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.045807    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.049954 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.049930    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c5sk5\""
Jul 12 08:25:56.050072 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.049934    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 08:25:56.051128 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.051112    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 08:25:56.057045 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.057026    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"]
Jul 12 08:25:56.209515 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.209474    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnhnh\" (UniqueName: \"kubernetes.io/projected/4dc98258-36fd-4f9c-a44d-67496a15465c-kube-api-access-jnhnh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.209696 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.209524    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.209696 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.209550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.310811 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.310735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnhnh\" (UniqueName: \"kubernetes.io/projected/4dc98258-36fd-4f9c-a44d-67496a15465c-kube-api-access-jnhnh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.310811 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.310774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.310811 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.310791    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.311191 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.311174    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.311262 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.311207    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.319103 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.319084    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnhnh\" (UniqueName: \"kubernetes.io/projected/4dc98258-36fd-4f9c-a44d-67496a15465c-kube-api-access-jnhnh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.354250 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.354224    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:25:56.479497 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:56.479473    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"]
Jul 12 08:25:56.482222 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:25:56.482196    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc98258_36fd_4f9c_a44d_67496a15465c.slice/crio-24dce8130368c0e335f8b5ece3b81876f09ab217fe795b91edc2d791adcf3ed6 WatchSource:0}: Error finding container 24dce8130368c0e335f8b5ece3b81876f09ab217fe795b91edc2d791adcf3ed6: Status 404 returned error can't find the container with id 24dce8130368c0e335f8b5ece3b81876f09ab217fe795b91edc2d791adcf3ed6
Jul 12 08:25:57.355718 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:25:57.355683    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9" event={"ID":"4dc98258-36fd-4f9c-a44d-67496a15465c","Type":"ContainerStarted","Data":"24dce8130368c0e335f8b5ece3b81876f09ab217fe795b91edc2d791adcf3ed6"}
Jul 12 08:26:03.380213 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:03.380177    2583 generic.go:356] "Generic (PLEG): container finished" podID="4dc98258-36fd-4f9c-a44d-67496a15465c" containerID="67089d89537be503c7d666812f7b520a8fae758b2a1040011456f4f57ece1961" exitCode=0
Jul 12 08:26:03.380626 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:03.380269    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9" event={"ID":"4dc98258-36fd-4f9c-a44d-67496a15465c","Type":"ContainerDied","Data":"67089d89537be503c7d666812f7b520a8fae758b2a1040011456f4f57ece1961"}
Jul 12 08:26:05.389375 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:05.389344    2583 generic.go:356] "Generic (PLEG): container finished" podID="4dc98258-36fd-4f9c-a44d-67496a15465c" containerID="97084386798aa610dbf403e9eb31dfd0637b2579fb9f4974568d69f4b6c280b1" exitCode=0
Jul 12 08:26:05.389686 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:05.389387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9" event={"ID":"4dc98258-36fd-4f9c-a44d-67496a15465c","Type":"ContainerDied","Data":"97084386798aa610dbf403e9eb31dfd0637b2579fb9f4974568d69f4b6c280b1"}
Jul 12 08:26:12.416311 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:12.416278    2583 generic.go:356] "Generic (PLEG): container finished" podID="4dc98258-36fd-4f9c-a44d-67496a15465c" containerID="62266bccc64bf3d5da8e5544d3b2f9259fb6672fb8a6b4ab6ff31d0e5559e04e" exitCode=0
Jul 12 08:26:12.416733 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:12.416357    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9" event={"ID":"4dc98258-36fd-4f9c-a44d-67496a15465c","Type":"ContainerDied","Data":"62266bccc64bf3d5da8e5544d3b2f9259fb6672fb8a6b4ab6ff31d0e5559e04e"}
Jul 12 08:26:13.542825 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:13.542804    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:26:13.647147 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:13.647119    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnhnh\" (UniqueName: \"kubernetes.io/projected/4dc98258-36fd-4f9c-a44d-67496a15465c-kube-api-access-jnhnh\") pod \"4dc98258-36fd-4f9c-a44d-67496a15465c\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") "
Jul 12 08:26:13.647303 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:13.647169    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-bundle\") pod \"4dc98258-36fd-4f9c-a44d-67496a15465c\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") "
Jul 12 08:26:13.647303 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:13.647208    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-util\") pod \"4dc98258-36fd-4f9c-a44d-67496a15465c\" (UID: \"4dc98258-36fd-4f9c-a44d-67496a15465c\") "
Jul 12 08:26:13.647794 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:13.647767    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-bundle" (OuterVolumeSpecName: "bundle") pod "4dc98258-36fd-4f9c-a44d-67496a15465c" (UID: "4dc98258-36fd-4f9c-a44d-67496a15465c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:26:13.649321 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:13.649299    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dc98258-36fd-4f9c-a44d-67496a15465c-kube-api-access-jnhnh" (OuterVolumeSpecName: "kube-api-access-jnhnh") pod "4dc98258-36fd-4f9c-a44d-67496a15465c" (UID: "4dc98258-36fd-4f9c-a44d-67496a15465c"). InnerVolumeSpecName "kube-api-access-jnhnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:26:13.654092 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:13.654068    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-util" (OuterVolumeSpecName: "util") pod "4dc98258-36fd-4f9c-a44d-67496a15465c" (UID: "4dc98258-36fd-4f9c-a44d-67496a15465c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:26:13.748117 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:13.748041    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnhnh\" (UniqueName: \"kubernetes.io/projected/4dc98258-36fd-4f9c-a44d-67496a15465c-kube-api-access-jnhnh\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:26:13.748117 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:13.748077    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-bundle\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:26:13.748117 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:13.748087    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dc98258-36fd-4f9c-a44d-67496a15465c-util\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:26:14.424568 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:14.424527    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9" event={"ID":"4dc98258-36fd-4f9c-a44d-67496a15465c","Type":"ContainerDied","Data":"24dce8130368c0e335f8b5ece3b81876f09ab217fe795b91edc2d791adcf3ed6"}
Jul 12 08:26:14.424724 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:14.424579    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406gnp9"
Jul 12 08:26:14.424724 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:14.424606    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24dce8130368c0e335f8b5ece3b81876f09ab217fe795b91edc2d791adcf3ed6"
Jul 12 08:26:18.939300 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.939261    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"]
Jul 12 08:26:18.939938 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.939538    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc98258-36fd-4f9c-a44d-67496a15465c" containerName="util"
Jul 12 08:26:18.939938 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.939548    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc98258-36fd-4f9c-a44d-67496a15465c" containerName="util"
Jul 12 08:26:18.939938 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.939562    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc98258-36fd-4f9c-a44d-67496a15465c" containerName="extract"
Jul 12 08:26:18.939938 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.939567    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc98258-36fd-4f9c-a44d-67496a15465c" containerName="extract"
Jul 12 08:26:18.939938 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.939582    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc98258-36fd-4f9c-a44d-67496a15465c" containerName="pull"
Jul 12 08:26:18.939938 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.939588    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc98258-36fd-4f9c-a44d-67496a15465c" containerName="pull"
Jul 12 08:26:18.939938 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.939639    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dc98258-36fd-4f9c-a44d-67496a15465c" containerName="extract"
Jul 12 08:26:18.944118 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.944101    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"
Jul 12 08:26:18.950179 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.950152    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:26:18.950321 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.950152    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 12 08:26:18.950321 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.950187    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-29fbb\""
Jul 12 08:26:18.956408 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.956382    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"]
Jul 12 08:26:18.983540 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.983510    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8jsz\" (UniqueName: \"kubernetes.io/projected/860801da-6a5d-42b5-a23a-bdfd200fa405-kube-api-access-v8jsz\") pod \"cert-manager-operator-controller-manager-55c444bf86-dvf4c\" (UID: \"860801da-6a5d-42b5-a23a-bdfd200fa405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"
Jul 12 08:26:18.983679 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:18.983625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/860801da-6a5d-42b5-a23a-bdfd200fa405-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dvf4c\" (UID: \"860801da-6a5d-42b5-a23a-bdfd200fa405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"
Jul 12 08:26:19.085064 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:19.085031    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/860801da-6a5d-42b5-a23a-bdfd200fa405-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dvf4c\" (UID: \"860801da-6a5d-42b5-a23a-bdfd200fa405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"
Jul 12 08:26:19.085224 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:19.085094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8jsz\" (UniqueName: \"kubernetes.io/projected/860801da-6a5d-42b5-a23a-bdfd200fa405-kube-api-access-v8jsz\") pod \"cert-manager-operator-controller-manager-55c444bf86-dvf4c\" (UID: \"860801da-6a5d-42b5-a23a-bdfd200fa405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"
Jul 12 08:26:19.085423 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:19.085398    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/860801da-6a5d-42b5-a23a-bdfd200fa405-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dvf4c\" (UID: \"860801da-6a5d-42b5-a23a-bdfd200fa405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"
Jul 12 08:26:19.102812 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:19.102790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8jsz\" (UniqueName: \"kubernetes.io/projected/860801da-6a5d-42b5-a23a-bdfd200fa405-kube-api-access-v8jsz\") pod \"cert-manager-operator-controller-manager-55c444bf86-dvf4c\" (UID: \"860801da-6a5d-42b5-a23a-bdfd200fa405\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"
Jul 12 08:26:19.253773 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:19.253682    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"
Jul 12 08:26:19.384835 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:19.384803    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c"]
Jul 12 08:26:19.388794 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:26:19.388766    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860801da_6a5d_42b5_a23a_bdfd200fa405.slice/crio-452b45761d0b68cebe5da66d85b918598484adb69a7001fdc83f98fb071e6712 WatchSource:0}: Error finding container 452b45761d0b68cebe5da66d85b918598484adb69a7001fdc83f98fb071e6712: Status 404 returned error can't find the container with id 452b45761d0b68cebe5da66d85b918598484adb69a7001fdc83f98fb071e6712
Jul 12 08:26:19.442710 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:19.442680    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c" event={"ID":"860801da-6a5d-42b5-a23a-bdfd200fa405","Type":"ContainerStarted","Data":"452b45761d0b68cebe5da66d85b918598484adb69a7001fdc83f98fb071e6712"}
Jul 12 08:26:21.454090 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:21.454049    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c" event={"ID":"860801da-6a5d-42b5-a23a-bdfd200fa405","Type":"ContainerStarted","Data":"da00490ecf9c3d1b2727103698a7c7362470c0f0a718505aef85c8434d7c8fe6"}
Jul 12 08:26:21.480395 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:21.480333    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dvf4c" podStartSLOduration=2.014502337 podStartE2EDuration="3.480311959s" totalImagesPullingTime="1.465809622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:26:21.478723579 +0000 UTC m=+284.058182095" watchObservedRunningTime="2026-07-12 08:26:21.480311959 +0000 UTC m=+284.059770439"
Jul 12 08:26:22.666025 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.665995    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"]
Jul 12 08:26:22.669413 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.669393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:22.671979 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.671960    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c5sk5\""
Jul 12 08:26:22.674801 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.674782    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 08:26:22.675345 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.675330    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 08:26:22.682065 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.682044    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"]
Jul 12 08:26:22.713582 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.713554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:22.713691 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.713612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx9cw\" (UniqueName: \"kubernetes.io/projected/06a8759a-401f-4aaa-861e-557e2a8e0709-kube-api-access-zx9cw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:22.713691 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.713631    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:22.814228 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.814194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:22.814365 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.814261    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx9cw\" (UniqueName: \"kubernetes.io/projected/06a8759a-401f-4aaa-861e-557e2a8e0709-kube-api-access-zx9cw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:22.814365 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.814289    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:22.814648 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.814630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:22.814692 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.814629    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:22.823166 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.823142    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx9cw\" (UniqueName: \"kubernetes.io/projected/06a8759a-401f-4aaa-861e-557e2a8e0709-kube-api-access-zx9cw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:22.977989 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:22.977913    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:23.054842 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.054810    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nll6z"]
Jul 12 08:26:23.058594 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.058554    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z"
Jul 12 08:26:23.061738 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.061681    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 12 08:26:23.061738 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.061711    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jzh6n\""
Jul 12 08:26:23.062117 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.061991    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 12 08:26:23.070578 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.070554    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nll6z"]
Jul 12 08:26:23.106665 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.106644    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"]
Jul 12 08:26:23.108904 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:26:23.108836    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a8759a_401f_4aaa_861e_557e2a8e0709.slice/crio-cd2a5c92a40b6a35c0ec3f0e273dfc651f234ada1f90f8961a980b496366421c WatchSource:0}: Error finding container cd2a5c92a40b6a35c0ec3f0e273dfc651f234ada1f90f8961a980b496366421c: Status 404 returned error can't find the container with id cd2a5c92a40b6a35c0ec3f0e273dfc651f234ada1f90f8961a980b496366421c
Jul 12 08:26:23.116799 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.116776    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mj5k\" (UniqueName: \"kubernetes.io/projected/d75fd7f2-7040-45a6-97cb-a8bc349cf10d-kube-api-access-7mj5k\") pod \"cert-manager-webhook-6486ffd997-nll6z\" (UID: \"d75fd7f2-7040-45a6-97cb-a8bc349cf10d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z"
Jul 12 08:26:23.116921 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.116906    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d75fd7f2-7040-45a6-97cb-a8bc349cf10d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nll6z\" (UID: \"d75fd7f2-7040-45a6-97cb-a8bc349cf10d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z"
Jul 12 08:26:23.217636 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.217612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d75fd7f2-7040-45a6-97cb-a8bc349cf10d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nll6z\" (UID: \"d75fd7f2-7040-45a6-97cb-a8bc349cf10d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z"
Jul 12 08:26:23.217729 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.217647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mj5k\" (UniqueName: \"kubernetes.io/projected/d75fd7f2-7040-45a6-97cb-a8bc349cf10d-kube-api-access-7mj5k\") pod \"cert-manager-webhook-6486ffd997-nll6z\" (UID: \"d75fd7f2-7040-45a6-97cb-a8bc349cf10d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z"
Jul 12 08:26:23.225627 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.225601    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d75fd7f2-7040-45a6-97cb-a8bc349cf10d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nll6z\" (UID: \"d75fd7f2-7040-45a6-97cb-a8bc349cf10d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z"
Jul 12 08:26:23.225790 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.225772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mj5k\" (UniqueName: \"kubernetes.io/projected/d75fd7f2-7040-45a6-97cb-a8bc349cf10d-kube-api-access-7mj5k\") pod \"cert-manager-webhook-6486ffd997-nll6z\" (UID: \"d75fd7f2-7040-45a6-97cb-a8bc349cf10d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z"
Jul 12 08:26:23.383104 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.383025    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z"
Jul 12 08:26:23.464121 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.464089    2583 generic.go:356] "Generic (PLEG): container finished" podID="06a8759a-401f-4aaa-861e-557e2a8e0709" containerID="89827df59f0768f84684718353212a46176cb6d25e778e4d11f591d37c5f7d37" exitCode=0
Jul 12 08:26:23.464249 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.464124    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs" event={"ID":"06a8759a-401f-4aaa-861e-557e2a8e0709","Type":"ContainerDied","Data":"89827df59f0768f84684718353212a46176cb6d25e778e4d11f591d37c5f7d37"}
Jul 12 08:26:23.464249 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.464186    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs" event={"ID":"06a8759a-401f-4aaa-861e-557e2a8e0709","Type":"ContainerStarted","Data":"cd2a5c92a40b6a35c0ec3f0e273dfc651f234ada1f90f8961a980b496366421c"}
Jul 12 08:26:23.504008 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:23.503988    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nll6z"]
Jul 12 08:26:23.506101 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:26:23.506078    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd75fd7f2_7040_45a6_97cb_a8bc349cf10d.slice/crio-007dda0f3e54a3772232809946abb072626cbfc8b36e8fdfbb38ceef92daf213 WatchSource:0}: Error finding container 007dda0f3e54a3772232809946abb072626cbfc8b36e8fdfbb38ceef92daf213: Status 404 returned error can't find the container with id 007dda0f3e54a3772232809946abb072626cbfc8b36e8fdfbb38ceef92daf213
Jul 12 08:26:24.471287 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:24.471245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z" event={"ID":"d75fd7f2-7040-45a6-97cb-a8bc349cf10d","Type":"ContainerStarted","Data":"007dda0f3e54a3772232809946abb072626cbfc8b36e8fdfbb38ceef92daf213"}
Jul 12 08:26:26.482238 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:26.482206    2583 generic.go:356] "Generic (PLEG): container finished" podID="06a8759a-401f-4aaa-861e-557e2a8e0709" containerID="e56afa1f4d7a4e6e0b5c38ba0e46cc415df12d553dba640bafd038823abe9b90" exitCode=0
Jul 12 08:26:26.482652 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:26.482264    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs" event={"ID":"06a8759a-401f-4aaa-861e-557e2a8e0709","Type":"ContainerDied","Data":"e56afa1f4d7a4e6e0b5c38ba0e46cc415df12d553dba640bafd038823abe9b90"}
Jul 12 08:26:26.483777 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:26.483751    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z" event={"ID":"d75fd7f2-7040-45a6-97cb-a8bc349cf10d","Type":"ContainerStarted","Data":"c63eeb09a3d72377a1070dafdf69a086233bf4cbe3d1ec8cf03cec23862117a8"}
Jul 12 08:26:26.483966 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:26.483888    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z"
Jul 12 08:26:26.517555 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:26.517509    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z" podStartSLOduration=0.703637131 podStartE2EDuration="3.517494553s" totalImagesPullingTime="2.813857422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:26:26.517034549 +0000 UTC m=+289.096493028" watchObservedRunningTime="2026-07-12 08:26:26.517494553 +0000 UTC m=+289.096953030"
Jul 12 08:26:27.489664 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:27.489629    2583 generic.go:356] "Generic (PLEG): container finished" podID="06a8759a-401f-4aaa-861e-557e2a8e0709" containerID="df0d9745524a2c53e0af916aedb661ac54bf3a79782a7335e0afdb60314153f6" exitCode=0
Jul 12 08:26:27.490041 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:27.489710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs" event={"ID":"06a8759a-401f-4aaa-861e-557e2a8e0709","Type":"ContainerDied","Data":"df0d9745524a2c53e0af916aedb661ac54bf3a79782a7335e0afdb60314153f6"}
Jul 12 08:26:28.612549 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:28.612523    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:28.664262 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:28.664229    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx9cw\" (UniqueName: \"kubernetes.io/projected/06a8759a-401f-4aaa-861e-557e2a8e0709-kube-api-access-zx9cw\") pod \"06a8759a-401f-4aaa-861e-557e2a8e0709\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") "
Jul 12 08:26:28.664411 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:28.664279    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-util\") pod \"06a8759a-401f-4aaa-861e-557e2a8e0709\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") "
Jul 12 08:26:28.664411 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:28.664305    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-bundle\") pod \"06a8759a-401f-4aaa-861e-557e2a8e0709\" (UID: \"06a8759a-401f-4aaa-861e-557e2a8e0709\") "
Jul 12 08:26:28.664717 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:28.664686    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-bundle" (OuterVolumeSpecName: "bundle") pod "06a8759a-401f-4aaa-861e-557e2a8e0709" (UID: "06a8759a-401f-4aaa-861e-557e2a8e0709"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:26:28.666286 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:28.666261    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a8759a-401f-4aaa-861e-557e2a8e0709-kube-api-access-zx9cw" (OuterVolumeSpecName: "kube-api-access-zx9cw") pod "06a8759a-401f-4aaa-861e-557e2a8e0709" (UID: "06a8759a-401f-4aaa-861e-557e2a8e0709"). InnerVolumeSpecName "kube-api-access-zx9cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:26:28.668978 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:28.668958    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-util" (OuterVolumeSpecName: "util") pod "06a8759a-401f-4aaa-861e-557e2a8e0709" (UID: "06a8759a-401f-4aaa-861e-557e2a8e0709"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:26:28.765001 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:28.764945    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx9cw\" (UniqueName: \"kubernetes.io/projected/06a8759a-401f-4aaa-861e-557e2a8e0709-kube-api-access-zx9cw\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:26:28.765001 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:28.764966    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-util\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:26:28.765001 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:28.764976    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06a8759a-401f-4aaa-861e-557e2a8e0709-bundle\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:26:29.499204 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.499167    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs" event={"ID":"06a8759a-401f-4aaa-861e-557e2a8e0709","Type":"ContainerDied","Data":"cd2a5c92a40b6a35c0ec3f0e273dfc651f234ada1f90f8961a980b496366421c"}
Jul 12 08:26:29.499442 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.499210    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk2qfs"
Jul 12 08:26:29.499442 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.499219    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd2a5c92a40b6a35c0ec3f0e273dfc651f234ada1f90f8961a980b496366421c"
Jul 12 08:26:29.852336 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.852264    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"]
Jul 12 08:26:29.852683 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.852528    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a8759a-401f-4aaa-861e-557e2a8e0709" containerName="pull"
Jul 12 08:26:29.852683 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.852539    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a8759a-401f-4aaa-861e-557e2a8e0709" containerName="pull"
Jul 12 08:26:29.852683 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.852546    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a8759a-401f-4aaa-861e-557e2a8e0709" containerName="extract"
Jul 12 08:26:29.852683 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.852552    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a8759a-401f-4aaa-861e-557e2a8e0709" containerName="extract"
Jul 12 08:26:29.852683 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.852566    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a8759a-401f-4aaa-861e-557e2a8e0709" containerName="util"
Jul 12 08:26:29.852683 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.852571    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a8759a-401f-4aaa-861e-557e2a8e0709" containerName="util"
Jul 12 08:26:29.852683 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.852651    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a8759a-401f-4aaa-861e-557e2a8e0709" containerName="extract"
Jul 12 08:26:29.855446 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.855427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"
Jul 12 08:26:29.858071 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.858049    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-czwtw\""
Jul 12 08:26:29.864140 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.864120    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"]
Jul 12 08:26:29.973152 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.973125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxvd8\" (UniqueName: \"kubernetes.io/projected/4ec78a62-dedc-47ab-85e5-889bd1ddd3c8-kube-api-access-rxvd8\") pod \"cert-manager-cainjector-559cdd8c87-jljl4\" (UID: \"4ec78a62-dedc-47ab-85e5-889bd1ddd3c8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"
Jul 12 08:26:29.973304 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:29.973180    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ec78a62-dedc-47ab-85e5-889bd1ddd3c8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jljl4\" (UID: \"4ec78a62-dedc-47ab-85e5-889bd1ddd3c8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"
Jul 12 08:26:30.074502 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:30.074473    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxvd8\" (UniqueName: \"kubernetes.io/projected/4ec78a62-dedc-47ab-85e5-889bd1ddd3c8-kube-api-access-rxvd8\") pod \"cert-manager-cainjector-559cdd8c87-jljl4\" (UID: \"4ec78a62-dedc-47ab-85e5-889bd1ddd3c8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"
Jul 12 08:26:30.074633 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:30.074522    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ec78a62-dedc-47ab-85e5-889bd1ddd3c8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jljl4\" (UID: \"4ec78a62-dedc-47ab-85e5-889bd1ddd3c8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"
Jul 12 08:26:30.082788 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:30.082769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxvd8\" (UniqueName: \"kubernetes.io/projected/4ec78a62-dedc-47ab-85e5-889bd1ddd3c8-kube-api-access-rxvd8\") pod \"cert-manager-cainjector-559cdd8c87-jljl4\" (UID: \"4ec78a62-dedc-47ab-85e5-889bd1ddd3c8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"
Jul 12 08:26:30.083046 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:30.083025    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ec78a62-dedc-47ab-85e5-889bd1ddd3c8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jljl4\" (UID: \"4ec78a62-dedc-47ab-85e5-889bd1ddd3c8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"
Jul 12 08:26:30.165095 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:30.165073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"
Jul 12 08:26:30.283261 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:30.283226    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jljl4"]
Jul 12 08:26:30.286351 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:26:30.286329    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ec78a62_dedc_47ab_85e5_889bd1ddd3c8.slice/crio-cd933ca7b04a6932b9b8ff1e566416166292c67e8890b2867e550131ac234797 WatchSource:0}: Error finding container cd933ca7b04a6932b9b8ff1e566416166292c67e8890b2867e550131ac234797: Status 404 returned error can't find the container with id cd933ca7b04a6932b9b8ff1e566416166292c67e8890b2867e550131ac234797
Jul 12 08:26:30.505304 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:30.505211    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4" event={"ID":"4ec78a62-dedc-47ab-85e5-889bd1ddd3c8","Type":"ContainerStarted","Data":"2726de22cece3fa4280f9191c23a5a775e51c27f188a0d03a1ada4379f0bd035"}
Jul 12 08:26:30.505304 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:30.505259    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4" event={"ID":"4ec78a62-dedc-47ab-85e5-889bd1ddd3c8","Type":"ContainerStarted","Data":"cd933ca7b04a6932b9b8ff1e566416166292c67e8890b2867e550131ac234797"}
Jul 12 08:26:30.525541 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:30.525482    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jljl4" podStartSLOduration=1.525461048 podStartE2EDuration="1.525461048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:26:30.523492338 +0000 UTC m=+293.102950814" watchObservedRunningTime="2026-07-12 08:26:30.525461048 +0000 UTC m=+293.104919528"
Jul 12 08:26:32.491416 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:32.491381    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nll6z"
Jul 12 08:26:33.086654 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.086626    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"]
Jul 12 08:26:33.089678 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.089662    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"
Jul 12 08:26:33.095085 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.095064    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:26:33.095210 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.095139    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 12 08:26:33.095251 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.095231    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4wwn8\""
Jul 12 08:26:33.099561 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.099537    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"]
Jul 12 08:26:33.201063 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.201025    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5829be0-d0c6-4204-a496-e46b4548e4bd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6lr45\" (UID: \"c5829be0-d0c6-4204-a496-e46b4548e4bd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"
Jul 12 08:26:33.201063 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.201065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zjk9\" (UniqueName: \"kubernetes.io/projected/c5829be0-d0c6-4204-a496-e46b4548e4bd-kube-api-access-8zjk9\") pod \"openshift-lws-operator-fd8ccff4c-6lr45\" (UID: \"c5829be0-d0c6-4204-a496-e46b4548e4bd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"
Jul 12 08:26:33.302168 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.302131    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5829be0-d0c6-4204-a496-e46b4548e4bd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6lr45\" (UID: \"c5829be0-d0c6-4204-a496-e46b4548e4bd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"
Jul 12 08:26:33.302168 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.302170    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zjk9\" (UniqueName: \"kubernetes.io/projected/c5829be0-d0c6-4204-a496-e46b4548e4bd-kube-api-access-8zjk9\") pod \"openshift-lws-operator-fd8ccff4c-6lr45\" (UID: \"c5829be0-d0c6-4204-a496-e46b4548e4bd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"
Jul 12 08:26:33.302517 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.302498    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5829be0-d0c6-4204-a496-e46b4548e4bd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6lr45\" (UID: \"c5829be0-d0c6-4204-a496-e46b4548e4bd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"
Jul 12 08:26:33.310572 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.310542    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zjk9\" (UniqueName: \"kubernetes.io/projected/c5829be0-d0c6-4204-a496-e46b4548e4bd-kube-api-access-8zjk9\") pod \"openshift-lws-operator-fd8ccff4c-6lr45\" (UID: \"c5829be0-d0c6-4204-a496-e46b4548e4bd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"
Jul 12 08:26:33.403749 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.403720    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"
Jul 12 08:26:33.531571 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:33.531545    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45"]
Jul 12 08:26:33.534311 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:26:33.534285    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5829be0_d0c6_4204_a496_e46b4548e4bd.slice/crio-4a6dbc680531f2367f8cd4750905591c252c19ea1c8a9e97639ceb05e84921b0 WatchSource:0}: Error finding container 4a6dbc680531f2367f8cd4750905591c252c19ea1c8a9e97639ceb05e84921b0: Status 404 returned error can't find the container with id 4a6dbc680531f2367f8cd4750905591c252c19ea1c8a9e97639ceb05e84921b0
Jul 12 08:26:34.524514 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:34.524481    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45" event={"ID":"c5829be0-d0c6-4204-a496-e46b4548e4bd","Type":"ContainerStarted","Data":"4a6dbc680531f2367f8cd4750905591c252c19ea1c8a9e97639ceb05e84921b0"}
Jul 12 08:26:35.530377 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:35.530305    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45" event={"ID":"c5829be0-d0c6-4204-a496-e46b4548e4bd","Type":"ContainerStarted","Data":"4ea380efb04e6c441cf13353e9aefdc40c71e6a45397b882318afc782ee3b07d"}
Jul 12 08:26:35.547064 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:35.547013    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6lr45" podStartSLOduration=0.823785294 podStartE2EDuration="2.546996653s" totalImagesPullingTime="1.723211359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:26:35.545479617 +0000 UTC m=+298.124938106" watchObservedRunningTime="2026-07-12 08:26:35.546996653 +0000 UTC m=+298.126455129"
Jul 12 08:26:37.756433 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:37.756405    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:26:37.756868 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:37.756405    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:26:37.759389 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:37.759371    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 08:26:38.106580 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.106504    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"]
Jul 12 08:26:38.110179 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.110162    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.112831 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.112808    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 08:26:38.113758 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.113738    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 08:26:38.113899 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.113737    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c5sk5\""
Jul 12 08:26:38.118029 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.118004    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"]
Jul 12 08:26:38.242288 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.242259    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.242461 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.242301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.242461 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.242336    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmvvf\" (UniqueName: \"kubernetes.io/projected/5a81b332-2270-4cb5-b96c-db457f3f20fd-kube-api-access-bmvvf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.343332 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.343307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.343408 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.343341    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.343408 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.343361    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmvvf\" (UniqueName: \"kubernetes.io/projected/5a81b332-2270-4cb5-b96c-db457f3f20fd-kube-api-access-bmvvf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.343649 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.343630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.343719 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.343703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.352224 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.352204    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmvvf\" (UniqueName: \"kubernetes.io/projected/5a81b332-2270-4cb5-b96c-db457f3f20fd-kube-api-access-bmvvf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.419430 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.419407    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:38.549264 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:38.549235    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"]
Jul 12 08:26:38.552082 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:26:38.552049    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a81b332_2270_4cb5_b96c_db457f3f20fd.slice/crio-6f39862fcd3c7db7dee79bd9679af1c73013fb3fceb46d23b856d42382b4ab5f WatchSource:0}: Error finding container 6f39862fcd3c7db7dee79bd9679af1c73013fb3fceb46d23b856d42382b4ab5f: Status 404 returned error can't find the container with id 6f39862fcd3c7db7dee79bd9679af1c73013fb3fceb46d23b856d42382b4ab5f
Jul 12 08:26:39.547931 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:39.547899    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a81b332-2270-4cb5-b96c-db457f3f20fd" containerID="ab20a0af63911a01a9ebca362e59d5fbbc9322b310de906c49cce4443c19b74d" exitCode=0
Jul 12 08:26:39.548263 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:39.547982    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq" event={"ID":"5a81b332-2270-4cb5-b96c-db457f3f20fd","Type":"ContainerDied","Data":"ab20a0af63911a01a9ebca362e59d5fbbc9322b310de906c49cce4443c19b74d"}
Jul 12 08:26:39.548263 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:39.548030    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq" event={"ID":"5a81b332-2270-4cb5-b96c-db457f3f20fd","Type":"ContainerStarted","Data":"6f39862fcd3c7db7dee79bd9679af1c73013fb3fceb46d23b856d42382b4ab5f"}
Jul 12 08:26:39.548393 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:39.548379    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:26:40.554498 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:40.554463    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a81b332-2270-4cb5-b96c-db457f3f20fd" containerID="6001ee22c0a41d304469a2066355ec5d6b7e320bbae6ee2fa9a1972a096d36f7" exitCode=0
Jul 12 08:26:40.554923 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:40.554557    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq" event={"ID":"5a81b332-2270-4cb5-b96c-db457f3f20fd","Type":"ContainerDied","Data":"6001ee22c0a41d304469a2066355ec5d6b7e320bbae6ee2fa9a1972a096d36f7"}
Jul 12 08:26:41.562152 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:41.562116    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a81b332-2270-4cb5-b96c-db457f3f20fd" containerID="22c34a44aa2e91e91ad7a86bb54fb1cbc317ae707b1d4cd2747354793dfad719" exitCode=0
Jul 12 08:26:41.562564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:41.562194    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq" event={"ID":"5a81b332-2270-4cb5-b96c-db457f3f20fd","Type":"ContainerDied","Data":"22c34a44aa2e91e91ad7a86bb54fb1cbc317ae707b1d4cd2747354793dfad719"}
Jul 12 08:26:42.691672 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:42.691650    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:42.783810 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:42.783780    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-util\") pod \"5a81b332-2270-4cb5-b96c-db457f3f20fd\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") "
Jul 12 08:26:42.784024 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:42.783824    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmvvf\" (UniqueName: \"kubernetes.io/projected/5a81b332-2270-4cb5-b96c-db457f3f20fd-kube-api-access-bmvvf\") pod \"5a81b332-2270-4cb5-b96c-db457f3f20fd\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") "
Jul 12 08:26:42.784024 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:42.783843    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-bundle\") pod \"5a81b332-2270-4cb5-b96c-db457f3f20fd\" (UID: \"5a81b332-2270-4cb5-b96c-db457f3f20fd\") "
Jul 12 08:26:42.784538 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:42.784511    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-bundle" (OuterVolumeSpecName: "bundle") pod "5a81b332-2270-4cb5-b96c-db457f3f20fd" (UID: "5a81b332-2270-4cb5-b96c-db457f3f20fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:26:42.785842 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:42.785818    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a81b332-2270-4cb5-b96c-db457f3f20fd-kube-api-access-bmvvf" (OuterVolumeSpecName: "kube-api-access-bmvvf") pod "5a81b332-2270-4cb5-b96c-db457f3f20fd" (UID: "5a81b332-2270-4cb5-b96c-db457f3f20fd"). InnerVolumeSpecName "kube-api-access-bmvvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:26:42.789371 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:42.789349    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-util" (OuterVolumeSpecName: "util") pod "5a81b332-2270-4cb5-b96c-db457f3f20fd" (UID: "5a81b332-2270-4cb5-b96c-db457f3f20fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:26:42.885408 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:42.885350    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-util\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:26:42.885408 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:42.885377    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmvvf\" (UniqueName: \"kubernetes.io/projected/5a81b332-2270-4cb5-b96c-db457f3f20fd-kube-api-access-bmvvf\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:26:42.885408 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:42.885386    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a81b332-2270-4cb5-b96c-db457f3f20fd-bundle\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:26:43.572263 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:43.572236    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq"
Jul 12 08:26:43.572263 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:43.572246    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2xpq" event={"ID":"5a81b332-2270-4cb5-b96c-db457f3f20fd","Type":"ContainerDied","Data":"6f39862fcd3c7db7dee79bd9679af1c73013fb3fceb46d23b856d42382b4ab5f"}
Jul 12 08:26:43.572452 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:43.572287    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f39862fcd3c7db7dee79bd9679af1c73013fb3fceb46d23b856d42382b4ab5f"
Jul 12 08:26:54.490764 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.490731    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"]
Jul 12 08:26:54.491153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.491024    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a81b332-2270-4cb5-b96c-db457f3f20fd" containerName="extract"
Jul 12 08:26:54.491153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.491035    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a81b332-2270-4cb5-b96c-db457f3f20fd" containerName="extract"
Jul 12 08:26:54.491153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.491045    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a81b332-2270-4cb5-b96c-db457f3f20fd" containerName="util"
Jul 12 08:26:54.491153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.491050    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a81b332-2270-4cb5-b96c-db457f3f20fd" containerName="util"
Jul 12 08:26:54.491153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.491058    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a81b332-2270-4cb5-b96c-db457f3f20fd" containerName="pull"
Jul 12 08:26:54.491153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.491063    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a81b332-2270-4cb5-b96c-db457f3f20fd" containerName="pull"
Jul 12 08:26:54.491153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.491114    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a81b332-2270-4cb5-b96c-db457f3f20fd" containerName="extract"
Jul 12 08:26:54.497021 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.497002    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.499993 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.499962    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 08:26:54.500106 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.500037    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 08:26:54.500197 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.500106    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 08:26:54.500197 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.500147    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xhbr4\""
Jul 12 08:26:54.500380 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.500367    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 08:26:54.514178 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.514158    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"]
Jul 12 08:26:54.685086 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.685053    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/134d816b-7600-46e7-8147-61a0a3158773-tmp\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.685256 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.685115    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qwl5\" (UniqueName: \"kubernetes.io/projected/134d816b-7600-46e7-8147-61a0a3158773-kube-api-access-2qwl5\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.685256 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.685148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/134d816b-7600-46e7-8147-61a0a3158773-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.685256 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.685189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/134d816b-7600-46e7-8147-61a0a3158773-manifests\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.685256 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.685241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/134d816b-7600-46e7-8147-61a0a3158773-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.785650 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.785566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/134d816b-7600-46e7-8147-61a0a3158773-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.785650 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.785621    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/134d816b-7600-46e7-8147-61a0a3158773-tmp\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.785902 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.785674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qwl5\" (UniqueName: \"kubernetes.io/projected/134d816b-7600-46e7-8147-61a0a3158773-kube-api-access-2qwl5\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.785902 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.785705    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/134d816b-7600-46e7-8147-61a0a3158773-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.785902 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.785743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/134d816b-7600-46e7-8147-61a0a3158773-manifests\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.786168 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.786148    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/134d816b-7600-46e7-8147-61a0a3158773-manifests\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.787925 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.787900    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/134d816b-7600-46e7-8147-61a0a3158773-tmp\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.788103 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.788086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/134d816b-7600-46e7-8147-61a0a3158773-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.788157 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.788142    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/134d816b-7600-46e7-8147-61a0a3158773-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.795004 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.794980    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qwl5\" (UniqueName: \"kubernetes.io/projected/134d816b-7600-46e7-8147-61a0a3158773-kube-api-access-2qwl5\") pod \"opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg\" (UID: \"134d816b-7600-46e7-8147-61a0a3158773\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.807400 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.807382    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:26:54.939917 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:54.939894    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"]
Jul 12 08:26:54.942544 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:26:54.942505    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod134d816b_7600_46e7_8147_61a0a3158773.slice/crio-5a9082eb131ea03dec8e1b1961891e836854ee81af06015e6b61be95717b15a2 WatchSource:0}: Error finding container 5a9082eb131ea03dec8e1b1961891e836854ee81af06015e6b61be95717b15a2: Status 404 returned error can't find the container with id 5a9082eb131ea03dec8e1b1961891e836854ee81af06015e6b61be95717b15a2
Jul 12 08:26:55.626820 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:55.626690    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg" event={"ID":"134d816b-7600-46e7-8147-61a0a3158773","Type":"ContainerStarted","Data":"5a9082eb131ea03dec8e1b1961891e836854ee81af06015e6b61be95717b15a2"}
Jul 12 08:26:58.643574 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:58.643534    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg" event={"ID":"134d816b-7600-46e7-8147-61a0a3158773","Type":"ContainerStarted","Data":"a1f091e9c5fb90855ea6fa8988e65e80708e5727f0ae4b736a2db181d01a816a"}
Jul 12 08:26:59.648905 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:59.648870    2583 generic.go:356] "Generic (PLEG): container finished" podID="134d816b-7600-46e7-8147-61a0a3158773" containerID="a1f091e9c5fb90855ea6fa8988e65e80708e5727f0ae4b736a2db181d01a816a" exitCode=0
Jul 12 08:26:59.649281 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:26:59.648944    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg" event={"ID":"134d816b-7600-46e7-8147-61a0a3158773","Type":"ContainerDied","Data":"a1f091e9c5fb90855ea6fa8988e65e80708e5727f0ae4b736a2db181d01a816a"}
Jul 12 08:27:00.656060 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:00.656028    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg" event={"ID":"134d816b-7600-46e7-8147-61a0a3158773","Type":"ContainerStarted","Data":"2886a76bf01600eb28212ba6812f786cc2465208d5485807de347845e2a61f91"}
Jul 12 08:27:00.656492 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:00.656144    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:27:00.682126 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:00.682074    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg" podStartSLOduration=2.405645203 podStartE2EDuration="6.682053077s" totalImagesPullingTime="3.228751036s" totalInitContainerRuntime="1.047656838s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:26:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:27:00.679900008 +0000 UTC m=+323.259358485" watchObservedRunningTime="2026-07-12 08:27:00.682053077 +0000 UTC m=+323.261511554"
Jul 12 08:27:11.662997 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:11.662966    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg"
Jul 12 08:27:13.840226 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.840190    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"]
Jul 12 08:27:13.850396 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.850374    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:13.861560 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.861541    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-s4z96\""
Jul 12 08:27:13.861681 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.861618    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"]
Jul 12 08:27:13.861681 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.861646    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 12 08:27:13.861779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.861736    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 12 08:27:13.862034 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.862019    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 12 08:27:13.862665 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.862648    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 12 08:27:13.932604 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.932570    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-tmp\") pod \"kube-auth-proxy-77c9f9759d-vvdwl\" (UID: \"66ba9701-0ebc-4cb3-bca2-32e4eb04f026\") " pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:13.932604 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.932613    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-tls-certs\") pod \"kube-auth-proxy-77c9f9759d-vvdwl\" (UID: \"66ba9701-0ebc-4cb3-bca2-32e4eb04f026\") " pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:13.932825 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:13.932661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qpcb\" (UniqueName: \"kubernetes.io/projected/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-kube-api-access-5qpcb\") pod \"kube-auth-proxy-77c9f9759d-vvdwl\" (UID: \"66ba9701-0ebc-4cb3-bca2-32e4eb04f026\") " pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:14.034022 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.033976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-tmp\") pod \"kube-auth-proxy-77c9f9759d-vvdwl\" (UID: \"66ba9701-0ebc-4cb3-bca2-32e4eb04f026\") " pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:14.034022 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.034024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-tls-certs\") pod \"kube-auth-proxy-77c9f9759d-vvdwl\" (UID: \"66ba9701-0ebc-4cb3-bca2-32e4eb04f026\") " pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:14.034285 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:27:14.034122    2583 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 12 08:27:14.034285 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.034159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qpcb\" (UniqueName: \"kubernetes.io/projected/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-kube-api-access-5qpcb\") pod \"kube-auth-proxy-77c9f9759d-vvdwl\" (UID: \"66ba9701-0ebc-4cb3-bca2-32e4eb04f026\") " pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:14.034285 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:27:14.034184    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-tls-certs podName:66ba9701-0ebc-4cb3-bca2-32e4eb04f026 nodeName:}" failed. No retries permitted until 2026-07-12 08:27:14.534166752 +0000 UTC m=+337.113625208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-tls-certs") pod "kube-auth-proxy-77c9f9759d-vvdwl" (UID: "66ba9701-0ebc-4cb3-bca2-32e4eb04f026") : secret "kube-auth-proxy-tls" not found
Jul 12 08:27:14.036344 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.036320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-tmp\") pod \"kube-auth-proxy-77c9f9759d-vvdwl\" (UID: \"66ba9701-0ebc-4cb3-bca2-32e4eb04f026\") " pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:14.053751 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.053731    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qpcb\" (UniqueName: \"kubernetes.io/projected/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-kube-api-access-5qpcb\") pod \"kube-auth-proxy-77c9f9759d-vvdwl\" (UID: \"66ba9701-0ebc-4cb3-bca2-32e4eb04f026\") " pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:14.274104 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.274073    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7jclt"]
Jul 12 08:27:14.278129 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.278103    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:14.282341 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.282321    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8lnm9\""
Jul 12 08:27:14.282873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.282842    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 12 08:27:14.298035 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.298007    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7jclt"]
Jul 12 08:27:14.336350 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.336311    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da53cd6a-2463-4d8d-81af-de3ba90e3429-cert\") pod \"odh-model-controller-7998c67dc4-7jclt\" (UID: \"da53cd6a-2463-4d8d-81af-de3ba90e3429\") " pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:14.336539 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.336381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsn5z\" (UniqueName: \"kubernetes.io/projected/da53cd6a-2463-4d8d-81af-de3ba90e3429-kube-api-access-gsn5z\") pod \"odh-model-controller-7998c67dc4-7jclt\" (UID: \"da53cd6a-2463-4d8d-81af-de3ba90e3429\") " pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:14.437086 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.437040    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsn5z\" (UniqueName: \"kubernetes.io/projected/da53cd6a-2463-4d8d-81af-de3ba90e3429-kube-api-access-gsn5z\") pod \"odh-model-controller-7998c67dc4-7jclt\" (UID: \"da53cd6a-2463-4d8d-81af-de3ba90e3429\") " pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:14.437267 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.437166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da53cd6a-2463-4d8d-81af-de3ba90e3429-cert\") pod \"odh-model-controller-7998c67dc4-7jclt\" (UID: \"da53cd6a-2463-4d8d-81af-de3ba90e3429\") " pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:14.437336 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:27:14.437277    2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 12 08:27:14.437396 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:27:14.437341    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da53cd6a-2463-4d8d-81af-de3ba90e3429-cert podName:da53cd6a-2463-4d8d-81af-de3ba90e3429 nodeName:}" failed. No retries permitted until 2026-07-12 08:27:14.937322201 +0000 UTC m=+337.516780660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/da53cd6a-2463-4d8d-81af-de3ba90e3429-cert") pod "odh-model-controller-7998c67dc4-7jclt" (UID: "da53cd6a-2463-4d8d-81af-de3ba90e3429") : secret "odh-model-controller-webhook-cert" not found
Jul 12 08:27:14.446092 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.446060    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsn5z\" (UniqueName: \"kubernetes.io/projected/da53cd6a-2463-4d8d-81af-de3ba90e3429-kube-api-access-gsn5z\") pod \"odh-model-controller-7998c67dc4-7jclt\" (UID: \"da53cd6a-2463-4d8d-81af-de3ba90e3429\") " pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:14.538077 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.537995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-tls-certs\") pod \"kube-auth-proxy-77c9f9759d-vvdwl\" (UID: \"66ba9701-0ebc-4cb3-bca2-32e4eb04f026\") " pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:14.540446 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.540419    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66ba9701-0ebc-4cb3-bca2-32e4eb04f026-tls-certs\") pod \"kube-auth-proxy-77c9f9759d-vvdwl\" (UID: \"66ba9701-0ebc-4cb3-bca2-32e4eb04f026\") " pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:14.760086 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.760053    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"
Jul 12 08:27:14.898898 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.898862    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl"]
Jul 12 08:27:14.902523 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:27:14.902493    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ba9701_0ebc_4cb3_bca2_32e4eb04f026.slice/crio-74b63d3ddfa6b7d69285b67346e3af17f96fdafa0bbe5d774e5b836b9eab1c09 WatchSource:0}: Error finding container 74b63d3ddfa6b7d69285b67346e3af17f96fdafa0bbe5d774e5b836b9eab1c09: Status 404 returned error can't find the container with id 74b63d3ddfa6b7d69285b67346e3af17f96fdafa0bbe5d774e5b836b9eab1c09
Jul 12 08:27:14.943048 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.943021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da53cd6a-2463-4d8d-81af-de3ba90e3429-cert\") pod \"odh-model-controller-7998c67dc4-7jclt\" (UID: \"da53cd6a-2463-4d8d-81af-de3ba90e3429\") " pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:14.945430 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:14.945408    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da53cd6a-2463-4d8d-81af-de3ba90e3429-cert\") pod \"odh-model-controller-7998c67dc4-7jclt\" (UID: \"da53cd6a-2463-4d8d-81af-de3ba90e3429\") " pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:15.189745 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.189490    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:15.226516 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.226475    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lj8sf"]
Jul 12 08:27:15.231565 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.231541    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf"
Jul 12 08:27:15.234954 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.234927    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 12 08:27:15.249560 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.249494    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lj8sf"]
Jul 12 08:27:15.346574 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.346543    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv8kb\" (UniqueName: \"kubernetes.io/projected/69623788-1986-4f09-8807-43bc0312834c-kube-api-access-jv8kb\") pod \"model-serving-api-54d89bd5fc-lj8sf\" (UID: \"69623788-1986-4f09-8807-43bc0312834c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf"
Jul 12 08:27:15.346707 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.346602    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69623788-1986-4f09-8807-43bc0312834c-tls-certs\") pod \"model-serving-api-54d89bd5fc-lj8sf\" (UID: \"69623788-1986-4f09-8807-43bc0312834c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf"
Jul 12 08:27:15.360930 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.360726    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7jclt"]
Jul 12 08:27:15.363567 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:27:15.363538    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda53cd6a_2463_4d8d_81af_de3ba90e3429.slice/crio-9c2b6b24cda946a82514bfef385f4cf3084d21b5f94657c475267d9009c08c41 WatchSource:0}: Error finding container 9c2b6b24cda946a82514bfef385f4cf3084d21b5f94657c475267d9009c08c41: Status 404 returned error can't find the container with id 9c2b6b24cda946a82514bfef385f4cf3084d21b5f94657c475267d9009c08c41
Jul 12 08:27:15.447217 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.447138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv8kb\" (UniqueName: \"kubernetes.io/projected/69623788-1986-4f09-8807-43bc0312834c-kube-api-access-jv8kb\") pod \"model-serving-api-54d89bd5fc-lj8sf\" (UID: \"69623788-1986-4f09-8807-43bc0312834c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf"
Jul 12 08:27:15.447217 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.447196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69623788-1986-4f09-8807-43bc0312834c-tls-certs\") pod \"model-serving-api-54d89bd5fc-lj8sf\" (UID: \"69623788-1986-4f09-8807-43bc0312834c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf"
Jul 12 08:27:15.449550 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.449522    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69623788-1986-4f09-8807-43bc0312834c-tls-certs\") pod \"model-serving-api-54d89bd5fc-lj8sf\" (UID: \"69623788-1986-4f09-8807-43bc0312834c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf"
Jul 12 08:27:15.456187 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.456164    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv8kb\" (UniqueName: \"kubernetes.io/projected/69623788-1986-4f09-8807-43bc0312834c-kube-api-access-jv8kb\") pod \"model-serving-api-54d89bd5fc-lj8sf\" (UID: \"69623788-1986-4f09-8807-43bc0312834c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf"
Jul 12 08:27:15.544465 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.544429    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf"
Jul 12 08:27:15.697564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.697506    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lj8sf"]
Jul 12 08:27:15.699500 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:27:15.699459    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69623788_1986_4f09_8807_43bc0312834c.slice/crio-d97433fc439ec73b5117576accd4a4aa68bb2dc2db7160884a5a4288c223aa7a WatchSource:0}: Error finding container d97433fc439ec73b5117576accd4a4aa68bb2dc2db7160884a5a4288c223aa7a: Status 404 returned error can't find the container with id d97433fc439ec73b5117576accd4a4aa68bb2dc2db7160884a5a4288c223aa7a
Jul 12 08:27:15.726193 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.726144    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl" event={"ID":"66ba9701-0ebc-4cb3-bca2-32e4eb04f026","Type":"ContainerStarted","Data":"74b63d3ddfa6b7d69285b67346e3af17f96fdafa0bbe5d774e5b836b9eab1c09"}
Jul 12 08:27:15.727589 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.727557    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf" event={"ID":"69623788-1986-4f09-8807-43bc0312834c","Type":"ContainerStarted","Data":"d97433fc439ec73b5117576accd4a4aa68bb2dc2db7160884a5a4288c223aa7a"}
Jul 12 08:27:15.729059 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:15.729033    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7jclt" event={"ID":"da53cd6a-2463-4d8d-81af-de3ba90e3429","Type":"ContainerStarted","Data":"9c2b6b24cda946a82514bfef385f4cf3084d21b5f94657c475267d9009c08c41"}
Jul 12 08:27:19.753764 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:19.753722    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl" event={"ID":"66ba9701-0ebc-4cb3-bca2-32e4eb04f026","Type":"ContainerStarted","Data":"bd37abd56d33f75b60dcad34ff9a4e4b01b4cc3ee86e3317f1024683472d0d43"}
Jul 12 08:27:19.755180 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:19.755158    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf" event={"ID":"69623788-1986-4f09-8807-43bc0312834c","Type":"ContainerStarted","Data":"e9a95b2691850054536042ff743e0f3d7316ecd4635c754e605786ead29c6ec6"}
Jul 12 08:27:19.755242 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:19.755204    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf"
Jul 12 08:27:19.756562 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:19.756538    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7jclt" event={"ID":"da53cd6a-2463-4d8d-81af-de3ba90e3429","Type":"ContainerStarted","Data":"f745fb5ca044dba7d01cc0cbdd70a9e482f2783bc2912cc3942d7ee730534bdb"}
Jul 12 08:27:19.756653 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:19.756596    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:19.772913 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:19.772866    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77c9f9759d-vvdwl" podStartSLOduration=2.281736542 podStartE2EDuration="6.772840767s" totalImagesPullingTime="4.491104225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:27:19.770639974 +0000 UTC m=+342.350098453" watchObservedRunningTime="2026-07-12 08:27:19.772840767 +0000 UTC m=+342.352299244"
Jul 12 08:27:19.793457 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:19.793406    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf" podStartSLOduration=1.099675729 podStartE2EDuration="4.793392029s" totalImagesPullingTime="3.6937163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:27:19.791218407 +0000 UTC m=+342.370676901" watchObservedRunningTime="2026-07-12 08:27:19.793392029 +0000 UTC m=+342.372850485"
Jul 12 08:27:19.812263 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:19.812215    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-7jclt" podStartSLOduration=1.7249928639999998 podStartE2EDuration="5.812198757s" totalImagesPullingTime="4.087205893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:27:19.810455754 +0000 UTC m=+342.389914245" watchObservedRunningTime="2026-07-12 08:27:19.812198757 +0000 UTC m=+342.391657235"
Jul 12 08:27:20.226631 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.226594    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"]
Jul 12 08:27:20.230034 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.230007    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.233642 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.233619    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 08:27:20.233767 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.233619    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-97xl9\""
Jul 12 08:27:20.243798 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.243773    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"]
Jul 12 08:27:20.294578 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.294526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.294578 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.294569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.294827 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.294591    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.294827 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.294622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06f2ff14-cdef-424d-80fc-1f4e8126676f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.294827 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.294760    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.294827 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.294803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.295041 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.294843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.295041 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.294896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xsdj\" (UniqueName: \"kubernetes.io/projected/06f2ff14-cdef-424d-80fc-1f4e8126676f-kube-api-access-2xsdj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.295041 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.294927    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.395766 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.395724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.395961 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.395772    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.395961 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.395809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06f2ff14-cdef-424d-80fc-1f4e8126676f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.395961 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.395914    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.395961 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.395944    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.396196 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.395979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.396196 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.396018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xsdj\" (UniqueName: \"kubernetes.io/projected/06f2ff14-cdef-424d-80fc-1f4e8126676f-kube-api-access-2xsdj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.396196 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.396045    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.396196 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.396081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.396470 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.396447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.396755 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.396682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.396873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.396811    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06f2ff14-cdef-424d-80fc-1f4e8126676f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.397141 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.397116    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.397428 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.397406    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.399366 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.399343    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.399466 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.399411    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.404419 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.404390    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06f2ff14-cdef-424d-80fc-1f4e8126676f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.405786 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.405764    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xsdj\" (UniqueName: \"kubernetes.io/projected/06f2ff14-cdef-424d-80fc-1f4e8126676f-kube-api-access-2xsdj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zgrqh\" (UID: \"06f2ff14-cdef-424d-80fc-1f4e8126676f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.541401 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.541326    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:20.685583 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.685552    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"]
Jul 12 08:27:20.688897 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:27:20.688870    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f2ff14_cdef_424d_80fc_1f4e8126676f.slice/crio-adb5a4b58731aa76dca0bb0345d556e4fb0758a0c829e2f877a6c5e84b240b0f WatchSource:0}: Error finding container adb5a4b58731aa76dca0bb0345d556e4fb0758a0c829e2f877a6c5e84b240b0f: Status 404 returned error can't find the container with id adb5a4b58731aa76dca0bb0345d556e4fb0758a0c829e2f877a6c5e84b240b0f
Jul 12 08:27:20.762278 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:20.762245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh" event={"ID":"06f2ff14-cdef-424d-80fc-1f4e8126676f","Type":"ContainerStarted","Data":"adb5a4b58731aa76dca0bb0345d556e4fb0758a0c829e2f877a6c5e84b240b0f"}
Jul 12 08:27:21.139533 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.139499    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"]
Jul 12 08:27:21.144098 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.144075    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.148367 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.148342    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xrctc\""
Jul 12 08:27:21.149033 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.149003    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 12 08:27:21.149139 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.149005    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 12 08:27:21.154583 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.154560    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"]
Jul 12 08:27:21.169822 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.169797    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 12 08:27:21.204070 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.204046    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtfz9\" (UniqueName: \"kubernetes.io/projected/1a9a96bb-3978-4378-8c4a-7be77fbde70c-kube-api-access-mtfz9\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.204187 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.204080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a9a96bb-3978-4378-8c4a-7be77fbde70c-cert\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.204187 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.204098    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a9a96bb-3978-4378-8c4a-7be77fbde70c-metrics-cert\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.204187 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.204120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1a9a96bb-3978-4378-8c4a-7be77fbde70c-manager-config\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.305190 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.305155    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtfz9\" (UniqueName: \"kubernetes.io/projected/1a9a96bb-3978-4378-8c4a-7be77fbde70c-kube-api-access-mtfz9\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.305190 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.305195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a9a96bb-3978-4378-8c4a-7be77fbde70c-cert\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.305367 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.305211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a9a96bb-3978-4378-8c4a-7be77fbde70c-metrics-cert\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.305440 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.305415    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1a9a96bb-3978-4378-8c4a-7be77fbde70c-manager-config\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.306315 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.306289    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1a9a96bb-3978-4378-8c4a-7be77fbde70c-manager-config\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.308066 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.308046    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a9a96bb-3978-4378-8c4a-7be77fbde70c-cert\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.308152 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.308077    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a9a96bb-3978-4378-8c4a-7be77fbde70c-metrics-cert\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.321119 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.321100    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtfz9\" (UniqueName: \"kubernetes.io/projected/1a9a96bb-3978-4378-8c4a-7be77fbde70c-kube-api-access-mtfz9\") pod \"lws-controller-manager-7cb89b9bb7-s6wm6\" (UID: \"1a9a96bb-3978-4378-8c4a-7be77fbde70c\") " pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.455666 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.455615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:21.616879 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.616834    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"]
Jul 12 08:27:21.618810 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:27:21.618767    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9a96bb_3978_4378_8c4a_7be77fbde70c.slice/crio-70362e42bbd23f37d1e81f3d268824d44a4e7fe6c6c46c173fcd7b8264a6c335 WatchSource:0}: Error finding container 70362e42bbd23f37d1e81f3d268824d44a4e7fe6c6c46c173fcd7b8264a6c335: Status 404 returned error can't find the container with id 70362e42bbd23f37d1e81f3d268824d44a4e7fe6c6c46c173fcd7b8264a6c335
Jul 12 08:27:21.778106 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:21.778020    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6" event={"ID":"1a9a96bb-3978-4378-8c4a-7be77fbde70c","Type":"ContainerStarted","Data":"70362e42bbd23f37d1e81f3d268824d44a4e7fe6c6c46c173fcd7b8264a6c335"}
Jul 12 08:27:23.919634 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:23.919593    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:27:23.919947 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:23.919675    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:27:23.919947 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:23.919717    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:27:24.796719 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:24.796680    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6" event={"ID":"1a9a96bb-3978-4378-8c4a-7be77fbde70c","Type":"ContainerStarted","Data":"ef093e8eb550788223c8075c434a85d51ef668bd3be824e062f7cf86b6e257d7"}
Jul 12 08:27:24.796936 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:24.796741    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:27:24.798272 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:24.798244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh" event={"ID":"06f2ff14-cdef-424d-80fc-1f4e8126676f","Type":"ContainerStarted","Data":"a8ac271605e004ebded059520e2e6fc4ee8699e2a1bfe1970df0f23a101197b7"}
Jul 12 08:27:24.825971 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:24.825931    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6" podStartSLOduration=1.529766062 podStartE2EDuration="3.825918222s" totalImagesPullingTime="2.29615216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:27:24.822259581 +0000 UTC m=+347.401718059" watchObservedRunningTime="2026-07-12 08:27:24.825918222 +0000 UTC m=+347.405376699"
Jul 12 08:27:24.889073 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:24.889024    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh" podStartSLOduration=1.661130781 podStartE2EDuration="4.889007627s" totalImagesPullingTime="3.227876846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:27:24.887172665 +0000 UTC m=+347.466631145" watchObservedRunningTime="2026-07-12 08:27:24.889007627 +0000 UTC m=+347.468466182"
Jul 12 08:27:25.542361 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:25.542328    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:25.546821 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:25.546800    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:25.804631 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:25.804540    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:25.805771 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:25.805750    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zgrqh"
Jul 12 08:27:30.764685 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:30.764584    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-7jclt"
Jul 12 08:27:30.766596 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:30.766577    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lj8sf"
Jul 12 08:27:35.806826 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:27:35.806797    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7cb89b9bb7-s6wm6"
Jul 12 08:28:30.354802 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.354761    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"]
Jul 12 08:28:30.358222 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.358204    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.360779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.360756    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 08:28:30.360779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.360769    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mtxpk\""
Jul 12 08:28:30.361915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.361899    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 08:28:30.371738 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.371714    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"]
Jul 12 08:28:30.480142 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.480106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4lzk\" (UniqueName: \"kubernetes.io/projected/6abd4595-3811-4b99-be53-b8fe3cedc6d4-kube-api-access-m4lzk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.480289 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.480162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.480289 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.480273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.581116 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.581077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4lzk\" (UniqueName: \"kubernetes.io/projected/6abd4595-3811-4b99-be53-b8fe3cedc6d4-kube-api-access-m4lzk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.581260 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.581137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.581260 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.581195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.581624 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.581604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.581660 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.581622    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.589253 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.589233    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4lzk\" (UniqueName: \"kubernetes.io/projected/6abd4595-3811-4b99-be53-b8fe3cedc6d4-kube-api-access-m4lzk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.670745 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.670724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:30.803313 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.803271    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"]
Jul 12 08:28:30.805710 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:28:30.805682    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6abd4595_3811_4b99_be53_b8fe3cedc6d4.slice/crio-6435fb568300be9d7c77eba6255a798b4b2fe8979bfa6a5db6a2733e4d4d456d WatchSource:0}: Error finding container 6435fb568300be9d7c77eba6255a798b4b2fe8979bfa6a5db6a2733e4d4d456d: Status 404 returned error can't find the container with id 6435fb568300be9d7c77eba6255a798b4b2fe8979bfa6a5db6a2733e4d4d456d
Jul 12 08:28:30.950388 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.950323    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"]
Jul 12 08:28:30.953773 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.953757    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:30.964897 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:30.964873    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"]
Jul 12 08:28:31.084836 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.084807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:31.084986 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.084880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwgc8\" (UniqueName: \"kubernetes.io/projected/d4105692-14fa-4466-b30a-db52e34654a9-kube-api-access-wwgc8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:31.084986 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.084916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:31.105314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.105287    2583 generic.go:356] "Generic (PLEG): container finished" podID="6abd4595-3811-4b99-be53-b8fe3cedc6d4" containerID="140df2942115eb363b05a66dd319852ce0fca2b652c036fcaf44ffffdcbdc138" exitCode=0
Jul 12 08:28:31.105428 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.105368    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4" event={"ID":"6abd4595-3811-4b99-be53-b8fe3cedc6d4","Type":"ContainerDied","Data":"140df2942115eb363b05a66dd319852ce0fca2b652c036fcaf44ffffdcbdc138"}
Jul 12 08:28:31.105428 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.105414    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4" event={"ID":"6abd4595-3811-4b99-be53-b8fe3cedc6d4","Type":"ContainerStarted","Data":"6435fb568300be9d7c77eba6255a798b4b2fe8979bfa6a5db6a2733e4d4d456d"}
Jul 12 08:28:31.186156 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.186121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwgc8\" (UniqueName: \"kubernetes.io/projected/d4105692-14fa-4466-b30a-db52e34654a9-kube-api-access-wwgc8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:31.186291 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.186177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:31.186291 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.186247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:31.186568 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.186548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:31.186631 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.186568    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:31.198711 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.198691    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwgc8\" (UniqueName: \"kubernetes.io/projected/d4105692-14fa-4466-b30a-db52e34654a9-kube-api-access-wwgc8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:31.272438 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.272375    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:31.401478 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.401455    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"]
Jul 12 08:28:31.402880 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:28:31.402832    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4105692_14fa_4466_b30a_db52e34654a9.slice/crio-fb8c8a92eb059b780d6d5fbb8415dd57ee2102a95397dda7737cab4ad143b60f WatchSource:0}: Error finding container fb8c8a92eb059b780d6d5fbb8415dd57ee2102a95397dda7737cab4ad143b60f: Status 404 returned error can't find the container with id fb8c8a92eb059b780d6d5fbb8415dd57ee2102a95397dda7737cab4ad143b60f
Jul 12 08:28:31.551198 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.551136    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"]
Jul 12 08:28:31.554472 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.554458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.563007 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.562985    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"]
Jul 12 08:28:31.690640 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.690613    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.690801 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.690669    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.690801 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.690763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mfmn\" (UniqueName: \"kubernetes.io/projected/74c678bc-6d58-48eb-9c4b-2eca0f641b50-kube-api-access-8mfmn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.791554 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.791530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.791666 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.791597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mfmn\" (UniqueName: \"kubernetes.io/projected/74c678bc-6d58-48eb-9c4b-2eca0f641b50-kube-api-access-8mfmn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.791666 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.791655    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.791926 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.791898    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.792044 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.791964    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.800432 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.800411    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mfmn\" (UniqueName: \"kubernetes.io/projected/74c678bc-6d58-48eb-9c4b-2eca0f641b50-kube-api-access-8mfmn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.864062 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.864039    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:31.989494 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:31.989460    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"]
Jul 12 08:28:31.992575 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:28:31.992551    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c678bc_6d58_48eb_9c4b_2eca0f641b50.slice/crio-2cfcdaa8cded35a4dce28416c322029d3ecd20f8376e55ab95e1489c7c0c6768 WatchSource:0}: Error finding container 2cfcdaa8cded35a4dce28416c322029d3ecd20f8376e55ab95e1489c7c0c6768: Status 404 returned error can't find the container with id 2cfcdaa8cded35a4dce28416c322029d3ecd20f8376e55ab95e1489c7c0c6768
Jul 12 08:28:32.113827 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.113798    2583 generic.go:356] "Generic (PLEG): container finished" podID="d4105692-14fa-4466-b30a-db52e34654a9" containerID="9cf18fcd3dd7c3871a95c2528474c16abca766724d16209dc9de5368e3778e04" exitCode=0
Jul 12 08:28:32.113989 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.113889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv" event={"ID":"d4105692-14fa-4466-b30a-db52e34654a9","Type":"ContainerDied","Data":"9cf18fcd3dd7c3871a95c2528474c16abca766724d16209dc9de5368e3778e04"}
Jul 12 08:28:32.113989 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.113948    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv" event={"ID":"d4105692-14fa-4466-b30a-db52e34654a9","Type":"ContainerStarted","Data":"fb8c8a92eb059b780d6d5fbb8415dd57ee2102a95397dda7737cab4ad143b60f"}
Jul 12 08:28:32.115880 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.115839    2583 generic.go:356] "Generic (PLEG): container finished" podID="6abd4595-3811-4b99-be53-b8fe3cedc6d4" containerID="206d41e39805916d802448767851636dab5abc8fb4fb862ebe1a79b79b47f537" exitCode=0
Jul 12 08:28:32.116003 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.115887    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4" event={"ID":"6abd4595-3811-4b99-be53-b8fe3cedc6d4","Type":"ContainerDied","Data":"206d41e39805916d802448767851636dab5abc8fb4fb862ebe1a79b79b47f537"}
Jul 12 08:28:32.117605 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.117577    2583 generic.go:356] "Generic (PLEG): container finished" podID="74c678bc-6d58-48eb-9c4b-2eca0f641b50" containerID="9d1e2f63fb151701dcfd0d15a75706c481bbe29d305384aa15dc95fc75e4ce29" exitCode=0
Jul 12 08:28:32.117679 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.117643    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m" event={"ID":"74c678bc-6d58-48eb-9c4b-2eca0f641b50","Type":"ContainerDied","Data":"9d1e2f63fb151701dcfd0d15a75706c481bbe29d305384aa15dc95fc75e4ce29"}
Jul 12 08:28:32.117679 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.117674    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m" event={"ID":"74c678bc-6d58-48eb-9c4b-2eca0f641b50","Type":"ContainerStarted","Data":"2cfcdaa8cded35a4dce28416c322029d3ecd20f8376e55ab95e1489c7c0c6768"}
Jul 12 08:28:32.162819 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.162796    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"]
Jul 12 08:28:32.167326 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.167309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.174536 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.174513    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"]
Jul 12 08:28:32.296791 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.296761    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.296943 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.296809    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdbcd\" (UniqueName: \"kubernetes.io/projected/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-kube-api-access-fdbcd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.296943 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.296922    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.398067 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.397995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.398067 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.398041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdbcd\" (UniqueName: \"kubernetes.io/projected/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-kube-api-access-fdbcd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.398280 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.398073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.398431 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.398408    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.398492 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.398433    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.406984 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.406957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdbcd\" (UniqueName: \"kubernetes.io/projected/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-kube-api-access-fdbcd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.485049 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.485022    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:32.611062 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:32.611037    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"]
Jul 12 08:28:32.613364 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:28:32.613335    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0074a57f_2c71_4aef_8df9_d02b7a8b1c34.slice/crio-26df09631bff51cd0dcc87a81519c34c9da3d52d261b9409731488e5e9cdd480 WatchSource:0}: Error finding container 26df09631bff51cd0dcc87a81519c34c9da3d52d261b9409731488e5e9cdd480: Status 404 returned error can't find the container with id 26df09631bff51cd0dcc87a81519c34c9da3d52d261b9409731488e5e9cdd480
Jul 12 08:28:33.124278 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:33.124251    2583 generic.go:356] "Generic (PLEG): container finished" podID="d4105692-14fa-4466-b30a-db52e34654a9" containerID="6b0aa19a43e834a07fe8c7935c5b74e4088a1353e04558158597c6bcea66017c" exitCode=0
Jul 12 08:28:33.124379 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:33.124334    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv" event={"ID":"d4105692-14fa-4466-b30a-db52e34654a9","Type":"ContainerDied","Data":"6b0aa19a43e834a07fe8c7935c5b74e4088a1353e04558158597c6bcea66017c"}
Jul 12 08:28:33.126575 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:33.126554    2583 generic.go:356] "Generic (PLEG): container finished" podID="6abd4595-3811-4b99-be53-b8fe3cedc6d4" containerID="fe0e5f7e529cb4102b7b52e3621e5c027ea67e3f115924d7037980a7a24ee308" exitCode=0
Jul 12 08:28:33.126673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:33.126591    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4" event={"ID":"6abd4595-3811-4b99-be53-b8fe3cedc6d4","Type":"ContainerDied","Data":"fe0e5f7e529cb4102b7b52e3621e5c027ea67e3f115924d7037980a7a24ee308"}
Jul 12 08:28:33.128422 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:33.128400    2583 generic.go:356] "Generic (PLEG): container finished" podID="74c678bc-6d58-48eb-9c4b-2eca0f641b50" containerID="3c28eef7a19f296ea989778d35e93b3c98779b59256fa1c30202d0671208f92c" exitCode=0
Jul 12 08:28:33.128503 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:33.128425    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m" event={"ID":"74c678bc-6d58-48eb-9c4b-2eca0f641b50","Type":"ContainerDied","Data":"3c28eef7a19f296ea989778d35e93b3c98779b59256fa1c30202d0671208f92c"}
Jul 12 08:28:33.130090 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:33.130055    2583 generic.go:356] "Generic (PLEG): container finished" podID="0074a57f-2c71-4aef-8df9-d02b7a8b1c34" containerID="e96341c969767a1a1f45ad8b9aabdb5693d43cc9e54d4883cfe3073f8d031283" exitCode=0
Jul 12 08:28:33.136509 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:33.130400    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx" event={"ID":"0074a57f-2c71-4aef-8df9-d02b7a8b1c34","Type":"ContainerDied","Data":"e96341c969767a1a1f45ad8b9aabdb5693d43cc9e54d4883cfe3073f8d031283"}
Jul 12 08:28:33.136509 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:33.130465    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx" event={"ID":"0074a57f-2c71-4aef-8df9-d02b7a8b1c34","Type":"ContainerStarted","Data":"26df09631bff51cd0dcc87a81519c34c9da3d52d261b9409731488e5e9cdd480"}
Jul 12 08:28:34.136912 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.136819    2583 generic.go:356] "Generic (PLEG): container finished" podID="d4105692-14fa-4466-b30a-db52e34654a9" containerID="e45ec920c43a379e94cd426e597790d36f5c90cc6a880fbfd1d4495cc1c1f1e4" exitCode=0
Jul 12 08:28:34.137304 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.136905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv" event={"ID":"d4105692-14fa-4466-b30a-db52e34654a9","Type":"ContainerDied","Data":"e45ec920c43a379e94cd426e597790d36f5c90cc6a880fbfd1d4495cc1c1f1e4"}
Jul 12 08:28:34.138912 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.138890    2583 generic.go:356] "Generic (PLEG): container finished" podID="74c678bc-6d58-48eb-9c4b-2eca0f641b50" containerID="f72109a3089582b634741ba77bc65bae8043f5facd37ae39ea8bf5d2887a3cef" exitCode=0
Jul 12 08:28:34.139043 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.138955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m" event={"ID":"74c678bc-6d58-48eb-9c4b-2eca0f641b50","Type":"ContainerDied","Data":"f72109a3089582b634741ba77bc65bae8043f5facd37ae39ea8bf5d2887a3cef"}
Jul 12 08:28:34.140696 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.140676    2583 generic.go:356] "Generic (PLEG): container finished" podID="0074a57f-2c71-4aef-8df9-d02b7a8b1c34" containerID="6f7e8d1e43da59c0fc0acd02b6d8e365babc3c5a757b6ec55e19edad9d75a350" exitCode=0
Jul 12 08:28:34.140789 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.140701    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx" event={"ID":"0074a57f-2c71-4aef-8df9-d02b7a8b1c34","Type":"ContainerDied","Data":"6f7e8d1e43da59c0fc0acd02b6d8e365babc3c5a757b6ec55e19edad9d75a350"}
Jul 12 08:28:34.272629 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.272595    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:34.415415 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.415396    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-bundle\") pod \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") "
Jul 12 08:28:34.415550 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.415504    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4lzk\" (UniqueName: \"kubernetes.io/projected/6abd4595-3811-4b99-be53-b8fe3cedc6d4-kube-api-access-m4lzk\") pod \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") "
Jul 12 08:28:34.415550 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.415543    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-util\") pod \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\" (UID: \"6abd4595-3811-4b99-be53-b8fe3cedc6d4\") "
Jul 12 08:28:34.416023 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.415990    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-bundle" (OuterVolumeSpecName: "bundle") pod "6abd4595-3811-4b99-be53-b8fe3cedc6d4" (UID: "6abd4595-3811-4b99-be53-b8fe3cedc6d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:28:34.417602 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.417580    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6abd4595-3811-4b99-be53-b8fe3cedc6d4-kube-api-access-m4lzk" (OuterVolumeSpecName: "kube-api-access-m4lzk") pod "6abd4595-3811-4b99-be53-b8fe3cedc6d4" (UID: "6abd4595-3811-4b99-be53-b8fe3cedc6d4"). InnerVolumeSpecName "kube-api-access-m4lzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:28:34.421433 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.421412    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-util" (OuterVolumeSpecName: "util") pod "6abd4595-3811-4b99-be53-b8fe3cedc6d4" (UID: "6abd4595-3811-4b99-be53-b8fe3cedc6d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:28:34.516381 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.516355    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4lzk\" (UniqueName: \"kubernetes.io/projected/6abd4595-3811-4b99-be53-b8fe3cedc6d4-kube-api-access-m4lzk\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:34.516381 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.516376    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-util\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:34.516381 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:34.516388    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6abd4595-3811-4b99-be53-b8fe3cedc6d4-bundle\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:35.147145 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.147114    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4"
Jul 12 08:28:35.147567 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.147112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4" event={"ID":"6abd4595-3811-4b99-be53-b8fe3cedc6d4","Type":"ContainerDied","Data":"6435fb568300be9d7c77eba6255a798b4b2fe8979bfa6a5db6a2733e4d4d456d"}
Jul 12 08:28:35.147567 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.147233    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6435fb568300be9d7c77eba6255a798b4b2fe8979bfa6a5db6a2733e4d4d456d"
Jul 12 08:28:35.149220 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.149190    2583 generic.go:356] "Generic (PLEG): container finished" podID="0074a57f-2c71-4aef-8df9-d02b7a8b1c34" containerID="50f648a9e86175c4745ce59792b1653cd7523de4ae5be648cda3c9b448b91125" exitCode=0
Jul 12 08:28:35.149332 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.149275    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx" event={"ID":"0074a57f-2c71-4aef-8df9-d02b7a8b1c34","Type":"ContainerDied","Data":"50f648a9e86175c4745ce59792b1653cd7523de4ae5be648cda3c9b448b91125"}
Jul 12 08:28:35.303921 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.303894    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:35.305983 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.305965    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:35.425053 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.425026    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-util\") pod \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") "
Jul 12 08:28:35.425193 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.425061    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-bundle\") pod \"d4105692-14fa-4466-b30a-db52e34654a9\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") "
Jul 12 08:28:35.425193 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.425093    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-util\") pod \"d4105692-14fa-4466-b30a-db52e34654a9\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") "
Jul 12 08:28:35.425193 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.425147    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-bundle\") pod \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") "
Jul 12 08:28:35.425193 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.425169    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwgc8\" (UniqueName: \"kubernetes.io/projected/d4105692-14fa-4466-b30a-db52e34654a9-kube-api-access-wwgc8\") pod \"d4105692-14fa-4466-b30a-db52e34654a9\" (UID: \"d4105692-14fa-4466-b30a-db52e34654a9\") "
Jul 12 08:28:35.425367 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.425198    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mfmn\" (UniqueName: \"kubernetes.io/projected/74c678bc-6d58-48eb-9c4b-2eca0f641b50-kube-api-access-8mfmn\") pod \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\" (UID: \"74c678bc-6d58-48eb-9c4b-2eca0f641b50\") "
Jul 12 08:28:35.425927 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.425611    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-bundle" (OuterVolumeSpecName: "bundle") pod "d4105692-14fa-4466-b30a-db52e34654a9" (UID: "d4105692-14fa-4466-b30a-db52e34654a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:28:35.425927 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.425620    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-bundle" (OuterVolumeSpecName: "bundle") pod "74c678bc-6d58-48eb-9c4b-2eca0f641b50" (UID: "74c678bc-6d58-48eb-9c4b-2eca0f641b50"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:28:35.427376 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.427343    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74c678bc-6d58-48eb-9c4b-2eca0f641b50-kube-api-access-8mfmn" (OuterVolumeSpecName: "kube-api-access-8mfmn") pod "74c678bc-6d58-48eb-9c4b-2eca0f641b50" (UID: "74c678bc-6d58-48eb-9c4b-2eca0f641b50"). InnerVolumeSpecName "kube-api-access-8mfmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:28:35.427477 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.427388    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4105692-14fa-4466-b30a-db52e34654a9-kube-api-access-wwgc8" (OuterVolumeSpecName: "kube-api-access-wwgc8") pod "d4105692-14fa-4466-b30a-db52e34654a9" (UID: "d4105692-14fa-4466-b30a-db52e34654a9"). InnerVolumeSpecName "kube-api-access-wwgc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:28:35.431173 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.431153    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-util" (OuterVolumeSpecName: "util") pod "d4105692-14fa-4466-b30a-db52e34654a9" (UID: "d4105692-14fa-4466-b30a-db52e34654a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:28:35.431419 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.431402    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-util" (OuterVolumeSpecName: "util") pod "74c678bc-6d58-48eb-9c4b-2eca0f641b50" (UID: "74c678bc-6d58-48eb-9c4b-2eca0f641b50"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:28:35.526161 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.526127    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-util\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:35.526161 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.526159    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-bundle\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:35.526161 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.526171    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4105692-14fa-4466-b30a-db52e34654a9-util\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:35.526429 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.526182    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74c678bc-6d58-48eb-9c4b-2eca0f641b50-bundle\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:35.526429 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.526193    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwgc8\" (UniqueName: \"kubernetes.io/projected/d4105692-14fa-4466-b30a-db52e34654a9-kube-api-access-wwgc8\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:35.526429 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:35.526206    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mfmn\" (UniqueName: \"kubernetes.io/projected/74c678bc-6d58-48eb-9c4b-2eca0f641b50-kube-api-access-8mfmn\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:36.158796 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.158761    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv"
Jul 12 08:28:36.158796 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.158787    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv" event={"ID":"d4105692-14fa-4466-b30a-db52e34654a9","Type":"ContainerDied","Data":"fb8c8a92eb059b780d6d5fbb8415dd57ee2102a95397dda7737cab4ad143b60f"}
Jul 12 08:28:36.159254 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.158831    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb8c8a92eb059b780d6d5fbb8415dd57ee2102a95397dda7737cab4ad143b60f"
Jul 12 08:28:36.160723 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.160706    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m"
Jul 12 08:28:36.160816 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.160760    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m" event={"ID":"74c678bc-6d58-48eb-9c4b-2eca0f641b50","Type":"ContainerDied","Data":"2cfcdaa8cded35a4dce28416c322029d3ecd20f8376e55ab95e1489c7c0c6768"}
Jul 12 08:28:36.160816 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.160796    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cfcdaa8cded35a4dce28416c322029d3ecd20f8376e55ab95e1489c7c0c6768"
Jul 12 08:28:36.289072 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.289049    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:36.435345 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.435262    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-util\") pod \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") "
Jul 12 08:28:36.435480 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.435349    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdbcd\" (UniqueName: \"kubernetes.io/projected/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-kube-api-access-fdbcd\") pod \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") "
Jul 12 08:28:36.435480 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.435396    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-bundle\") pod \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\" (UID: \"0074a57f-2c71-4aef-8df9-d02b7a8b1c34\") "
Jul 12 08:28:36.436029 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.436001    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-bundle" (OuterVolumeSpecName: "bundle") pod "0074a57f-2c71-4aef-8df9-d02b7a8b1c34" (UID: "0074a57f-2c71-4aef-8df9-d02b7a8b1c34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:28:36.437410 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.437382    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-kube-api-access-fdbcd" (OuterVolumeSpecName: "kube-api-access-fdbcd") pod "0074a57f-2c71-4aef-8df9-d02b7a8b1c34" (UID: "0074a57f-2c71-4aef-8df9-d02b7a8b1c34"). InnerVolumeSpecName "kube-api-access-fdbcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:28:36.440701 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.440662    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-util" (OuterVolumeSpecName: "util") pod "0074a57f-2c71-4aef-8df9-d02b7a8b1c34" (UID: "0074a57f-2c71-4aef-8df9-d02b7a8b1c34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:28:36.536260 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.536236    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-util\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:36.536260 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.536260    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdbcd\" (UniqueName: \"kubernetes.io/projected/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-kube-api-access-fdbcd\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:36.536406 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:36.536274    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0074a57f-2c71-4aef-8df9-d02b7a8b1c34-bundle\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:28:37.167409 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:37.167384    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx"
Jul 12 08:28:37.167409 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:37.167391    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx" event={"ID":"0074a57f-2c71-4aef-8df9-d02b7a8b1c34","Type":"ContainerDied","Data":"26df09631bff51cd0dcc87a81519c34c9da3d52d261b9409731488e5e9cdd480"}
Jul 12 08:28:37.167945 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:37.167438    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26df09631bff51cd0dcc87a81519c34c9da3d52d261b9409731488e5e9cdd480"
Jul 12 08:28:54.305196 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305160    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"]
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305473    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4105692-14fa-4466-b30a-db52e34654a9" containerName="util"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305483    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4105692-14fa-4466-b30a-db52e34654a9" containerName="util"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305494    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6abd4595-3811-4b99-be53-b8fe3cedc6d4" containerName="pull"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305499    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6abd4595-3811-4b99-be53-b8fe3cedc6d4" containerName="pull"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305505    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0074a57f-2c71-4aef-8df9-d02b7a8b1c34" containerName="pull"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305511    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0074a57f-2c71-4aef-8df9-d02b7a8b1c34" containerName="pull"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305519    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6abd4595-3811-4b99-be53-b8fe3cedc6d4" containerName="extract"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305524    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6abd4595-3811-4b99-be53-b8fe3cedc6d4" containerName="extract"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305531    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c678bc-6d58-48eb-9c4b-2eca0f641b50" containerName="pull"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305536    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c678bc-6d58-48eb-9c4b-2eca0f641b50" containerName="pull"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305542    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6abd4595-3811-4b99-be53-b8fe3cedc6d4" containerName="util"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305548    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6abd4595-3811-4b99-be53-b8fe3cedc6d4" containerName="util"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305560    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c678bc-6d58-48eb-9c4b-2eca0f641b50" containerName="extract"
Jul 12 08:28:54.305576 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305566    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c678bc-6d58-48eb-9c4b-2eca0f641b50" containerName="extract"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305589    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0074a57f-2c71-4aef-8df9-d02b7a8b1c34" containerName="util"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305594    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0074a57f-2c71-4aef-8df9-d02b7a8b1c34" containerName="util"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305601    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0074a57f-2c71-4aef-8df9-d02b7a8b1c34" containerName="extract"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305606    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0074a57f-2c71-4aef-8df9-d02b7a8b1c34" containerName="extract"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305615    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4105692-14fa-4466-b30a-db52e34654a9" containerName="pull"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305621    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4105692-14fa-4466-b30a-db52e34654a9" containerName="pull"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305628    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c678bc-6d58-48eb-9c4b-2eca0f641b50" containerName="util"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305633    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c678bc-6d58-48eb-9c4b-2eca0f641b50" containerName="util"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305639    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4105692-14fa-4466-b30a-db52e34654a9" containerName="extract"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305644    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4105692-14fa-4466-b30a-db52e34654a9" containerName="extract"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305691    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="74c678bc-6d58-48eb-9c4b-2eca0f641b50" containerName="extract"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305697    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0074a57f-2c71-4aef-8df9-d02b7a8b1c34" containerName="extract"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305702    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4105692-14fa-4466-b30a-db52e34654a9" containerName="extract"
Jul 12 08:28:54.306299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.305707    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6abd4595-3811-4b99-be53-b8fe3cedc6d4" containerName="extract"
Jul 12 08:28:54.310186 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.310170    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.312703 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.312680    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 12 08:28:54.312807 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.312793    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mtxpk\""
Jul 12 08:28:54.312868 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.312804    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 08:28:54.313875 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.313841    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 12 08:28:54.314195 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.314174    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 08:28:54.316667 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.316646    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"]
Jul 12 08:28:54.389938 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.389909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd088a8d-c49c-4ae7-b011-ebebdf028adb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s7xrb\" (UID: \"cd088a8d-c49c-4ae7-b011-ebebdf028adb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.390050 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.389943    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zpkf\" (UniqueName: \"kubernetes.io/projected/cd088a8d-c49c-4ae7-b011-ebebdf028adb-kube-api-access-9zpkf\") pod \"kuadrant-console-plugin-66b5774985-s7xrb\" (UID: \"cd088a8d-c49c-4ae7-b011-ebebdf028adb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.390086 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.390054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd088a8d-c49c-4ae7-b011-ebebdf028adb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s7xrb\" (UID: \"cd088a8d-c49c-4ae7-b011-ebebdf028adb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.490737 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.490712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd088a8d-c49c-4ae7-b011-ebebdf028adb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s7xrb\" (UID: \"cd088a8d-c49c-4ae7-b011-ebebdf028adb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.490888 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.490747    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd088a8d-c49c-4ae7-b011-ebebdf028adb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s7xrb\" (UID: \"cd088a8d-c49c-4ae7-b011-ebebdf028adb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.490888 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.490770    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zpkf\" (UniqueName: \"kubernetes.io/projected/cd088a8d-c49c-4ae7-b011-ebebdf028adb-kube-api-access-9zpkf\") pod \"kuadrant-console-plugin-66b5774985-s7xrb\" (UID: \"cd088a8d-c49c-4ae7-b011-ebebdf028adb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.491467 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.491443    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd088a8d-c49c-4ae7-b011-ebebdf028adb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s7xrb\" (UID: \"cd088a8d-c49c-4ae7-b011-ebebdf028adb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.493182 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.493162    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd088a8d-c49c-4ae7-b011-ebebdf028adb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s7xrb\" (UID: \"cd088a8d-c49c-4ae7-b011-ebebdf028adb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.499405 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.499384    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zpkf\" (UniqueName: \"kubernetes.io/projected/cd088a8d-c49c-4ae7-b011-ebebdf028adb-kube-api-access-9zpkf\") pod \"kuadrant-console-plugin-66b5774985-s7xrb\" (UID: \"cd088a8d-c49c-4ae7-b011-ebebdf028adb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.620466 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.620411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"
Jul 12 08:28:54.748259 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:54.748237    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb"]
Jul 12 08:28:54.750873 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:28:54.750822    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd088a8d_c49c_4ae7_b011_ebebdf028adb.slice/crio-60e110d7ed5a24f52f0a38428f04e2111e9b947882c1eb78b7de6516288935a5 WatchSource:0}: Error finding container 60e110d7ed5a24f52f0a38428f04e2111e9b947882c1eb78b7de6516288935a5: Status 404 returned error can't find the container with id 60e110d7ed5a24f52f0a38428f04e2111e9b947882c1eb78b7de6516288935a5
Jul 12 08:28:55.262944 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:28:55.262911    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb" event={"ID":"cd088a8d-c49c-4ae7-b011-ebebdf028adb","Type":"ContainerStarted","Data":"60e110d7ed5a24f52f0a38428f04e2111e9b947882c1eb78b7de6516288935a5"}
Jul 12 08:29:17.773488 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:17.773449    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-844b84f5cb-dqrvm"]
Jul 12 08:29:17.776030 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:17.776012    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:17.801495 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:17.801465    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844b84f5cb-dqrvm"]
Jul 12 08:29:17.902075 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:17.902041    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab86a721-cdd9-48ac-bd77-9ab46f95905f-console-oauth-config\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:17.902075 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:17.902081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-service-ca\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:17.902260 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:17.902171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab86a721-cdd9-48ac-bd77-9ab46f95905f-console-serving-cert\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:17.902260 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:17.902199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-trusted-ca-bundle\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:17.902260 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:17.902216    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-oauth-serving-cert\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:17.902260 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:17.902233    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4x99\" (UniqueName: \"kubernetes.io/projected/ab86a721-cdd9-48ac-bd77-9ab46f95905f-kube-api-access-h4x99\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:17.902429 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:17.902307    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-console-config\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.002672 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.002634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab86a721-cdd9-48ac-bd77-9ab46f95905f-console-serving-cert\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.002672 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.002677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-trusted-ca-bundle\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.002935 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.002694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-oauth-serving-cert\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.002935 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.002711    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4x99\" (UniqueName: \"kubernetes.io/projected/ab86a721-cdd9-48ac-bd77-9ab46f95905f-kube-api-access-h4x99\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.002935 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.002732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-console-config\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.002935 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.002753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab86a721-cdd9-48ac-bd77-9ab46f95905f-console-oauth-config\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.002935 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.002787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-service-ca\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.003583 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.003560    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-service-ca\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.003675 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.003559    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-oauth-serving-cert\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.003715 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.003667    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-console-config\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.003764 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.003748    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab86a721-cdd9-48ac-bd77-9ab46f95905f-trusted-ca-bundle\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.005170 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.005150    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab86a721-cdd9-48ac-bd77-9ab46f95905f-console-oauth-config\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.005257 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.005239    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab86a721-cdd9-48ac-bd77-9ab46f95905f-console-serving-cert\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.011892 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.011873    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4x99\" (UniqueName: \"kubernetes.io/projected/ab86a721-cdd9-48ac-bd77-9ab46f95905f-kube-api-access-h4x99\") pod \"console-844b84f5cb-dqrvm\" (UID: \"ab86a721-cdd9-48ac-bd77-9ab46f95905f\") " pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.085660 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.085590    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:18.237812 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.237789    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844b84f5cb-dqrvm"]
Jul 12 08:29:18.239781 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:29:18.239756    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab86a721_cdd9_48ac_bd77_9ab46f95905f.slice/crio-f6d785777001618d704fe06f2c47f22becc1ce924d1ac339bd131c8672b2952b WatchSource:0}: Error finding container f6d785777001618d704fe06f2c47f22becc1ce924d1ac339bd131c8672b2952b: Status 404 returned error can't find the container with id f6d785777001618d704fe06f2c47f22becc1ce924d1ac339bd131c8672b2952b
Jul 12 08:29:18.398555 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.398470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb" event={"ID":"cd088a8d-c49c-4ae7-b011-ebebdf028adb","Type":"ContainerStarted","Data":"cfdaa54f204ed737534b4c7830353592622b3c7bc913535131df06631db0fba3"}
Jul 12 08:29:18.399972 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.399945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844b84f5cb-dqrvm" event={"ID":"ab86a721-cdd9-48ac-bd77-9ab46f95905f","Type":"ContainerStarted","Data":"0921020585dcf20402a8e46f31fd7a89e4610a692ab97336e5207d5ba7b71a48"}
Jul 12 08:29:18.400096 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.399993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844b84f5cb-dqrvm" event={"ID":"ab86a721-cdd9-48ac-bd77-9ab46f95905f","Type":"ContainerStarted","Data":"f6d785777001618d704fe06f2c47f22becc1ce924d1ac339bd131c8672b2952b"}
Jul 12 08:29:18.424674 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.424576    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s7xrb" podStartSLOduration=1.845557661 podStartE2EDuration="24.424562711s" totalImagesPullingTime="22.57900505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:29:18.423600365 +0000 UTC m=+461.003058842" watchObservedRunningTime="2026-07-12 08:29:18.424562711 +0000 UTC m=+461.004021231"
Jul 12 08:29:18.446985 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:18.446940    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-844b84f5cb-dqrvm" podStartSLOduration=1.446927054 podStartE2EDuration="1.446927054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:29:18.44541189 +0000 UTC m=+461.024870369" watchObservedRunningTime="2026-07-12 08:29:18.446927054 +0000 UTC m=+461.026385530"
Jul 12 08:29:28.086333 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:28.086290    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:28.086711 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:28.086363    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:28.091007 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:28.090987    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:28.453058 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:28.453029    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-844b84f5cb-dqrvm"
Jul 12 08:29:28.506436 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:28.506407    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fcb48bc76-ssstx"]
Jul 12 08:29:34.144435 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.144405    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"]
Jul 12 08:29:34.147688 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.147668    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.152896 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.152874    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hfnsx\""
Jul 12 08:29:34.166694 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.166668    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"]
Jul 12 08:29:34.247474 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.247446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.247474 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.247477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.247691 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.247497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.247691 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.247552    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.247691 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.247606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2msh\" (UniqueName: \"kubernetes.io/projected/f80e31c7-2d11-458a-93b7-9ee689eb5c00-kube-api-access-z2msh\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.247691 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.247635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.247691 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.247663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.247691 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.247688    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.247937 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.247710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348238 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348238 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348236    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348436 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348436 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348371    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348436 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2msh\" (UniqueName: \"kubernetes.io/projected/f80e31c7-2d11-458a-93b7-9ee689eb5c00-kube-api-access-z2msh\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348602 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348602 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348492    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348602 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348602 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348543    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348602 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348903 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.348970 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.348941    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.349080 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.349057    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.349180 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.349162    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.350541 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.350521    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.350906 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.350886    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.367309 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.367279    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2msh\" (UniqueName: \"kubernetes.io/projected/f80e31c7-2d11-458a-93b7-9ee689eb5c00-kube-api-access-z2msh\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.369642 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.369614    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f80e31c7-2d11-458a-93b7-9ee689eb5c00-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ghbrs\" (UID: \"f80e31c7-2d11-458a-93b7-9ee689eb5c00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.458525 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.458502    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:34.593085 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.593058    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"]
Jul 12 08:29:34.594492 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:29:34.594469    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80e31c7_2d11_458a_93b7_9ee689eb5c00.slice/crio-500632d783664112a2e66a5b920c103d2da52165b0b278df3555a8a8aa14fd24 WatchSource:0}: Error finding container 500632d783664112a2e66a5b920c103d2da52165b0b278df3555a8a8aa14fd24: Status 404 returned error can't find the container with id 500632d783664112a2e66a5b920c103d2da52165b0b278df3555a8a8aa14fd24
Jul 12 08:29:34.596492 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.596466    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:29:34.596563 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.596530    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:29:34.596563 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:34.596558    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:29:35.486693 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:35.486658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs" event={"ID":"f80e31c7-2d11-458a-93b7-9ee689eb5c00","Type":"ContainerStarted","Data":"ada2059112dd62304902dbe9109fc56d05eba57ddb0d12212a91f8ac2d6f8129"}
Jul 12 08:29:35.487082 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:35.486709    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs" event={"ID":"f80e31c7-2d11-458a-93b7-9ee689eb5c00","Type":"ContainerStarted","Data":"500632d783664112a2e66a5b920c103d2da52165b0b278df3555a8a8aa14fd24"}
Jul 12 08:29:35.511918 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:35.511868    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs" podStartSLOduration=1.511838104 podStartE2EDuration="1.511838104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:29:35.5095676 +0000 UTC m=+478.089026079" watchObservedRunningTime="2026-07-12 08:29:35.511838104 +0000 UTC m=+478.091296580"
Jul 12 08:29:36.458960 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:36.458917    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:36.463883 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:36.463858    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:36.491695 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:36.491665    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:36.492519 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:36.492461    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:29:46.255865 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:46.255820    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jf9cg"]
Jul 12 08:29:46.341034 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:46.341006    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jf9cg"]
Jul 12 08:29:46.341199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:46.341099    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jf9cg"
Jul 12 08:29:46.343779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:46.343752    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xgvs5\""
Jul 12 08:29:46.459289 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:46.459257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf47r\" (UniqueName: \"kubernetes.io/projected/ef5a7dac-c136-4a3e-8aae-a93571eb732f-kube-api-access-pf47r\") pod \"authorino-58cd955675-jf9cg\" (UID: \"ef5a7dac-c136-4a3e-8aae-a93571eb732f\") " pod="kuadrant-system/authorino-58cd955675-jf9cg"
Jul 12 08:29:46.560489 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:46.560406    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf47r\" (UniqueName: \"kubernetes.io/projected/ef5a7dac-c136-4a3e-8aae-a93571eb732f-kube-api-access-pf47r\") pod \"authorino-58cd955675-jf9cg\" (UID: \"ef5a7dac-c136-4a3e-8aae-a93571eb732f\") " pod="kuadrant-system/authorino-58cd955675-jf9cg"
Jul 12 08:29:46.569314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:46.569288    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf47r\" (UniqueName: \"kubernetes.io/projected/ef5a7dac-c136-4a3e-8aae-a93571eb732f-kube-api-access-pf47r\") pod \"authorino-58cd955675-jf9cg\" (UID: \"ef5a7dac-c136-4a3e-8aae-a93571eb732f\") " pod="kuadrant-system/authorino-58cd955675-jf9cg"
Jul 12 08:29:46.650241 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:46.650218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jf9cg"
Jul 12 08:29:46.803758 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:46.803731    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jf9cg"]
Jul 12 08:29:46.805549 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:29:46.805518    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef5a7dac_c136_4a3e_8aae_a93571eb732f.slice/crio-aab14996c8bf0b1fc687b66dd326b3113ca0b36d9773a90e13702394b29857f6 WatchSource:0}: Error finding container aab14996c8bf0b1fc687b66dd326b3113ca0b36d9773a90e13702394b29857f6: Status 404 returned error can't find the container with id aab14996c8bf0b1fc687b66dd326b3113ca0b36d9773a90e13702394b29857f6
Jul 12 08:29:47.549314 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:47.549251    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jf9cg" event={"ID":"ef5a7dac-c136-4a3e-8aae-a93571eb732f","Type":"ContainerStarted","Data":"aab14996c8bf0b1fc687b66dd326b3113ca0b36d9773a90e13702394b29857f6"}
Jul 12 08:29:50.522047 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:50.522014    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jf9cg"]
Jul 12 08:29:50.569408 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:50.569366    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jf9cg" event={"ID":"ef5a7dac-c136-4a3e-8aae-a93571eb732f","Type":"ContainerStarted","Data":"228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392"}
Jul 12 08:29:50.584651 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:50.584575    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jf9cg" podStartSLOduration=1.338910789 podStartE2EDuration="4.584561075s" totalImagesPullingTime="3.245650286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:29:50.583952148 +0000 UTC m=+493.163410624" watchObservedRunningTime="2026-07-12 08:29:50.584561075 +0000 UTC m=+493.164019550"
Jul 12 08:29:51.574535 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:51.574495    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jf9cg" podUID="ef5a7dac-c136-4a3e-8aae-a93571eb732f" containerName="authorino" containerID="cri-o://228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392" gracePeriod=30
Jul 12 08:29:51.815459 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:51.815435    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jf9cg"
Jul 12 08:29:51.912097 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:51.912065    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf47r\" (UniqueName: \"kubernetes.io/projected/ef5a7dac-c136-4a3e-8aae-a93571eb732f-kube-api-access-pf47r\") pod \"ef5a7dac-c136-4a3e-8aae-a93571eb732f\" (UID: \"ef5a7dac-c136-4a3e-8aae-a93571eb732f\") "
Jul 12 08:29:51.914168 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:51.914143    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef5a7dac-c136-4a3e-8aae-a93571eb732f-kube-api-access-pf47r" (OuterVolumeSpecName: "kube-api-access-pf47r") pod "ef5a7dac-c136-4a3e-8aae-a93571eb732f" (UID: "ef5a7dac-c136-4a3e-8aae-a93571eb732f"). InnerVolumeSpecName "kube-api-access-pf47r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:29:52.013562 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:52.013524    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf47r\" (UniqueName: \"kubernetes.io/projected/ef5a7dac-c136-4a3e-8aae-a93571eb732f-kube-api-access-pf47r\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:29:52.580951 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:52.580915    2583 generic.go:356] "Generic (PLEG): container finished" podID="ef5a7dac-c136-4a3e-8aae-a93571eb732f" containerID="228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392" exitCode=0
Jul 12 08:29:52.581357 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:52.580968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jf9cg" event={"ID":"ef5a7dac-c136-4a3e-8aae-a93571eb732f","Type":"ContainerDied","Data":"228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392"}
Jul 12 08:29:52.581357 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:52.580973    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jf9cg"
Jul 12 08:29:52.581357 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:52.580998    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jf9cg" event={"ID":"ef5a7dac-c136-4a3e-8aae-a93571eb732f","Type":"ContainerDied","Data":"aab14996c8bf0b1fc687b66dd326b3113ca0b36d9773a90e13702394b29857f6"}
Jul 12 08:29:52.581357 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:52.581015    2583 scope.go:117] "RemoveContainer" containerID="228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392"
Jul 12 08:29:52.589564 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:52.589546    2583 scope.go:117] "RemoveContainer" containerID="228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392"
Jul 12 08:29:52.589804 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:29:52.589787    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392\": container with ID starting with 228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392 not found: ID does not exist" containerID="228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392"
Jul 12 08:29:52.589875 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:52.589819    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392"} err="failed to get container status \"228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392\": rpc error: code = NotFound desc = could not find container \"228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392\": container with ID starting with 228bdee869abe7287219ad0abc69bdea396e961ea9e6e6a6e47ef5414b73a392 not found: ID does not exist"
Jul 12 08:29:52.597671 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:52.597649    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jf9cg"]
Jul 12 08:29:52.600900 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:52.600880    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jf9cg"]
Jul 12 08:29:53.526611 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.526560    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fcb48bc76-ssstx" podUID="1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" containerName="console" containerID="cri-o://5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6" gracePeriod=15
Jul 12 08:29:53.765497 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.765472    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:29:53.828102 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828024    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-service-ca\") pod \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") "
Jul 12 08:29:53.828102 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828057    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-oauth-config\") pod \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") "
Jul 12 08:29:53.828102 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828078    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-serving-cert\") pod \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") "
Jul 12 08:29:53.828398 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828119    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-oauth-serving-cert\") pod \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") "
Jul 12 08:29:53.828398 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828153    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whzc7\" (UniqueName: \"kubernetes.io/projected/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-kube-api-access-whzc7\") pod \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") "
Jul 12 08:29:53.828398 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828372    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-config\") pod \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") "
Jul 12 08:29:53.828546 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828372    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-service-ca" (OuterVolumeSpecName: "service-ca") pod "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" (UID: "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:29:53.828546 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828487    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-trusted-ca-bundle\") pod \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\" (UID: \"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7\") "
Jul 12 08:29:53.828685 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828547    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" (UID: "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:29:53.828793 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828767    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-config" (OuterVolumeSpecName: "console-config") pod "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" (UID: "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:29:53.828879 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828840    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-service-ca\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:29:53.828879 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828881    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-oauth-serving-cert\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:29:53.829060 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.828910    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" (UID: "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:29:53.830257 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.830227    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" (UID: "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:29:53.830324 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.830285    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" (UID: "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:29:53.830378 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.830362    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-kube-api-access-whzc7" (OuterVolumeSpecName: "kube-api-access-whzc7") pod "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" (UID: "1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7"). InnerVolumeSpecName "kube-api-access-whzc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:29:53.930218 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.930186    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-trusted-ca-bundle\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:29:53.930218 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.930214    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-oauth-config\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:29:53.930218 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.930223    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-serving-cert\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:29:53.930437 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.930232    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whzc7\" (UniqueName: \"kubernetes.io/projected/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-kube-api-access-whzc7\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:29:53.930437 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:53.930241    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7-console-config\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:29:54.368601 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:54.368560    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef5a7dac-c136-4a3e-8aae-a93571eb732f" path="/var/lib/kubelet/pods/ef5a7dac-c136-4a3e-8aae-a93571eb732f/volumes"
Jul 12 08:29:54.592779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:54.592743    2583 generic.go:356] "Generic (PLEG): container finished" podID="1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" containerID="5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6" exitCode=0
Jul 12 08:29:54.592979 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:54.592791    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fcb48bc76-ssstx"
Jul 12 08:29:54.592979 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:54.592835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fcb48bc76-ssstx" event={"ID":"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7","Type":"ContainerDied","Data":"5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6"}
Jul 12 08:29:54.592979 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:54.592919    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fcb48bc76-ssstx" event={"ID":"1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7","Type":"ContainerDied","Data":"a138e44f4881238013b833a1da90750bb3d71226c40a9b1251ae52a8c4b029a1"}
Jul 12 08:29:54.592979 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:54.592947    2583 scope.go:117] "RemoveContainer" containerID="5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6"
Jul 12 08:29:54.601575 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:54.601559    2583 scope.go:117] "RemoveContainer" containerID="5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6"
Jul 12 08:29:54.601812 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:29:54.601792    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6\": container with ID starting with 5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6 not found: ID does not exist" containerID="5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6"
Jul 12 08:29:54.601944 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:54.601824    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6"} err="failed to get container status \"5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6\": rpc error: code = NotFound desc = could not find container \"5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6\": container with ID starting with 5cd24211e99d6236981bfe181221fc19dbcc94ced1b173d8092c9e947d13c2f6 not found: ID does not exist"
Jul 12 08:29:54.610885 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:54.610844    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fcb48bc76-ssstx"]
Jul 12 08:29:54.616884 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:54.616864    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fcb48bc76-ssstx"]
Jul 12 08:29:56.373345 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:29:56.373315    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" path="/var/lib/kubelet/pods/1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7/volumes"
Jul 12 08:30:17.147517 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.147480    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2k4qm"]
Jul 12 08:30:17.148031 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.147805    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5a7dac-c136-4a3e-8aae-a93571eb732f" containerName="authorino"
Jul 12 08:30:17.148031 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.147815    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5a7dac-c136-4a3e-8aae-a93571eb732f" containerName="authorino"
Jul 12 08:30:17.148031 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.147825    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" containerName="console"
Jul 12 08:30:17.148031 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.147832    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" containerName="console"
Jul 12 08:30:17.148031 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.147921    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a5f21fa-ad87-416e-88e2-8f8be7c9aeb7" containerName="console"
Jul 12 08:30:17.148031 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.147931    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef5a7dac-c136-4a3e-8aae-a93571eb732f" containerName="authorino"
Jul 12 08:30:17.150815 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.150798    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2k4qm"
Jul 12 08:30:17.153343 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.153323    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xgvs5\""
Jul 12 08:30:17.161134 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.161112    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2k4qm"]
Jul 12 08:30:17.232723 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.232690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfl4j\" (UniqueName: \"kubernetes.io/projected/9326928b-d37e-4512-b4af-85ecd0bb09de-kube-api-access-pfl4j\") pod \"authorino-5d4b67c446-2k4qm\" (UID: \"9326928b-d37e-4512-b4af-85ecd0bb09de\") " pod="kuadrant-system/authorino-5d4b67c446-2k4qm"
Jul 12 08:30:17.333781 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.333752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfl4j\" (UniqueName: \"kubernetes.io/projected/9326928b-d37e-4512-b4af-85ecd0bb09de-kube-api-access-pfl4j\") pod \"authorino-5d4b67c446-2k4qm\" (UID: \"9326928b-d37e-4512-b4af-85ecd0bb09de\") " pod="kuadrant-system/authorino-5d4b67c446-2k4qm"
Jul 12 08:30:17.343253 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.343223    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfl4j\" (UniqueName: \"kubernetes.io/projected/9326928b-d37e-4512-b4af-85ecd0bb09de-kube-api-access-pfl4j\") pod \"authorino-5d4b67c446-2k4qm\" (UID: \"9326928b-d37e-4512-b4af-85ecd0bb09de\") " pod="kuadrant-system/authorino-5d4b67c446-2k4qm"
Jul 12 08:30:17.350650 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.350626    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2k4qm"]
Jul 12 08:30:17.350952 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.350930    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2k4qm"
Jul 12 08:30:17.478880 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.478842    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2k4qm"]
Jul 12 08:30:17.480730 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:30:17.480703    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9326928b_d37e_4512_b4af_85ecd0bb09de.slice/crio-2806562a3a59abfcd4eb1ed2f15029be2b59239aa21c808cb69b075ec2aee311 WatchSource:0}: Error finding container 2806562a3a59abfcd4eb1ed2f15029be2b59239aa21c808cb69b075ec2aee311: Status 404 returned error can't find the container with id 2806562a3a59abfcd4eb1ed2f15029be2b59239aa21c808cb69b075ec2aee311
Jul 12 08:30:17.711445 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:17.711369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2k4qm" event={"ID":"9326928b-d37e-4512-b4af-85ecd0bb09de","Type":"ContainerStarted","Data":"2806562a3a59abfcd4eb1ed2f15029be2b59239aa21c808cb69b075ec2aee311"}
Jul 12 08:30:18.717409 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:18.717373    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2k4qm" event={"ID":"9326928b-d37e-4512-b4af-85ecd0bb09de","Type":"ContainerStarted","Data":"50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e"}
Jul 12 08:30:18.717905 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:18.717420    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-2k4qm" podUID="9326928b-d37e-4512-b4af-85ecd0bb09de" containerName="authorino" containerID="cri-o://50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e" gracePeriod=30
Jul 12 08:30:18.733746 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:18.733706    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-2k4qm" podStartSLOduration=1.352345508 podStartE2EDuration="1.733690761s" totalImagesPullingTime="381.345253ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:30:18.732806281 +0000 UTC m=+521.312264782" watchObservedRunningTime="2026-07-12 08:30:18.733690761 +0000 UTC m=+521.313149297"
Jul 12 08:30:18.959680 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:18.959654    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2k4qm"
Jul 12 08:30:19.048752 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.048676    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfl4j\" (UniqueName: \"kubernetes.io/projected/9326928b-d37e-4512-b4af-85ecd0bb09de-kube-api-access-pfl4j\") pod \"9326928b-d37e-4512-b4af-85ecd0bb09de\" (UID: \"9326928b-d37e-4512-b4af-85ecd0bb09de\") "
Jul 12 08:30:19.050642 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.050619    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9326928b-d37e-4512-b4af-85ecd0bb09de-kube-api-access-pfl4j" (OuterVolumeSpecName: "kube-api-access-pfl4j") pod "9326928b-d37e-4512-b4af-85ecd0bb09de" (UID: "9326928b-d37e-4512-b4af-85ecd0bb09de"). InnerVolumeSpecName "kube-api-access-pfl4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:30:19.150069 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.150038    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfl4j\" (UniqueName: \"kubernetes.io/projected/9326928b-d37e-4512-b4af-85ecd0bb09de-kube-api-access-pfl4j\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:30:19.723919 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.723885    2583 generic.go:356] "Generic (PLEG): container finished" podID="9326928b-d37e-4512-b4af-85ecd0bb09de" containerID="50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e" exitCode=0
Jul 12 08:30:19.724350 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.723935    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2k4qm"
Jul 12 08:30:19.724350 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.723954    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2k4qm" event={"ID":"9326928b-d37e-4512-b4af-85ecd0bb09de","Type":"ContainerDied","Data":"50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e"}
Jul 12 08:30:19.724350 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.723998    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2k4qm" event={"ID":"9326928b-d37e-4512-b4af-85ecd0bb09de","Type":"ContainerDied","Data":"2806562a3a59abfcd4eb1ed2f15029be2b59239aa21c808cb69b075ec2aee311"}
Jul 12 08:30:19.724350 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.724018    2583 scope.go:117] "RemoveContainer" containerID="50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e"
Jul 12 08:30:19.732647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.732612    2583 scope.go:117] "RemoveContainer" containerID="50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e"
Jul 12 08:30:19.732910 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:30:19.732889    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e\": container with ID starting with 50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e not found: ID does not exist" containerID="50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e"
Jul 12 08:30:19.732986 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.732917    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e"} err="failed to get container status \"50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e\": rpc error: code = NotFound desc = could not find container \"50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e\": container with ID starting with 50d3f8c30b7c812ee6bf108e24de50fe9947c9f648b43dede3fd006e15e4419e not found: ID does not exist"
Jul 12 08:30:19.745423 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.745404    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2k4qm"]
Jul 12 08:30:19.747572 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:19.747554    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2k4qm"]
Jul 12 08:30:20.369319 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:30:20.369287    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9326928b-d37e-4512-b4af-85ecd0bb09de" path="/var/lib/kubelet/pods/9326928b-d37e-4512-b4af-85ecd0bb09de/volumes"
Jul 12 08:31:07.533995 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:07.533965    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ghbrs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 12 08:31:07.536939 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:07.534038    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs" podUID="f80e31c7-2d11-458a-93b7-9ee689eb5c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 12 08:31:07.965376 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:07.965346    2583 generic.go:356] "Generic (PLEG): container finished" podID="f80e31c7-2d11-458a-93b7-9ee689eb5c00" containerID="ada2059112dd62304902dbe9109fc56d05eba57ddb0d12212a91f8ac2d6f8129" exitCode=0
Jul 12 08:31:07.965523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:07.965390    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs" event={"ID":"f80e31c7-2d11-458a-93b7-9ee689eb5c00","Type":"ContainerDied","Data":"ada2059112dd62304902dbe9109fc56d05eba57ddb0d12212a91f8ac2d6f8129"}
Jul 12 08:31:07.965746 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:07.965733    2583 scope.go:117] "RemoveContainer" containerID="ada2059112dd62304902dbe9109fc56d05eba57ddb0d12212a91f8ac2d6f8129"
Jul 12 08:31:07.966745 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:07.966714    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:31:07.966817 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:07.966802    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:31:07.966884 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:07.966874    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:31:08.971905 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:08.971868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs" event={"ID":"f80e31c7-2d11-458a-93b7-9ee689eb5c00","Type":"ContainerStarted","Data":"b74c1d9bc9946ec7bc7187bc7069ff9e7be1cf9e72ec47e63d155b58b8589bea"}
Jul 12 08:31:09.458873 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:09.458831    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:31:09.459086 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:09.459065    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ghbrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 12 08:31:09.459140 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:09.459121    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs" podUID="f80e31c7-2d11-458a-93b7-9ee689eb5c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 12 08:31:10.458994 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:10.458954    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ghbrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 12 08:31:10.459461 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:10.459026    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs" podUID="f80e31c7-2d11-458a-93b7-9ee689eb5c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 12 08:31:11.459069 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:11.459033    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ghbrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 12 08:31:11.459455 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:11.459087    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs" podUID="f80e31c7-2d11-458a-93b7-9ee689eb5c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 12 08:31:12.459707 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:12.459676    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ghbrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 12 08:31:12.460072 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:12.459730    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs" podUID="f80e31c7-2d11-458a-93b7-9ee689eb5c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 12 08:31:13.462900 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:13.462864    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:31:13.463291 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:13.463246    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:31:13.463835 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:13.463815    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ghbrs"
Jul 12 08:31:33.295591 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.295556    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"]
Jul 12 08:31:33.296121 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.296099    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9326928b-d37e-4512-b4af-85ecd0bb09de" containerName="authorino"
Jul 12 08:31:33.296190 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.296124    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9326928b-d37e-4512-b4af-85ecd0bb09de" containerName="authorino"
Jul 12 08:31:33.296239 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.296227    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9326928b-d37e-4512-b4af-85ecd0bb09de" containerName="authorino"
Jul 12 08:31:33.299569 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.299553    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.302185 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.302161    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 12 08:31:33.303494 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.303474    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bf7sq\""
Jul 12 08:31:33.303621 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.303483    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 12 08:31:33.303621 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.303482    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 12 08:31:33.308237 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.308214    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"]
Jul 12 08:31:33.397526 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.397494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw7s2\" (UniqueName: \"kubernetes.io/projected/4bf25407-20ec-49ef-8fe3-393c6e9877c6-kube-api-access-qw7s2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.397526 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.397525    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.397767 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.397697    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.397894 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.397836    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.398037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.397909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.398037 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.397934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf25407-20ec-49ef-8fe3-393c6e9877c6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.498919 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.498885    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.499089 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.498958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.499089 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.498982    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.499089 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.499005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf25407-20ec-49ef-8fe3-393c6e9877c6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.499089 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.499057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw7s2\" (UniqueName: \"kubernetes.io/projected/4bf25407-20ec-49ef-8fe3-393c6e9877c6-kube-api-access-qw7s2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.499089 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.499080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.499329 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.499283    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.499418 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.499395    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.499492 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.499472    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.501227 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.501198    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bf25407-20ec-49ef-8fe3-393c6e9877c6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.501377 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.501361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf25407-20ec-49ef-8fe3-393c6e9877c6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.507473 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.507448    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw7s2\" (UniqueName: \"kubernetes.io/projected/4bf25407-20ec-49ef-8fe3-393c6e9877c6-kube-api-access-qw7s2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v\" (UID: \"4bf25407-20ec-49ef-8fe3-393c6e9877c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.611352 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.611289    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:33.740585 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:33.740514    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"]
Jul 12 08:31:33.743188 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:31:33.743163    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf25407_20ec_49ef_8fe3_393c6e9877c6.slice/crio-9a60b5456e05d3b87bef46f2d72d88e790384a49d0bafb81b296d89a467fe4f7 WatchSource:0}: Error finding container 9a60b5456e05d3b87bef46f2d72d88e790384a49d0bafb81b296d89a467fe4f7: Status 404 returned error can't find the container with id 9a60b5456e05d3b87bef46f2d72d88e790384a49d0bafb81b296d89a467fe4f7
Jul 12 08:31:34.110018 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:34.109977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v" event={"ID":"4bf25407-20ec-49ef-8fe3-393c6e9877c6","Type":"ContainerStarted","Data":"9a60b5456e05d3b87bef46f2d72d88e790384a49d0bafb81b296d89a467fe4f7"}
Jul 12 08:31:35.116429 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:35.116340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v" event={"ID":"4bf25407-20ec-49ef-8fe3-393c6e9877c6","Type":"ContainerStarted","Data":"d5cebd77a1922aa58a09228fc35e156f41219b830a90a894e8e1860449fedc66"}
Jul 12 08:31:35.134712 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:35.134669    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v" podStartSLOduration=1.042870231 podStartE2EDuration="2.134656485s" totalImagesPullingTime="1.091786254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:31:35.132109388 +0000 UTC m=+597.711567864" watchObservedRunningTime="2026-07-12 08:31:35.134656485 +0000 UTC m=+597.714114961"
Jul 12 08:31:37.791232 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:37.791206    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:31:37.792667 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:37.792628    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:31:43.611944 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:43.611914    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:43.612309 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:43.611969    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:43.623829 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:43.623803    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:31:44.173537 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:31:44.173509    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v"
Jul 12 08:32:05.412987 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.412906    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"]
Jul 12 08:32:05.416213 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.416194    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.418726 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.418707    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 12 08:32:05.426108 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.426084    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"]
Jul 12 08:32:05.576904 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.576871    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.577045 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.576929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sb8t\" (UniqueName: \"kubernetes.io/projected/b226c998-1061-418a-bd6b-6298acb65021-kube-api-access-9sb8t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.577045 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.576950    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b226c998-1061-418a-bd6b-6298acb65021-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.577045 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.576990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.577169 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.577070    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.577169 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.577112    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.678062 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.677984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.678062 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.678030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.678062 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.678052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.678312 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.678080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.678312 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.678117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sb8t\" (UniqueName: \"kubernetes.io/projected/b226c998-1061-418a-bd6b-6298acb65021-kube-api-access-9sb8t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.678312 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.678137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b226c998-1061-418a-bd6b-6298acb65021-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.678485 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.678459    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.678550 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.678482    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.678594 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.678548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.680330 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.680309    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b226c998-1061-418a-bd6b-6298acb65021-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.680625 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.680605    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b226c998-1061-418a-bd6b-6298acb65021-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.685581 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.685562    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sb8t\" (UniqueName: \"kubernetes.io/projected/b226c998-1061-418a-bd6b-6298acb65021-kube-api-access-9sb8t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x\" (UID: \"b226c998-1061-418a-bd6b-6298acb65021\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.727304 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.727286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:05.858813 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.858792    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"]
Jul 12 08:32:05.860835 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:32:05.860809    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb226c998_1061_418a_bd6b_6298acb65021.slice/crio-c6173b8d7fd340b289cf569f5327314b9798dd62c5b88fc705dbe85f2c99c15c WatchSource:0}: Error finding container c6173b8d7fd340b289cf569f5327314b9798dd62c5b88fc705dbe85f2c99c15c: Status 404 returned error can't find the container with id c6173b8d7fd340b289cf569f5327314b9798dd62c5b88fc705dbe85f2c99c15c
Jul 12 08:32:05.862178 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:05.862162    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:32:06.275624 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:06.275531    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x" event={"ID":"b226c998-1061-418a-bd6b-6298acb65021","Type":"ContainerStarted","Data":"b653751178441d2385be1339b6ed804262cae1ae1dd094629d05b6486f4554e9"}
Jul 12 08:32:06.275624 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:06.275586    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x" event={"ID":"b226c998-1061-418a-bd6b-6298acb65021","Type":"ContainerStarted","Data":"c6173b8d7fd340b289cf569f5327314b9798dd62c5b88fc705dbe85f2c99c15c"}
Jul 12 08:32:06.292410 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:06.292357    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x" podStartSLOduration=1.1359440140000001 podStartE2EDuration="1.292342908s" totalImagesPullingTime="156.398894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:32:06.290279555 +0000 UTC m=+628.869738040" watchObservedRunningTime="2026-07-12 08:32:06.292342908 +0000 UTC m=+628.871801385"
Jul 12 08:32:15.728217 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:15.728187    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:15.728801 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:15.728250    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:15.740889 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:15.740843    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:16.338265 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:16.338236    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x"
Jul 12 08:32:21.803297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:21.803259    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"]
Jul 12 08:32:21.809162 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:21.809142    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:21.811551 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:21.811533    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 12 08:32:21.818725 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:21.818706    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"]
Jul 12 08:32:21.903458 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:21.903424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e7816b-6a31-403c-a556-57616e12eb98-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:21.903605 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:21.903468    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9zhz\" (UniqueName: \"kubernetes.io/projected/92e7816b-6a31-403c-a556-57616e12eb98-kube-api-access-j9zhz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:21.903605 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:21.903487    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:21.903605 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:21.903569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:21.903723 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:21.903652    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:21.903723 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:21.903703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.004812 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.004781    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.005014 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.004838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.005014 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.004878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e7816b-6a31-403c-a556-57616e12eb98-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.005014 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.004909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9zhz\" (UniqueName: \"kubernetes.io/projected/92e7816b-6a31-403c-a556-57616e12eb98-kube-api-access-j9zhz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.005014 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.004929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.005014 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.004958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.005274 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.005244    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.005274 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.005265    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.005363 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.005294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.007131 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.007108    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e7816b-6a31-403c-a556-57616e12eb98-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.007381 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.007364    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e7816b-6a31-403c-a556-57616e12eb98-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.012199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.012177    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9zhz\" (UniqueName: \"kubernetes.io/projected/92e7816b-6a31-403c-a556-57616e12eb98-kube-api-access-j9zhz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd\" (UID: \"92e7816b-6a31-403c-a556-57616e12eb98\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.119329 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.119259    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:22.249800 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.249774    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"]
Jul 12 08:32:22.251612 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:32:22.251582    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92e7816b_6a31_403c_a556_57616e12eb98.slice/crio-abd1f7dfe1f8458b88a241ee484d3ddab105e2ee662964d26e7f2aa2d859c092 WatchSource:0}: Error finding container abd1f7dfe1f8458b88a241ee484d3ddab105e2ee662964d26e7f2aa2d859c092: Status 404 returned error can't find the container with id abd1f7dfe1f8458b88a241ee484d3ddab105e2ee662964d26e7f2aa2d859c092
Jul 12 08:32:22.358813 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:22.358779    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd" event={"ID":"92e7816b-6a31-403c-a556-57616e12eb98","Type":"ContainerStarted","Data":"abd1f7dfe1f8458b88a241ee484d3ddab105e2ee662964d26e7f2aa2d859c092"}
Jul 12 08:32:23.365684 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:23.365636    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd" event={"ID":"92e7816b-6a31-403c-a556-57616e12eb98","Type":"ContainerStarted","Data":"cd8eca8190dd2f4f98db1bba6ac4cf94c1835d8cc509efa1f2bf18f014f87352"}
Jul 12 08:32:23.382637 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:23.382584    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd" podStartSLOduration=2.172899681 podStartE2EDuration="2.382569067s" totalImagesPullingTime="209.669386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:32:23.380901075 +0000 UTC m=+645.960359551" watchObservedRunningTime="2026-07-12 08:32:23.382569067 +0000 UTC m=+645.962027545"
Jul 12 08:32:32.119717 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:32.119679    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:32.120146 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:32.119968    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:32.132167 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:32.132147    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:32:32.422883 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:32:32.422833    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd"
Jul 12 08:36:37.829965 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:36:37.829888    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:36:37.833204 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:36:37.833181    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:41:37.863269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:41:37.863244    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:41:37.867793 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:41:37.867771    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:46:37.896112 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:37.896007    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:46:37.901181 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:37.901161    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:46:47.624096 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.624052    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"]
Jul 12 08:46:47.627675 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.627650    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.630540 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.630515    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ea05cb34-openshift-default-dockercfg-8psfh\""
Jul 12 08:46:47.645153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.645127    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"]
Jul 12 08:46:47.684771 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.684730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hwxt\" (UniqueName: \"kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-kube-api-access-7hwxt\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.684975 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.684802    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-certs\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.684975 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.684833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-data\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.684975 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.684896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-credential-socket\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.685112 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.684974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-envoy\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.685112 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.685005    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-podinfo\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.685112 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.685023    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-token\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.685112 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.685063    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-socket\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.685112 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.685102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5879ea55-ea55-4e92-9e4b-26a56087354b-istiod-ca-cert\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786163 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hwxt\" (UniqueName: \"kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-kube-api-access-7hwxt\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786360 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-certs\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786360 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786213    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-data\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786360 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-credential-socket\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786360 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786355    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-envoy\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786598 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-podinfo\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786598 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-token\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786598 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-socket\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786598 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786481    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5879ea55-ea55-4e92-9e4b-26a56087354b-istiod-ca-cert\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786598 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-certs\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786821 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786646    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-data\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786821 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-credential-socket\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.786925 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.786832    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-socket\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.787188 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.787164    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5879ea55-ea55-4e92-9e4b-26a56087354b-istiod-ca-cert\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.788693 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.788675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-envoy\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.788920 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.788900    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-podinfo\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.794150 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.794125    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-token\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.794255 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.794195    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hwxt\" (UniqueName: \"kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-kube-api-access-7hwxt\") pod \"e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") " pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:47.940440 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:47.940406    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:48.074691 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:48.074667    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"]
Jul 12 08:46:48.076677 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:46:48.076636    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5879ea55_ea55_4e92_9e4b_26a56087354b.slice/crio-d0f6731d84a6ef54e8b4490fdb022f9a8ee82d97a01fb1c86cea0a52bd9fc7b6 WatchSource:0}: Error finding container d0f6731d84a6ef54e8b4490fdb022f9a8ee82d97a01fb1c86cea0a52bd9fc7b6: Status 404 returned error can't find the container with id d0f6731d84a6ef54e8b4490fdb022f9a8ee82d97a01fb1c86cea0a52bd9fc7b6
Jul 12 08:46:48.078767 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:48.078735    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:46:48.078868 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:48.078800    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:46:48.078868 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:48.078826    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:46:48.824631 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:48.824576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw" event={"ID":"5879ea55-ea55-4e92-9e4b-26a56087354b","Type":"ContainerStarted","Data":"d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f"}
Jul 12 08:46:48.825200 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:48.824651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw" event={"ID":"5879ea55-ea55-4e92-9e4b-26a56087354b","Type":"ContainerStarted","Data":"d0f6731d84a6ef54e8b4490fdb022f9a8ee82d97a01fb1c86cea0a52bd9fc7b6"}
Jul 12 08:46:48.850644 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:48.850600    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw" podStartSLOduration=1.850582962 podStartE2EDuration="1.850582962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:46:48.849129191 +0000 UTC m=+1511.428587669" watchObservedRunningTime="2026-07-12 08:46:48.850582962 +0000 UTC m=+1511.430041440"
Jul 12 08:46:48.940528 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:48.940498    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:49.945987 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:49.945954    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:50.835299 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:50.835272    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:50.836173 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:50.836152    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:54.021627 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:54.021594    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"]
Jul 12 08:46:54.022186 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:54.021808    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw" podUID="5879ea55-ea55-4e92-9e4b-26a56087354b" containerName="istio-proxy" containerID="cri-o://d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f" gracePeriod=30
Jul 12 08:46:59.280052 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.280028    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:59.399915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.395761    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hwxt\" (UniqueName: \"kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-kube-api-access-7hwxt\") pod \"5879ea55-ea55-4e92-9e4b-26a56087354b\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") "
Jul 12 08:46:59.399915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.395832    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-podinfo\") pod \"5879ea55-ea55-4e92-9e4b-26a56087354b\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") "
Jul 12 08:46:59.399915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.395900    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-token\") pod \"5879ea55-ea55-4e92-9e4b-26a56087354b\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") "
Jul 12 08:46:59.399915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.395936    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-certs\") pod \"5879ea55-ea55-4e92-9e4b-26a56087354b\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") "
Jul 12 08:46:59.399915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.395963    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5879ea55-ea55-4e92-9e4b-26a56087354b-istiod-ca-cert\") pod \"5879ea55-ea55-4e92-9e4b-26a56087354b\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") "
Jul 12 08:46:59.399915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.396023    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-credential-socket\") pod \"5879ea55-ea55-4e92-9e4b-26a56087354b\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") "
Jul 12 08:46:59.399915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.396056    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-socket\") pod \"5879ea55-ea55-4e92-9e4b-26a56087354b\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") "
Jul 12 08:46:59.399915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.396136    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-data\") pod \"5879ea55-ea55-4e92-9e4b-26a56087354b\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") "
Jul 12 08:46:59.399915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.396170    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-envoy\") pod \"5879ea55-ea55-4e92-9e4b-26a56087354b\" (UID: \"5879ea55-ea55-4e92-9e4b-26a56087354b\") "
Jul 12 08:46:59.399915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.399378    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5879ea55-ea55-4e92-9e4b-26a56087354b" (UID: "5879ea55-ea55-4e92-9e4b-26a56087354b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:46:59.402043 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.401747    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-kube-api-access-7hwxt" (OuterVolumeSpecName: "kube-api-access-7hwxt") pod "5879ea55-ea55-4e92-9e4b-26a56087354b" (UID: "5879ea55-ea55-4e92-9e4b-26a56087354b"). InnerVolumeSpecName "kube-api-access-7hwxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:46:59.402542 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.402517    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5879ea55-ea55-4e92-9e4b-26a56087354b" (UID: "5879ea55-ea55-4e92-9e4b-26a56087354b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:46:59.402702 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.402535    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5879ea55-ea55-4e92-9e4b-26a56087354b" (UID: "5879ea55-ea55-4e92-9e4b-26a56087354b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:46:59.402819 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.402592    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5879ea55-ea55-4e92-9e4b-26a56087354b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5879ea55-ea55-4e92-9e4b-26a56087354b" (UID: "5879ea55-ea55-4e92-9e4b-26a56087354b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:46:59.402819 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.402773    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5879ea55-ea55-4e92-9e4b-26a56087354b" (UID: "5879ea55-ea55-4e92-9e4b-26a56087354b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:46:59.402944 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.402915    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-data" (OuterVolumeSpecName: "istio-data") pod "5879ea55-ea55-4e92-9e4b-26a56087354b" (UID: "5879ea55-ea55-4e92-9e4b-26a56087354b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:46:59.404050 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.404027    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5879ea55-ea55-4e92-9e4b-26a56087354b" (UID: "5879ea55-ea55-4e92-9e4b-26a56087354b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 08:46:59.404693 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.404676    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-token" (OuterVolumeSpecName: "istio-token") pod "5879ea55-ea55-4e92-9e4b-26a56087354b" (UID: "5879ea55-ea55-4e92-9e4b-26a56087354b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:46:59.497427 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.497391    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-podinfo\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:46:59.497427 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.497420    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-token\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:46:59.497427 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.497429    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-certs\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:46:59.497427 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.497438    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5879ea55-ea55-4e92-9e4b-26a56087354b-istiod-ca-cert\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:46:59.497668 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.497445    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-credential-socket\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:46:59.497668 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.497455    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-workload-socket\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:46:59.497668 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.497464    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-data\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:46:59.497668 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.497472    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5879ea55-ea55-4e92-9e4b-26a56087354b-istio-envoy\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:46:59.497668 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.497480    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hwxt\" (UniqueName: \"kubernetes.io/projected/5879ea55-ea55-4e92-9e4b-26a56087354b-kube-api-access-7hwxt\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:46:59.882578 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.882491    2583 generic.go:356] "Generic (PLEG): container finished" podID="5879ea55-ea55-4e92-9e4b-26a56087354b" containerID="d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f" exitCode=0
Jul 12 08:46:59.882578 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.882570    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"
Jul 12 08:46:59.882772 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.882577    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw" event={"ID":"5879ea55-ea55-4e92-9e4b-26a56087354b","Type":"ContainerDied","Data":"d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f"}
Jul 12 08:46:59.882772 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.882658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw" event={"ID":"5879ea55-ea55-4e92-9e4b-26a56087354b","Type":"ContainerDied","Data":"d0f6731d84a6ef54e8b4490fdb022f9a8ee82d97a01fb1c86cea0a52bd9fc7b6"}
Jul 12 08:46:59.882772 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.882681    2583 scope.go:117] "RemoveContainer" containerID="d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f"
Jul 12 08:46:59.892332 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.892308    2583 scope.go:117] "RemoveContainer" containerID="d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f"
Jul 12 08:46:59.892592 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:46:59.892565    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f\": container with ID starting with d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f not found: ID does not exist" containerID="d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f"
Jul 12 08:46:59.892661 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.892600    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f"} err="failed to get container status \"d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f\": rpc error: code = NotFound desc = could not find container \"d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f\": container with ID starting with d8b2e8d93c5a3c79205b801acd0ae6bd08fe4a5035df7b9cf478801c8545949f not found: ID does not exist"
Jul 12 08:46:59.904878 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.904821    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"]
Jul 12 08:46:59.910746 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:46:59.910721    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ea05cb34-openshift-default-787f985fdf-4vgkw"]
Jul 12 08:47:00.044338 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.044304    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"]
Jul 12 08:47:00.044908 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.044891    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5879ea55-ea55-4e92-9e4b-26a56087354b" containerName="istio-proxy"
Jul 12 08:47:00.044962 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.044912    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5879ea55-ea55-4e92-9e4b-26a56087354b" containerName="istio-proxy"
Jul 12 08:47:00.045008 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.044997    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5879ea55-ea55-4e92-9e4b-26a56087354b" containerName="istio-proxy"
Jul 12 08:47:00.049755 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.049732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.052823 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.052800    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7d19ceaa-openshift-default-dockercfg-b6w47\""
Jul 12 08:47:00.058362 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.058343    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"]
Jul 12 08:47:00.203928 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.203894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-socket\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.203928 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.203930    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/019041a0-dfff-4ba4-9f19-abd194120e78-istio-podinfo\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.204140 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.203957    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jsh\" (UniqueName: \"kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-kube-api-access-w5jsh\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.204140 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.204044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-certs\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.204140 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.204073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-data\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.204140 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.204089    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-istio-token\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.204269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.204160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-credential-socket\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.204269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.204183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-envoy\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.204269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.204197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/019041a0-dfff-4ba4-9f19-abd194120e78-istiod-ca-cert\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305014 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.304981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-certs\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305014 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-data\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305486 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-istio-token\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305486 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305075    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-credential-socket\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305486 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-envoy\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305486 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/019041a0-dfff-4ba4-9f19-abd194120e78-istiod-ca-cert\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305486 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-socket\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305486 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/019041a0-dfff-4ba4-9f19-abd194120e78-istio-podinfo\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305486 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jsh\" (UniqueName: \"kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-kube-api-access-w5jsh\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305486 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305439    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-data\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305486 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305464    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-certs\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305978 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-socket\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305978 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305644    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-credential-socket\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.305978 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.305915    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/019041a0-dfff-4ba4-9f19-abd194120e78-istiod-ca-cert\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.307633 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.307601    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/019041a0-dfff-4ba4-9f19-abd194120e78-istio-podinfo\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.307633 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.307608    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-envoy\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.313514 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.313484    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-istio-token\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.313600 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.313539    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jsh\" (UniqueName: \"kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-kube-api-access-w5jsh\") pod \"e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") " pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.361688 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.361664    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:00.369410 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.369382    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5879ea55-ea55-4e92-9e4b-26a56087354b" path="/var/lib/kubelet/pods/5879ea55-ea55-4e92-9e4b-26a56087354b/volumes"
Jul 12 08:47:00.497171 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.497144    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"]
Jul 12 08:47:00.498416 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:47:00.498382    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod019041a0_dfff_4ba4_9f19_abd194120e78.slice/crio-d67e72e7da746f8d367122c213d06ca0b8d0eed141b0b16ac885ec5b0eee0c7d WatchSource:0}: Error finding container d67e72e7da746f8d367122c213d06ca0b8d0eed141b0b16ac885ec5b0eee0c7d: Status 404 returned error can't find the container with id d67e72e7da746f8d367122c213d06ca0b8d0eed141b0b16ac885ec5b0eee0c7d
Jul 12 08:47:00.500813 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.500775    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:47:00.500905 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.500879    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:47:00.500954 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.500925    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 08:47:00.890840 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.890756    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk" event={"ID":"019041a0-dfff-4ba4-9f19-abd194120e78","Type":"ContainerStarted","Data":"c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822"}
Jul 12 08:47:00.890840 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.890808    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk" event={"ID":"019041a0-dfff-4ba4-9f19-abd194120e78","Type":"ContainerStarted","Data":"d67e72e7da746f8d367122c213d06ca0b8d0eed141b0b16ac885ec5b0eee0c7d"}
Jul 12 08:47:00.911499 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:00.911453    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk" podStartSLOduration=0.91143796 podStartE2EDuration="911.43796ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:47:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:47:00.90922322 +0000 UTC m=+1523.488681724" watchObservedRunningTime="2026-07-12 08:47:00.91143796 +0000 UTC m=+1523.490896438"
Jul 12 08:47:01.362549 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:01.362516    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:01.368351 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:01.368277    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:01.896418 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:01.896388    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:01.897246 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:01.897226    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:12.354643 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.354555    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"]
Jul 12 08:47:12.355134 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.354766    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk" podUID="019041a0-dfff-4ba4-9f19-abd194120e78" containerName="istio-proxy" containerID="cri-o://c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822" gracePeriod=30
Jul 12 08:47:12.502131 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.502104    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:12.527600 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.527567    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-certs\") pod \"019041a0-dfff-4ba4-9f19-abd194120e78\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") "
Jul 12 08:47:12.527764 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.527621    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-istio-token\") pod \"019041a0-dfff-4ba4-9f19-abd194120e78\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") "
Jul 12 08:47:12.527764 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.527692    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5jsh\" (UniqueName: \"kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-kube-api-access-w5jsh\") pod \"019041a0-dfff-4ba4-9f19-abd194120e78\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") "
Jul 12 08:47:12.527764 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.527737    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/019041a0-dfff-4ba4-9f19-abd194120e78-istio-podinfo\") pod \"019041a0-dfff-4ba4-9f19-abd194120e78\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") "
Jul 12 08:47:12.527764 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.527759    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-data\") pod \"019041a0-dfff-4ba4-9f19-abd194120e78\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") "
Jul 12 08:47:12.528319 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.527786    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/019041a0-dfff-4ba4-9f19-abd194120e78-istiod-ca-cert\") pod \"019041a0-dfff-4ba4-9f19-abd194120e78\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") "
Jul 12 08:47:12.528319 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.527814    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-socket\") pod \"019041a0-dfff-4ba4-9f19-abd194120e78\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") "
Jul 12 08:47:12.528319 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.527815    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "019041a0-dfff-4ba4-9f19-abd194120e78" (UID: "019041a0-dfff-4ba4-9f19-abd194120e78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:47:12.528319 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.527836    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-credential-socket\") pod \"019041a0-dfff-4ba4-9f19-abd194120e78\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") "
Jul 12 08:47:12.528319 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.527886    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-envoy\") pod \"019041a0-dfff-4ba4-9f19-abd194120e78\" (UID: \"019041a0-dfff-4ba4-9f19-abd194120e78\") "
Jul 12 08:47:12.528319 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.528077    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "019041a0-dfff-4ba4-9f19-abd194120e78" (UID: "019041a0-dfff-4ba4-9f19-abd194120e78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:47:12.528319 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.528244    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-certs\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:47:12.528319 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.528263    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-workload-socket\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:47:12.528742 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.528385    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "019041a0-dfff-4ba4-9f19-abd194120e78" (UID: "019041a0-dfff-4ba4-9f19-abd194120e78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:47:12.528742 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.528533    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/019041a0-dfff-4ba4-9f19-abd194120e78-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "019041a0-dfff-4ba4-9f19-abd194120e78" (UID: "019041a0-dfff-4ba4-9f19-abd194120e78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:47:12.529431 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.529406    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-data" (OuterVolumeSpecName: "istio-data") pod "019041a0-dfff-4ba4-9f19-abd194120e78" (UID: "019041a0-dfff-4ba4-9f19-abd194120e78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:47:12.530528 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.530505    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "019041a0-dfff-4ba4-9f19-abd194120e78" (UID: "019041a0-dfff-4ba4-9f19-abd194120e78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:47:12.530676 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.530658    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-istio-token" (OuterVolumeSpecName: "istio-token") pod "019041a0-dfff-4ba4-9f19-abd194120e78" (UID: "019041a0-dfff-4ba4-9f19-abd194120e78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:47:12.530745 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.530721    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/019041a0-dfff-4ba4-9f19-abd194120e78-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "019041a0-dfff-4ba4-9f19-abd194120e78" (UID: "019041a0-dfff-4ba4-9f19-abd194120e78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 08:47:12.531260 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.531228    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-kube-api-access-w5jsh" (OuterVolumeSpecName: "kube-api-access-w5jsh") pod "019041a0-dfff-4ba4-9f19-abd194120e78" (UID: "019041a0-dfff-4ba4-9f19-abd194120e78"). InnerVolumeSpecName "kube-api-access-w5jsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:47:12.629293 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.629219    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-istio-token\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:47:12.629293 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.629245    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5jsh\" (UniqueName: \"kubernetes.io/projected/019041a0-dfff-4ba4-9f19-abd194120e78-kube-api-access-w5jsh\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:47:12.629293 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.629255    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/019041a0-dfff-4ba4-9f19-abd194120e78-istio-podinfo\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:47:12.629293 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.629263    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-data\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:47:12.629293 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.629271    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/019041a0-dfff-4ba4-9f19-abd194120e78-istiod-ca-cert\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:47:12.629293 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.629278    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-credential-socket\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:47:12.629293 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.629285    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/019041a0-dfff-4ba4-9f19-abd194120e78-istio-envoy\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:47:12.961156 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.961127    2583 generic.go:356] "Generic (PLEG): container finished" podID="019041a0-dfff-4ba4-9f19-abd194120e78" containerID="c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822" exitCode=0
Jul 12 08:47:12.961335 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.961169    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"
Jul 12 08:47:12.961335 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.961183    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk" event={"ID":"019041a0-dfff-4ba4-9f19-abd194120e78","Type":"ContainerDied","Data":"c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822"}
Jul 12 08:47:12.961335 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.961224    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk" event={"ID":"019041a0-dfff-4ba4-9f19-abd194120e78","Type":"ContainerDied","Data":"d67e72e7da746f8d367122c213d06ca0b8d0eed141b0b16ac885ec5b0eee0c7d"}
Jul 12 08:47:12.961335 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.961246    2583 scope.go:117] "RemoveContainer" containerID="c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822"
Jul 12 08:47:12.970413 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.970396    2583 scope.go:117] "RemoveContainer" containerID="c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822"
Jul 12 08:47:12.970687 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:47:12.970670    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822\": container with ID starting with c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822 not found: ID does not exist" containerID="c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822"
Jul 12 08:47:12.970727 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.970696    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822"} err="failed to get container status \"c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822\": rpc error: code = NotFound desc = could not find container \"c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822\": container with ID starting with c4dddc0338a5cfd507e13a2d072eb93e5888e4c9041f701b66eef340551b1822 not found: ID does not exist"
Jul 12 08:47:12.982320 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.982299    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"]
Jul 12 08:47:12.987458 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:12.987438    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7d19ceaa-openshift-default-c5c79f65-m56zk"]
Jul 12 08:47:14.367981 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:47:14.367948    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="019041a0-dfff-4ba4-9f19-abd194120e78" path="/var/lib/kubelet/pods/019041a0-dfff-4ba4-9f19-abd194120e78/volumes"
Jul 12 08:49:47.252013 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.251976    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"]
Jul 12 08:49:47.252598 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.252579    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="019041a0-dfff-4ba4-9f19-abd194120e78" containerName="istio-proxy"
Jul 12 08:49:47.252661 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.252603    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="019041a0-dfff-4ba4-9f19-abd194120e78" containerName="istio-proxy"
Jul 12 08:49:47.252741 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.252728    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="019041a0-dfff-4ba4-9f19-abd194120e78" containerName="istio-proxy"
Jul 12 08:49:47.256125 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.256107    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.259010 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.258985    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2828b0e9-serving-cert\""
Jul 12 08:49:47.259191 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.259172    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 08:49:47.260134 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.260119    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8ggw6\""
Jul 12 08:49:47.260134 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.260130    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 08:49:47.264441 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.264350    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"]
Jul 12 08:49:47.347941 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.347897    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5992dce5-c653-4884-8ea1-891088be2f11-openshift-service-ca\") pod \"maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.348139 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.347964    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5992dce5-c653-4884-8ea1-891088be2f11-maas-api-tls\") pod \"maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.348139 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.348014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wcr\" (UniqueName: \"kubernetes.io/projected/5992dce5-c653-4884-8ea1-891088be2f11-kube-api-access-k6wcr\") pod \"maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.448612 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.448574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5992dce5-c653-4884-8ea1-891088be2f11-maas-api-tls\") pod \"maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.448828 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.448645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wcr\" (UniqueName: \"kubernetes.io/projected/5992dce5-c653-4884-8ea1-891088be2f11-kube-api-access-k6wcr\") pod \"maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.448828 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.448710    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5992dce5-c653-4884-8ea1-891088be2f11-openshift-service-ca\") pod \"maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.449370 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.449350    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5992dce5-c653-4884-8ea1-891088be2f11-openshift-service-ca\") pod \"maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.451065 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.451045    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5992dce5-c653-4884-8ea1-891088be2f11-maas-api-tls\") pod \"maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.459922 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.459902    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wcr\" (UniqueName: \"kubernetes.io/projected/5992dce5-c653-4884-8ea1-891088be2f11-kube-api-access-k6wcr\") pod \"maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.568281 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.568198    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:47.711699 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.711663    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"]
Jul 12 08:49:47.726519 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:49:47.726490    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5992dce5_c653_4884_8ea1_891088be2f11.slice/crio-f688d6ce0b297474dd3125bf723f00411f60382f2d56c66a939c91e6a69ce2c8 WatchSource:0}: Error finding container f688d6ce0b297474dd3125bf723f00411f60382f2d56c66a939c91e6a69ce2c8: Status 404 returned error can't find the container with id f688d6ce0b297474dd3125bf723f00411f60382f2d56c66a939c91e6a69ce2c8
Jul 12 08:49:47.727749 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.727729    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:49:47.757165 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:47.757136    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr" event={"ID":"5992dce5-c653-4884-8ea1-891088be2f11","Type":"ContainerStarted","Data":"f688d6ce0b297474dd3125bf723f00411f60382f2d56c66a939c91e6a69ce2c8"}
Jul 12 08:49:49.770387 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:49.770347    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr" event={"ID":"5992dce5-c653-4884-8ea1-891088be2f11","Type":"ContainerStarted","Data":"f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f"}
Jul 12 08:49:49.770782 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:49.770416    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:49:49.786796 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:49.786597    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr" podStartSLOduration=1.17397998 podStartE2EDuration="2.786578075s" totalImagesPullingTime="1.612598095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:49:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:49:49.786454421 +0000 UTC m=+1692.365912900" watchObservedRunningTime="2026-07-12 08:49:49.786578075 +0000 UTC m=+1692.366036555"
Jul 12 08:49:55.781218 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:49:55.781188    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:50:12.111719 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.111634    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"]
Jul 12 08:50:12.115136 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.115120    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.118953 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.118928    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2828b0e9\"/\"default-dockercfg-4m5vv\""
Jul 12 08:50:12.119093 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.118959    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2828b0e9\"/\"kube-root-ca.crt\""
Jul 12 08:50:12.119093 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.118970    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2828b0e9\"/\"openshift-service-ca.crt\""
Jul 12 08:50:12.119093 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.118987    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2828b0e9\"/\"e2e-lifecycle-model-2828b0e9-kserve-self-signed-certs\""
Jul 12 08:50:12.125338 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.125316    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"]
Jul 12 08:50:12.176440 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.176401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-model-cache\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.176648 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.176469    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-home\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.176648 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.176511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-dshm\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.176648 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.176534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-tmp-dir\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.176648 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.176556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95213646-53f1-4b64-9061-1247f098b6f3-tls-certs\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.176648 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.176585    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f87n6\" (UniqueName: \"kubernetes.io/projected/95213646-53f1-4b64-9061-1247f098b6f3-kube-api-access-f87n6\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.277887 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.277828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-model-cache\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.278085 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.277905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-home\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.278085 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.277931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-dshm\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.278085 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.277945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-tmp-dir\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.278085 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.277961    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95213646-53f1-4b64-9061-1247f098b6f3-tls-certs\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.278085 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.277983    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f87n6\" (UniqueName: \"kubernetes.io/projected/95213646-53f1-4b64-9061-1247f098b6f3-kube-api-access-f87n6\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.278388 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.278278    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-model-cache\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.278565 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.278516    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-home\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.278701 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.278616    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-tmp-dir\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.280508 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.280489    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-dshm\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.280702 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.280683    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95213646-53f1-4b64-9061-1247f098b6f3-tls-certs\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.285220 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.285198    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f87n6\" (UniqueName: \"kubernetes.io/projected/95213646-53f1-4b64-9061-1247f098b6f3-kube-api-access-f87n6\") pod \"e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") " pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.426003 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.425971    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:12.555482 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.555458    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"]
Jul 12 08:50:12.557464 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:50:12.557431    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95213646_53f1_4b64_9061_1247f098b6f3.slice/crio-94e19b93231858ab6bfe9543bda7c55714386050caeff980f5e81e41e0f03598 WatchSource:0}: Error finding container 94e19b93231858ab6bfe9543bda7c55714386050caeff980f5e81e41e0f03598: Status 404 returned error can't find the container with id 94e19b93231858ab6bfe9543bda7c55714386050caeff980f5e81e41e0f03598
Jul 12 08:50:12.892246 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.892165    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb" event={"ID":"95213646-53f1-4b64-9061-1247f098b6f3","Type":"ContainerStarted","Data":"6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc"}
Jul 12 08:50:12.892246 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.892204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb" event={"ID":"95213646-53f1-4b64-9061-1247f098b6f3","Type":"ContainerStarted","Data":"94e19b93231858ab6bfe9543bda7c55714386050caeff980f5e81e41e0f03598"}
Jul 12 08:50:12.907806 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:12.907759    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb" podStartSLOduration=0.907745418 podStartE2EDuration="907.745418ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:50:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:50:12.906595916 +0000 UTC m=+1715.486054395" watchObservedRunningTime="2026-07-12 08:50:12.907745418 +0000 UTC m=+1715.487203941"
Jul 12 08:50:22.426195 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:22.426153    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:22.426751 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:22.426380    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:22.438774 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:22.438747    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:22.957702 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:22.957672    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:50:35.097806 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.097772    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"]
Jul 12 08:50:35.098329 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.098007    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr" podUID="5992dce5-c653-4884-8ea1-891088be2f11" containerName="maas-api" containerID="cri-o://f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f" gracePeriod=30
Jul 12 08:50:35.359313 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.359240    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:50:35.393165 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.393127    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5992dce5-c653-4884-8ea1-891088be2f11-openshift-service-ca\") pod \"5992dce5-c653-4884-8ea1-891088be2f11\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") "
Jul 12 08:50:35.393322 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.393185    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6wcr\" (UniqueName: \"kubernetes.io/projected/5992dce5-c653-4884-8ea1-891088be2f11-kube-api-access-k6wcr\") pod \"5992dce5-c653-4884-8ea1-891088be2f11\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") "
Jul 12 08:50:35.393322 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.393261    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5992dce5-c653-4884-8ea1-891088be2f11-maas-api-tls\") pod \"5992dce5-c653-4884-8ea1-891088be2f11\" (UID: \"5992dce5-c653-4884-8ea1-891088be2f11\") "
Jul 12 08:50:35.393543 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.393490    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5992dce5-c653-4884-8ea1-891088be2f11-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5992dce5-c653-4884-8ea1-891088be2f11" (UID: "5992dce5-c653-4884-8ea1-891088be2f11"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:50:35.393957 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.393716    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5992dce5-c653-4884-8ea1-891088be2f11-openshift-service-ca\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:50:35.396010 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.395985    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5992dce5-c653-4884-8ea1-891088be2f11-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5992dce5-c653-4884-8ea1-891088be2f11" (UID: "5992dce5-c653-4884-8ea1-891088be2f11"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:50:35.396010 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.395995    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5992dce5-c653-4884-8ea1-891088be2f11-kube-api-access-k6wcr" (OuterVolumeSpecName: "kube-api-access-k6wcr") pod "5992dce5-c653-4884-8ea1-891088be2f11" (UID: "5992dce5-c653-4884-8ea1-891088be2f11"). InnerVolumeSpecName "kube-api-access-k6wcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:50:35.494293 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.494259    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6wcr\" (UniqueName: \"kubernetes.io/projected/5992dce5-c653-4884-8ea1-891088be2f11-kube-api-access-k6wcr\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:50:35.494293 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:35.494287    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5992dce5-c653-4884-8ea1-891088be2f11-maas-api-tls\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:50:36.018144 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:36.018105    2583 generic.go:356] "Generic (PLEG): container finished" podID="5992dce5-c653-4884-8ea1-891088be2f11" containerID="f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f" exitCode=0
Jul 12 08:50:36.018328 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:36.018161    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"
Jul 12 08:50:36.018328 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:36.018193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr" event={"ID":"5992dce5-c653-4884-8ea1-891088be2f11","Type":"ContainerDied","Data":"f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f"}
Jul 12 08:50:36.018328 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:36.018254    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr" event={"ID":"5992dce5-c653-4884-8ea1-891088be2f11","Type":"ContainerDied","Data":"f688d6ce0b297474dd3125bf723f00411f60382f2d56c66a939c91e6a69ce2c8"}
Jul 12 08:50:36.018328 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:36.018280    2583 scope.go:117] "RemoveContainer" containerID="f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f"
Jul 12 08:50:36.031643 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:36.031622    2583 scope.go:117] "RemoveContainer" containerID="f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f"
Jul 12 08:50:36.031959 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:50:36.031935    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f\": container with ID starting with f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f not found: ID does not exist" containerID="f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f"
Jul 12 08:50:36.032046 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:36.031967    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f"} err="failed to get container status \"f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f\": rpc error: code = NotFound desc = could not find container \"f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f\": container with ID starting with f024237a93fa3a54a2f8a71767bee719f1f604a596f056666fba673594dfa10f not found: ID does not exist"
Jul 12 08:50:36.042559 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:36.042534    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"]
Jul 12 08:50:36.044624 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:36.044598    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2828b0e9-776b4b7787-gnkwr"]
Jul 12 08:50:36.368641 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:36.368550    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5992dce5-c653-4884-8ea1-891088be2f11" path="/var/lib/kubelet/pods/5992dce5-c653-4884-8ea1-891088be2f11/volumes"
Jul 12 08:50:45.473454 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:50:45.473416    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"]
Jul 12 08:51:00.494270 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.494226    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb" podUID="95213646-53f1-4b64-9061-1247f098b6f3" containerName="main" containerID="cri-o://6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc" gracePeriod=45
Jul 12 08:51:00.738381 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.738351    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:51:00.815333 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.815241    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-dshm\") pod \"95213646-53f1-4b64-9061-1247f098b6f3\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") "
Jul 12 08:51:00.815333 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.815301    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95213646-53f1-4b64-9061-1247f098b6f3-tls-certs\") pod \"95213646-53f1-4b64-9061-1247f098b6f3\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") "
Jul 12 08:51:00.815551 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.815340    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-model-cache\") pod \"95213646-53f1-4b64-9061-1247f098b6f3\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") "
Jul 12 08:51:00.815551 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.815418    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f87n6\" (UniqueName: \"kubernetes.io/projected/95213646-53f1-4b64-9061-1247f098b6f3-kube-api-access-f87n6\") pod \"95213646-53f1-4b64-9061-1247f098b6f3\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") "
Jul 12 08:51:00.815551 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.815433    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-home\") pod \"95213646-53f1-4b64-9061-1247f098b6f3\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") "
Jul 12 08:51:00.815551 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.815470    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-tmp-dir\") pod \"95213646-53f1-4b64-9061-1247f098b6f3\" (UID: \"95213646-53f1-4b64-9061-1247f098b6f3\") "
Jul 12 08:51:00.815775 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.815694    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "95213646-53f1-4b64-9061-1247f098b6f3" (UID: "95213646-53f1-4b64-9061-1247f098b6f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:51:00.815775 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.815738    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-home" (OuterVolumeSpecName: "home") pod "95213646-53f1-4b64-9061-1247f098b6f3" (UID: "95213646-53f1-4b64-9061-1247f098b6f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:51:00.815910 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.815815    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "95213646-53f1-4b64-9061-1247f098b6f3" (UID: "95213646-53f1-4b64-9061-1247f098b6f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:51:00.817615 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.817584    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95213646-53f1-4b64-9061-1247f098b6f3-kube-api-access-f87n6" (OuterVolumeSpecName: "kube-api-access-f87n6") pod "95213646-53f1-4b64-9061-1247f098b6f3" (UID: "95213646-53f1-4b64-9061-1247f098b6f3"). InnerVolumeSpecName "kube-api-access-f87n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:51:00.817615 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.817599    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-dshm" (OuterVolumeSpecName: "dshm") pod "95213646-53f1-4b64-9061-1247f098b6f3" (UID: "95213646-53f1-4b64-9061-1247f098b6f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:51:00.817773 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.817620    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95213646-53f1-4b64-9061-1247f098b6f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "95213646-53f1-4b64-9061-1247f098b6f3" (UID: "95213646-53f1-4b64-9061-1247f098b6f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:51:00.916269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.916229    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f87n6\" (UniqueName: \"kubernetes.io/projected/95213646-53f1-4b64-9061-1247f098b6f3-kube-api-access-f87n6\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:51:00.916269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.916262    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-home\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:51:00.916269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.916271    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-tmp-dir\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:51:00.916269 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.916279    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-dshm\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:51:00.916562 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.916287    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95213646-53f1-4b64-9061-1247f098b6f3-tls-certs\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:51:00.916562 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:00.916295    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95213646-53f1-4b64-9061-1247f098b6f3-model-cache\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:51:01.153766 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:01.153734    2583 generic.go:356] "Generic (PLEG): container finished" podID="95213646-53f1-4b64-9061-1247f098b6f3" containerID="6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc" exitCode=0
Jul 12 08:51:01.153955 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:01.153776    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"
Jul 12 08:51:01.153955 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:01.153787    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb" event={"ID":"95213646-53f1-4b64-9061-1247f098b6f3","Type":"ContainerDied","Data":"6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc"}
Jul 12 08:51:01.153955 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:01.153824    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb" event={"ID":"95213646-53f1-4b64-9061-1247f098b6f3","Type":"ContainerDied","Data":"94e19b93231858ab6bfe9543bda7c55714386050caeff980f5e81e41e0f03598"}
Jul 12 08:51:01.153955 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:01.153844    2583 scope.go:117] "RemoveContainer" containerID="6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc"
Jul 12 08:51:01.168178 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:01.168158    2583 scope.go:117] "RemoveContainer" containerID="6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc"
Jul 12 08:51:01.168518 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:51:01.168489    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc\": container with ID starting with 6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc not found: ID does not exist" containerID="6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc"
Jul 12 08:51:01.168635 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:01.168529    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc"} err="failed to get container status \"6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc\": rpc error: code = NotFound desc = could not find container \"6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc\": container with ID starting with 6b726dcc24fd3d9bb79e135667a0e6d3f30476f59c882ec8c2a9a592628031fc not found: ID does not exist"
Jul 12 08:51:01.178185 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:01.178159    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"]
Jul 12 08:51:01.181543 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:01.181520    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-2828b0e9/e2e-lifecycle-model-2828b0e9-kserve-86b647544c-w47hb"]
Jul 12 08:51:02.368112 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:02.368081    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95213646-53f1-4b64-9061-1247f098b6f3" path="/var/lib/kubelet/pods/95213646-53f1-4b64-9061-1247f098b6f3/volumes"
Jul 12 08:51:37.934771 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:37.934744    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:51:37.941377 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:51:37.941357    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:52:25.034086 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.034047    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"]
Jul 12 08:52:25.034628 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.034389    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5992dce5-c653-4884-8ea1-891088be2f11" containerName="maas-api"
Jul 12 08:52:25.034628 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.034399    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5992dce5-c653-4884-8ea1-891088be2f11" containerName="maas-api"
Jul 12 08:52:25.034628 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.034416    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95213646-53f1-4b64-9061-1247f098b6f3" containerName="main"
Jul 12 08:52:25.034628 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.034421    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="95213646-53f1-4b64-9061-1247f098b6f3" containerName="main"
Jul 12 08:52:25.034628 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.034480    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5992dce5-c653-4884-8ea1-891088be2f11" containerName="maas-api"
Jul 12 08:52:25.034628 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.034488    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="95213646-53f1-4b64-9061-1247f098b6f3" containerName="main"
Jul 12 08:52:25.037443 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.037423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.040154 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.040132    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d8ca53-serving-cert\""
Jul 12 08:52:25.040154 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.040145    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 08:52:25.040325 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.040133    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 08:52:25.041158 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.041140    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8ggw6\""
Jul 12 08:52:25.045779 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.045760    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"]
Jul 12 08:52:25.190182 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.190151    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pjgn\" (UniqueName: \"kubernetes.io/projected/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-kube-api-access-5pjgn\") pod \"maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.190360 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.190226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-maas-api-tls\") pod \"maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.190360 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.190246    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.291244 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.291159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-maas-api-tls\") pod \"maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.291244 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.291197    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.291244 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.291244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pjgn\" (UniqueName: \"kubernetes.io/projected/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-kube-api-access-5pjgn\") pod \"maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.291989 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.291965    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.293542 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.293517    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-maas-api-tls\") pod \"maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.299358 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.299332    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pjgn\" (UniqueName: \"kubernetes.io/projected/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-kube-api-access-5pjgn\") pod \"maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.349177 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.349149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:25.501100 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.501070    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"]
Jul 12 08:52:25.502518 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:52:25.502491    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd4bbb9_4cc2_481e_bf91_2d392f790f7d.slice/crio-c6396e758667661923b9ef70067b83892884e9636015c36fb743d4a105962e6c WatchSource:0}: Error finding container c6396e758667661923b9ef70067b83892884e9636015c36fb743d4a105962e6c: Status 404 returned error can't find the container with id c6396e758667661923b9ef70067b83892884e9636015c36fb743d4a105962e6c
Jul 12 08:52:25.595456 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:25.595368    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh" event={"ID":"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d","Type":"ContainerStarted","Data":"c6396e758667661923b9ef70067b83892884e9636015c36fb743d4a105962e6c"}
Jul 12 08:52:26.602030 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:26.601997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh" event={"ID":"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d","Type":"ContainerStarted","Data":"be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5"}
Jul 12 08:52:26.602416 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:26.602059    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:26.618505 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:26.618455    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh" podStartSLOduration=1.058372046 podStartE2EDuration="1.618439639s" totalImagesPullingTime="560.067593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:52:26.617074857 +0000 UTC m=+1849.196533336" watchObservedRunningTime="2026-07-12 08:52:26.618439639 +0000 UTC m=+1849.197898116"
Jul 12 08:52:32.613556 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:32.613522    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:52:33.059461 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.059432    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"]
Jul 12 08:52:33.063301 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.063272    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.065839 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.065813    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-b534df-serving-cert\""
Jul 12 08:52:33.075579 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.075555    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"]
Jul 12 08:52:33.165153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.165107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0257b5b0-3ef6-4ef6-a338-bca21767b49e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b534df-56496557c6-qcnzk\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.165361 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.165199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0257b5b0-3ef6-4ef6-a338-bca21767b49e-maas-api-tls\") pod \"maas-api-e2e-inf-b-b534df-56496557c6-qcnzk\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.165361 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.165288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb4sf\" (UniqueName: \"kubernetes.io/projected/0257b5b0-3ef6-4ef6-a338-bca21767b49e-kube-api-access-zb4sf\") pod \"maas-api-e2e-inf-b-b534df-56496557c6-qcnzk\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.266495 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.266458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb4sf\" (UniqueName: \"kubernetes.io/projected/0257b5b0-3ef6-4ef6-a338-bca21767b49e-kube-api-access-zb4sf\") pod \"maas-api-e2e-inf-b-b534df-56496557c6-qcnzk\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.266699 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.266552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0257b5b0-3ef6-4ef6-a338-bca21767b49e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b534df-56496557c6-qcnzk\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.266699 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.266593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0257b5b0-3ef6-4ef6-a338-bca21767b49e-maas-api-tls\") pod \"maas-api-e2e-inf-b-b534df-56496557c6-qcnzk\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.266837 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:52:33.266737    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-serving-cert: secret "maas-api-e2e-inf-b-b534df-serving-cert" not found
Jul 12 08:52:33.266837 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:52:33.266810    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0257b5b0-3ef6-4ef6-a338-bca21767b49e-maas-api-tls podName:0257b5b0-3ef6-4ef6-a338-bca21767b49e nodeName:}" failed. No retries permitted until 2026-07-12 08:52:33.766787497 +0000 UTC m=+1856.346245953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0257b5b0-3ef6-4ef6-a338-bca21767b49e-maas-api-tls") pod "maas-api-e2e-inf-b-b534df-56496557c6-qcnzk" (UID: "0257b5b0-3ef6-4ef6-a338-bca21767b49e") : secret "maas-api-e2e-inf-b-b534df-serving-cert" not found
Jul 12 08:52:33.267260 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.267239    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0257b5b0-3ef6-4ef6-a338-bca21767b49e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b534df-56496557c6-qcnzk\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.275199 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.275175    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb4sf\" (UniqueName: \"kubernetes.io/projected/0257b5b0-3ef6-4ef6-a338-bca21767b49e-kube-api-access-zb4sf\") pod \"maas-api-e2e-inf-b-b534df-56496557c6-qcnzk\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.771186 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.771149    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0257b5b0-3ef6-4ef6-a338-bca21767b49e-maas-api-tls\") pod \"maas-api-e2e-inf-b-b534df-56496557c6-qcnzk\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.773647 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.773623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0257b5b0-3ef6-4ef6-a338-bca21767b49e-maas-api-tls\") pod \"maas-api-e2e-inf-b-b534df-56496557c6-qcnzk\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:33.974959 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:33.974928    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:34.110210 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:34.110186    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"]
Jul 12 08:52:34.111970 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:52:34.111944    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0257b5b0_3ef6_4ef6_a338_bca21767b49e.slice/crio-6ed42e34bd688c3eb57d7897890617901793de1e7727c04c3c9aabebd7ce32b9 WatchSource:0}: Error finding container 6ed42e34bd688c3eb57d7897890617901793de1e7727c04c3c9aabebd7ce32b9: Status 404 returned error can't find the container with id 6ed42e34bd688c3eb57d7897890617901793de1e7727c04c3c9aabebd7ce32b9
Jul 12 08:52:34.644256 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:34.644208    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk" event={"ID":"0257b5b0-3ef6-4ef6-a338-bca21767b49e","Type":"ContainerStarted","Data":"14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48"}
Jul 12 08:52:34.644432 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:34.644305    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk" event={"ID":"0257b5b0-3ef6-4ef6-a338-bca21767b49e","Type":"ContainerStarted","Data":"6ed42e34bd688c3eb57d7897890617901793de1e7727c04c3c9aabebd7ce32b9"}
Jul 12 08:52:34.644432 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:34.644330    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:34.661084 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:34.661039    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk" podStartSLOduration=1.28310473 podStartE2EDuration="1.661025925s" totalImagesPullingTime="377.921195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:52:34.658729164 +0000 UTC m=+1857.238187643" watchObservedRunningTime="2026-07-12 08:52:34.661025925 +0000 UTC m=+1857.240484448"
Jul 12 08:52:40.655288 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:40.655258    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:52:56.802630 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.802597    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"]
Jul 12 08:52:56.806520 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.806498    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.809117 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.809096    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d8ca53\"/\"kube-root-ca.crt\""
Jul 12 08:52:56.810194 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.810167    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d8ca53\"/\"default-dockercfg-v5nsl\""
Jul 12 08:52:56.810283 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.810237    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d8ca53\"/\"openshift-service-ca.crt\""
Jul 12 08:52:56.810363 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.810335    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d8ca53\"/\"test-model-d8ca53-kserve-self-signed-certs\""
Jul 12 08:52:56.815440 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.815417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"]
Jul 12 08:52:56.885385 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.885357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-home\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.885547 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.885454    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-tmp-dir\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.885547 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.885486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-dshm\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.885547 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.885524    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a559eda-7084-4a90-b16e-5b76a0599e6d-tls-certs\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.885654 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.885556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfg5f\" (UniqueName: \"kubernetes.io/projected/2a559eda-7084-4a90-b16e-5b76a0599e6d-kube-api-access-rfg5f\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.885654 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.885590    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-model-cache\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.986758 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.986715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-tmp-dir\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.986758 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.986770    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-dshm\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.987042 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.986788    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a559eda-7084-4a90-b16e-5b76a0599e6d-tls-certs\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.987042 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.986818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfg5f\" (UniqueName: \"kubernetes.io/projected/2a559eda-7084-4a90-b16e-5b76a0599e6d-kube-api-access-rfg5f\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.987042 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.986842    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-model-cache\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.987042 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.986919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-home\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.987298 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.987273    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-model-cache\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.987298 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.987287    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-tmp-dir\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.987379 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.987308    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-home\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.988992 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.988972    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-dshm\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.989280 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.989262    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a559eda-7084-4a90-b16e-5b76a0599e6d-tls-certs\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:56.994193 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:56.994171    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfg5f\" (UniqueName: \"kubernetes.io/projected/2a559eda-7084-4a90-b16e-5b76a0599e6d-kube-api-access-rfg5f\") pod \"test-model-d8ca53-kserve-7f9656c9fc-88m8t\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") " pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:57.116928 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:57.116814    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:52:57.247680 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:57.247657    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"]
Jul 12 08:52:57.248831 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:52:57.248797    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a559eda_7084_4a90_b16e_5b76a0599e6d.slice/crio-8673ae41a78b3bdc006fef1cb908ab9c4aeadf109b02026e4ddfa636b965da2b WatchSource:0}: Error finding container 8673ae41a78b3bdc006fef1cb908ab9c4aeadf109b02026e4ddfa636b965da2b: Status 404 returned error can't find the container with id 8673ae41a78b3bdc006fef1cb908ab9c4aeadf109b02026e4ddfa636b965da2b
Jul 12 08:52:57.766843 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:57.766810    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t" event={"ID":"2a559eda-7084-4a90-b16e-5b76a0599e6d","Type":"ContainerStarted","Data":"2ebaea1a4759bd068555d3cbf2b00ad6e530f48c3173a33af781b7307a0ec707"}
Jul 12 08:52:57.767029 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:57.766875    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t" event={"ID":"2a559eda-7084-4a90-b16e-5b76a0599e6d","Type":"ContainerStarted","Data":"8673ae41a78b3bdc006fef1cb908ab9c4aeadf109b02026e4ddfa636b965da2b"}
Jul 12 08:52:57.783480 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:52:57.783433    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t" podStartSLOduration=1.783418204 podStartE2EDuration="1.783418204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:52:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:52:57.781612049 +0000 UTC m=+1880.361070533" watchObservedRunningTime="2026-07-12 08:52:57.783418204 +0000 UTC m=+1880.362876682"
Jul 12 08:53:07.117365 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:07.117259    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:53:07.117365 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:07.117331    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:53:07.130193 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:07.130162    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:53:07.836969 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:07.836938    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:53:23.405559 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.405524    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"]
Jul 12 08:53:23.409097 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.409080    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.411476 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.411450    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b534df\"/\"kube-root-ca.crt\""
Jul 12 08:53:23.412759 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.412737    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b534df\"/\"test-model-b534df-kserve-self-signed-certs\""
Jul 12 08:53:23.412907 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.412809    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b534df\"/\"default-dockercfg-ncsm8\""
Jul 12 08:53:23.412907 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.412809    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b534df\"/\"openshift-service-ca.crt\""
Jul 12 08:53:23.416030 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.416005    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"]
Jul 12 08:53:23.435589 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.435562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqmsp\" (UniqueName: \"kubernetes.io/projected/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-kube-api-access-qqmsp\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.435726 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.435599    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-model-cache\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.435726 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.435628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tmp-dir\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.435880 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.435798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tls-certs\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.435947 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.435882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-home\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.436006 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.435958    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-dshm\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.536446 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.536412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-dshm\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.536646 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.536453    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqmsp\" (UniqueName: \"kubernetes.io/projected/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-kube-api-access-qqmsp\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.536646 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.536477    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-model-cache\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.536646 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.536608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tmp-dir\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.536828 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.536695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tls-certs\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.536828 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.536735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-home\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.536941 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.536892    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-model-cache\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.537053 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.537030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tmp-dir\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.537094 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.537081    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-home\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.538696 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.538667    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-dshm\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.539047 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.539029    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tls-certs\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.543715 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.543696    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqmsp\" (UniqueName: \"kubernetes.io/projected/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-kube-api-access-qqmsp\") pod \"test-model-b534df-kserve-69d49457b9-mnb2b\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") " pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.720167 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.720082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:23.857622 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.857599    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"]
Jul 12 08:53:23.859059 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:53:23.859025    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb6cfd10_e6b5_49cf_bfb2_535bb5c1c1d3.slice/crio-72d8ebe70c2d62193e41b4db0de2d02eec4adb1e0d9b5d92359f455fd25a9a14 WatchSource:0}: Error finding container 72d8ebe70c2d62193e41b4db0de2d02eec4adb1e0d9b5d92359f455fd25a9a14: Status 404 returned error can't find the container with id 72d8ebe70c2d62193e41b4db0de2d02eec4adb1e0d9b5d92359f455fd25a9a14
Jul 12 08:53:23.910715 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:23.910686    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b" event={"ID":"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3","Type":"ContainerStarted","Data":"72d8ebe70c2d62193e41b4db0de2d02eec4adb1e0d9b5d92359f455fd25a9a14"}
Jul 12 08:53:24.917120 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:24.917080    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b" event={"ID":"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3","Type":"ContainerStarted","Data":"653a9df74af280c911c141eacc1a176d8db09da9b43ac7e3ad4c71d6f9816b1e"}
Jul 12 08:53:24.934814 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:24.934765    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b" podStartSLOduration=1.9347494859999999 podStartE2EDuration="1.934749486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:53:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:53:24.932363289 +0000 UTC m=+1907.511821767" watchObservedRunningTime="2026-07-12 08:53:24.934749486 +0000 UTC m=+1907.514207968"
Jul 12 08:53:33.721033 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:33.720998    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:33.721033 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:33.721040    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:33.733494 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:33.733471    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:33.974914 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:33.974807    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:40.945543 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:40.945508    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"]
Jul 12 08:53:41.927472 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:41.927438    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"]
Jul 12 08:53:42.900588 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:42.900546    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"]
Jul 12 08:53:42.901022 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:42.900758    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh" podUID="3dd4bbb9-4cc2-481e-bf91-2d392f790f7d" containerName="maas-api" containerID="cri-o://be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5" gracePeriod=30
Jul 12 08:53:43.143120 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:43.143100    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:53:43.212270 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:43.212244    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pjgn\" (UniqueName: \"kubernetes.io/projected/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-kube-api-access-5pjgn\") pod \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") "
Jul 12 08:53:43.212458 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:43.212302    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-maas-api-tls\") pod \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") "
Jul 12 08:53:43.212458 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:43.212357    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-openshift-service-ca\") pod \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\" (UID: \"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d\") "
Jul 12 08:53:43.212774 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:43.212747    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3dd4bbb9-4cc2-481e-bf91-2d392f790f7d" (UID: "3dd4bbb9-4cc2-481e-bf91-2d392f790f7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:53:43.214344 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:43.214316    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3dd4bbb9-4cc2-481e-bf91-2d392f790f7d" (UID: "3dd4bbb9-4cc2-481e-bf91-2d392f790f7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:53:43.214439 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:43.214393    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-kube-api-access-5pjgn" (OuterVolumeSpecName: "kube-api-access-5pjgn") pod "3dd4bbb9-4cc2-481e-bf91-2d392f790f7d" (UID: "3dd4bbb9-4cc2-481e-bf91-2d392f790f7d"). InnerVolumeSpecName "kube-api-access-5pjgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:53:43.313989 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:43.313957    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pjgn\" (UniqueName: \"kubernetes.io/projected/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-kube-api-access-5pjgn\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:43.313989 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:43.313984    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-maas-api-tls\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:43.313989 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:43.313994    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d-openshift-service-ca\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:44.018065 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:44.018029    2583 generic.go:356] "Generic (PLEG): container finished" podID="3dd4bbb9-4cc2-481e-bf91-2d392f790f7d" containerID="be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5" exitCode=0
Jul 12 08:53:44.018541 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:44.018080    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"
Jul 12 08:53:44.018541 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:44.018092    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh" event={"ID":"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d","Type":"ContainerDied","Data":"be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5"}
Jul 12 08:53:44.018541 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:44.018134    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh" event={"ID":"3dd4bbb9-4cc2-481e-bf91-2d392f790f7d","Type":"ContainerDied","Data":"c6396e758667661923b9ef70067b83892884e9636015c36fb743d4a105962e6c"}
Jul 12 08:53:44.018541 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:44.018154    2583 scope.go:117] "RemoveContainer" containerID="be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5"
Jul 12 08:53:44.027973 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:44.027952    2583 scope.go:117] "RemoveContainer" containerID="be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5"
Jul 12 08:53:44.028219 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:53:44.028197    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5\": container with ID starting with be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5 not found: ID does not exist" containerID="be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5"
Jul 12 08:53:44.028297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:44.028230    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5"} err="failed to get container status \"be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5\": rpc error: code = NotFound desc = could not find container \"be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5\": container with ID starting with be28d72740aefd253da979d556c061c819714a91153936c6aa67122db2aef1d5 not found: ID does not exist"
Jul 12 08:53:44.039800 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:44.039767    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"]
Jul 12 08:53:44.043096 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:44.043075    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d8ca53-5b5844799c-qdkwh"]
Jul 12 08:53:44.368541 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:44.368462    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dd4bbb9-4cc2-481e-bf91-2d392f790f7d" path="/var/lib/kubelet/pods/3dd4bbb9-4cc2-481e-bf91-2d392f790f7d/volumes"
Jul 12 08:53:55.967980 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:55.967940    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t" podUID="2a559eda-7084-4a90-b16e-5b76a0599e6d" containerName="main" containerID="cri-o://2ebaea1a4759bd068555d3cbf2b00ad6e530f48c3173a33af781b7307a0ec707" gracePeriod=45
Jul 12 08:53:56.085298 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.085271    2583 generic.go:356] "Generic (PLEG): container finished" podID="2a559eda-7084-4a90-b16e-5b76a0599e6d" containerID="2ebaea1a4759bd068555d3cbf2b00ad6e530f48c3173a33af781b7307a0ec707" exitCode=0
Jul 12 08:53:56.085418 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.085346    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t" event={"ID":"2a559eda-7084-4a90-b16e-5b76a0599e6d","Type":"ContainerDied","Data":"2ebaea1a4759bd068555d3cbf2b00ad6e530f48c3173a33af781b7307a0ec707"}
Jul 12 08:53:56.215467 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.215442    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:53:56.338296 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338216    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a559eda-7084-4a90-b16e-5b76a0599e6d-tls-certs\") pod \"2a559eda-7084-4a90-b16e-5b76a0599e6d\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") "
Jul 12 08:53:56.338296 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338249    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-home\") pod \"2a559eda-7084-4a90-b16e-5b76a0599e6d\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") "
Jul 12 08:53:56.338296 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338268    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfg5f\" (UniqueName: \"kubernetes.io/projected/2a559eda-7084-4a90-b16e-5b76a0599e6d-kube-api-access-rfg5f\") pod \"2a559eda-7084-4a90-b16e-5b76a0599e6d\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") "
Jul 12 08:53:56.338588 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338322    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-dshm\") pod \"2a559eda-7084-4a90-b16e-5b76a0599e6d\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") "
Jul 12 08:53:56.338588 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338357    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-model-cache\") pod \"2a559eda-7084-4a90-b16e-5b76a0599e6d\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") "
Jul 12 08:53:56.338588 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338393    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-tmp-dir\") pod \"2a559eda-7084-4a90-b16e-5b76a0599e6d\" (UID: \"2a559eda-7084-4a90-b16e-5b76a0599e6d\") "
Jul 12 08:53:56.338588 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338530    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-home" (OuterVolumeSpecName: "home") pod "2a559eda-7084-4a90-b16e-5b76a0599e6d" (UID: "2a559eda-7084-4a90-b16e-5b76a0599e6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:53:56.338778 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338632    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a559eda-7084-4a90-b16e-5b76a0599e6d" (UID: "2a559eda-7084-4a90-b16e-5b76a0599e6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:53:56.338778 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338668    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a559eda-7084-4a90-b16e-5b76a0599e6d" (UID: "2a559eda-7084-4a90-b16e-5b76a0599e6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:53:56.338883 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338833    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-model-cache\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:56.338929 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338881    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-tmp-dir\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:56.338929 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.338892    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-home\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:56.340613 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.340593    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a559eda-7084-4a90-b16e-5b76a0599e6d-kube-api-access-rfg5f" (OuterVolumeSpecName: "kube-api-access-rfg5f") pod "2a559eda-7084-4a90-b16e-5b76a0599e6d" (UID: "2a559eda-7084-4a90-b16e-5b76a0599e6d"). InnerVolumeSpecName "kube-api-access-rfg5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:53:56.340892 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.340866    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-dshm" (OuterVolumeSpecName: "dshm") pod "2a559eda-7084-4a90-b16e-5b76a0599e6d" (UID: "2a559eda-7084-4a90-b16e-5b76a0599e6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:53:56.340892 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.340866    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a559eda-7084-4a90-b16e-5b76a0599e6d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a559eda-7084-4a90-b16e-5b76a0599e6d" (UID: "2a559eda-7084-4a90-b16e-5b76a0599e6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:53:56.439673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.439634    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a559eda-7084-4a90-b16e-5b76a0599e6d-tls-certs\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:56.439673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.439663    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfg5f\" (UniqueName: \"kubernetes.io/projected/2a559eda-7084-4a90-b16e-5b76a0599e6d-kube-api-access-rfg5f\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:56.439673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.439672    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a559eda-7084-4a90-b16e-5b76a0599e6d-dshm\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:56.947897 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:56.947842    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b" podUID="bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" containerName="main" containerID="cri-o://653a9df74af280c911c141eacc1a176d8db09da9b43ac7e3ad4c71d6f9816b1e" gracePeriod=45
Jul 12 08:53:57.092522 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.092497    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"
Jul 12 08:53:57.092522 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.092501    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t" event={"ID":"2a559eda-7084-4a90-b16e-5b76a0599e6d","Type":"ContainerDied","Data":"8673ae41a78b3bdc006fef1cb908ab9c4aeadf109b02026e4ddfa636b965da2b"}
Jul 12 08:53:57.093066 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.092552    2583 scope.go:117] "RemoveContainer" containerID="2ebaea1a4759bd068555d3cbf2b00ad6e530f48c3173a33af781b7307a0ec707"
Jul 12 08:53:57.095321 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.095178    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" containerID="653a9df74af280c911c141eacc1a176d8db09da9b43ac7e3ad4c71d6f9816b1e" exitCode=0
Jul 12 08:53:57.095321 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.095280    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b" event={"ID":"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3","Type":"ContainerDied","Data":"653a9df74af280c911c141eacc1a176d8db09da9b43ac7e3ad4c71d6f9816b1e"}
Jul 12 08:53:57.111919 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.110697    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"]
Jul 12 08:53:57.117864 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.117826    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d8ca53/test-model-d8ca53-kserve-7f9656c9fc-88m8t"]
Jul 12 08:53:57.209571 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.209504    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:57.347467 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.347433    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tls-certs\") pod \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") "
Jul 12 08:53:57.347656 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.347495    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqmsp\" (UniqueName: \"kubernetes.io/projected/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-kube-api-access-qqmsp\") pod \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") "
Jul 12 08:53:57.347656 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.347515    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-home\") pod \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") "
Jul 12 08:53:57.347656 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.347568    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tmp-dir\") pod \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") "
Jul 12 08:53:57.347656 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.347596    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-dshm\") pod \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") "
Jul 12 08:53:57.347893 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.347670    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-model-cache\") pod \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\" (UID: \"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3\") "
Jul 12 08:53:57.347948 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.347884    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-home" (OuterVolumeSpecName: "home") pod "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" (UID: "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:53:57.347948 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.347895    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" (UID: "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:53:57.348093 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.348068    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" (UID: "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:53:57.348232 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.348134    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-home\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:57.348232 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.348156    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tmp-dir\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:57.349841 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.349811    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-dshm" (OuterVolumeSpecName: "dshm") pod "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" (UID: "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:53:57.349961 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.349872    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" (UID: "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:53:57.349961 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.349915    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-kube-api-access-qqmsp" (OuterVolumeSpecName: "kube-api-access-qqmsp") pod "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" (UID: "bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3"). InnerVolumeSpecName "kube-api-access-qqmsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:53:57.449294 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.449258    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-model-cache\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:57.449294 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.449286    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-tls-certs\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:57.449294 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.449295    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqmsp\" (UniqueName: \"kubernetes.io/projected/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-kube-api-access-qqmsp\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:57.449294 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:57.449305    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3-dshm\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:53:58.102442 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:58.102414    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"
Jul 12 08:53:58.102889 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:58.102444    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b" event={"ID":"bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3","Type":"ContainerDied","Data":"72d8ebe70c2d62193e41b4db0de2d02eec4adb1e0d9b5d92359f455fd25a9a14"}
Jul 12 08:53:58.102889 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:58.102488    2583 scope.go:117] "RemoveContainer" containerID="653a9df74af280c911c141eacc1a176d8db09da9b43ac7e3ad4c71d6f9816b1e"
Jul 12 08:53:58.125883 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:58.125829    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"]
Jul 12 08:53:58.128009 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:58.127989    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b534df/test-model-b534df-kserve-69d49457b9-mnb2b"]
Jul 12 08:53:58.368514 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:58.368433    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a559eda-7084-4a90-b16e-5b76a0599e6d" path="/var/lib/kubelet/pods/2a559eda-7084-4a90-b16e-5b76a0599e6d/volumes"
Jul 12 08:53:58.368834 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:53:58.368817    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" path="/var/lib/kubelet/pods/bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3/volumes"
Jul 12 08:54:25.566618 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.566586    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"]
Jul 12 08:54:25.567168 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.566868    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk" podUID="0257b5b0-3ef6-4ef6-a338-bca21767b49e" containerName="maas-api" containerID="cri-o://14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48" gracePeriod=30
Jul 12 08:54:25.650386 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.650342    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk" podUID="0257b5b0-3ef6-4ef6-a338-bca21767b49e" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.47:8443/health\": dial tcp 10.133.0.47:8443: connect: connection refused"
Jul 12 08:54:25.818896 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.818820    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:54:25.896610 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.896570    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb4sf\" (UniqueName: \"kubernetes.io/projected/0257b5b0-3ef6-4ef6-a338-bca21767b49e-kube-api-access-zb4sf\") pod \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") "
Jul 12 08:54:25.896794 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.896665    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0257b5b0-3ef6-4ef6-a338-bca21767b49e-maas-api-tls\") pod \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") "
Jul 12 08:54:25.896794 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.896693    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0257b5b0-3ef6-4ef6-a338-bca21767b49e-openshift-service-ca\") pod \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\" (UID: \"0257b5b0-3ef6-4ef6-a338-bca21767b49e\") "
Jul 12 08:54:25.897100 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.897075    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0257b5b0-3ef6-4ef6-a338-bca21767b49e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0257b5b0-3ef6-4ef6-a338-bca21767b49e" (UID: "0257b5b0-3ef6-4ef6-a338-bca21767b49e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:54:25.898629 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.898604    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0257b5b0-3ef6-4ef6-a338-bca21767b49e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0257b5b0-3ef6-4ef6-a338-bca21767b49e" (UID: "0257b5b0-3ef6-4ef6-a338-bca21767b49e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:54:25.898722 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.898609    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0257b5b0-3ef6-4ef6-a338-bca21767b49e-kube-api-access-zb4sf" (OuterVolumeSpecName: "kube-api-access-zb4sf") pod "0257b5b0-3ef6-4ef6-a338-bca21767b49e" (UID: "0257b5b0-3ef6-4ef6-a338-bca21767b49e"). InnerVolumeSpecName "kube-api-access-zb4sf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:54:25.998060 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.998030    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb4sf\" (UniqueName: \"kubernetes.io/projected/0257b5b0-3ef6-4ef6-a338-bca21767b49e-kube-api-access-zb4sf\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:54:25.998060 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.998056    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0257b5b0-3ef6-4ef6-a338-bca21767b49e-maas-api-tls\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:54:25.998261 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:25.998067    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0257b5b0-3ef6-4ef6-a338-bca21767b49e-openshift-service-ca\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:54:26.254339 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:26.254303    2583 generic.go:356] "Generic (PLEG): container finished" podID="0257b5b0-3ef6-4ef6-a338-bca21767b49e" containerID="14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48" exitCode=0
Jul 12 08:54:26.254512 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:26.254360    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"
Jul 12 08:54:26.254512 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:26.254380    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk" event={"ID":"0257b5b0-3ef6-4ef6-a338-bca21767b49e","Type":"ContainerDied","Data":"14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48"}
Jul 12 08:54:26.254512 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:26.254450    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk" event={"ID":"0257b5b0-3ef6-4ef6-a338-bca21767b49e","Type":"ContainerDied","Data":"6ed42e34bd688c3eb57d7897890617901793de1e7727c04c3c9aabebd7ce32b9"}
Jul 12 08:54:26.254512 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:26.254473    2583 scope.go:117] "RemoveContainer" containerID="14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48"
Jul 12 08:54:26.264109 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:26.264090    2583 scope.go:117] "RemoveContainer" containerID="14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48"
Jul 12 08:54:26.264351 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:54:26.264335    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48\": container with ID starting with 14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48 not found: ID does not exist" containerID="14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48"
Jul 12 08:54:26.264400 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:26.264358    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48"} err="failed to get container status \"14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48\": rpc error: code = NotFound desc = could not find container \"14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48\": container with ID starting with 14faf8dc8ad34d812fbb91be0e74118a3d9d4e9862b33de2730693d40b9ecd48 not found: ID does not exist"
Jul 12 08:54:26.275488 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:26.275464    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"]
Jul 12 08:54:26.278784 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:26.278761    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b534df-56496557c6-qcnzk"]
Jul 12 08:54:26.368806 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:26.368772    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0257b5b0-3ef6-4ef6-a338-bca21767b49e" path="/var/lib/kubelet/pods/0257b5b0-3ef6-4ef6-a338-bca21767b49e/volumes"
Jul 12 08:54:34.708227 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708150    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"]
Jul 12 08:54:34.708670 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708518    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd4bbb9-4cc2-481e-bf91-2d392f790f7d" containerName="maas-api"
Jul 12 08:54:34.708670 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708530    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd4bbb9-4cc2-481e-bf91-2d392f790f7d" containerName="maas-api"
Jul 12 08:54:34.708670 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708558    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0257b5b0-3ef6-4ef6-a338-bca21767b49e" containerName="maas-api"
Jul 12 08:54:34.708670 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708590    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0257b5b0-3ef6-4ef6-a338-bca21767b49e" containerName="maas-api"
Jul 12 08:54:34.708670 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708604    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" containerName="main"
Jul 12 08:54:34.708670 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708609    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" containerName="main"
Jul 12 08:54:34.708670 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708619    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a559eda-7084-4a90-b16e-5b76a0599e6d" containerName="main"
Jul 12 08:54:34.708670 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708630    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a559eda-7084-4a90-b16e-5b76a0599e6d" containerName="main"
Jul 12 08:54:34.708963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708698    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb6cfd10-e6b5-49cf-bfb2-535bb5c1c1d3" containerName="main"
Jul 12 08:54:34.708963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708708    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0257b5b0-3ef6-4ef6-a338-bca21767b49e" containerName="maas-api"
Jul 12 08:54:34.708963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708717    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a559eda-7084-4a90-b16e-5b76a0599e6d" containerName="main"
Jul 12 08:54:34.708963 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.708724    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dd4bbb9-4cc2-481e-bf91-2d392f790f7d" containerName="maas-api"
Jul 12 08:54:34.713099 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.713077    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:34.715645 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.715620    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 08:54:34.715770 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.715669    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8ggw6\""
Jul 12 08:54:34.715770 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.715682    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 08:54:34.716716 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.716679    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-91c269-serving-cert\""
Jul 12 08:54:34.723071 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.723043    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"]
Jul 12 08:54:34.780486 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.780453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edfac023-6f9d-4be1-bb90-fffc71601e52-openshift-service-ca\") pod \"maas-api-e2e-api-a-91c269-559466f864-b9jxx\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:34.780675 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.780507    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edfac023-6f9d-4be1-bb90-fffc71601e52-maas-api-tls\") pod \"maas-api-e2e-api-a-91c269-559466f864-b9jxx\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:34.780675 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.780626    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxq28\" (UniqueName: \"kubernetes.io/projected/edfac023-6f9d-4be1-bb90-fffc71601e52-kube-api-access-kxq28\") pod \"maas-api-e2e-api-a-91c269-559466f864-b9jxx\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:34.882030 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.881992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxq28\" (UniqueName: \"kubernetes.io/projected/edfac023-6f9d-4be1-bb90-fffc71601e52-kube-api-access-kxq28\") pod \"maas-api-e2e-api-a-91c269-559466f864-b9jxx\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:34.882229 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.882088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edfac023-6f9d-4be1-bb90-fffc71601e52-openshift-service-ca\") pod \"maas-api-e2e-api-a-91c269-559466f864-b9jxx\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:34.882229 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.882122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edfac023-6f9d-4be1-bb90-fffc71601e52-maas-api-tls\") pod \"maas-api-e2e-api-a-91c269-559466f864-b9jxx\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:34.882788 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.882762    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edfac023-6f9d-4be1-bb90-fffc71601e52-openshift-service-ca\") pod \"maas-api-e2e-api-a-91c269-559466f864-b9jxx\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:34.884859 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.884818    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edfac023-6f9d-4be1-bb90-fffc71601e52-maas-api-tls\") pod \"maas-api-e2e-api-a-91c269-559466f864-b9jxx\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:34.889971 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:34.889946    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxq28\" (UniqueName: \"kubernetes.io/projected/edfac023-6f9d-4be1-bb90-fffc71601e52-kube-api-access-kxq28\") pod \"maas-api-e2e-api-a-91c269-559466f864-b9jxx\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:35.024763 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:35.024676    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:35.163498 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:35.163461    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"]
Jul 12 08:54:35.164929 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:54:35.164906    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedfac023_6f9d_4be1_bb90_fffc71601e52.slice/crio-480fa099e5fab86dcf825e1342949d03772dd83de38bbba0c1fad92ace2639b2 WatchSource:0}: Error finding container 480fa099e5fab86dcf825e1342949d03772dd83de38bbba0c1fad92ace2639b2: Status 404 returned error can't find the container with id 480fa099e5fab86dcf825e1342949d03772dd83de38bbba0c1fad92ace2639b2
Jul 12 08:54:35.304432 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:35.304343    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx" event={"ID":"edfac023-6f9d-4be1-bb90-fffc71601e52","Type":"ContainerStarted","Data":"480fa099e5fab86dcf825e1342949d03772dd83de38bbba0c1fad92ace2639b2"}
Jul 12 08:54:36.311985 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:36.311952    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx" event={"ID":"edfac023-6f9d-4be1-bb90-fffc71601e52","Type":"ContainerStarted","Data":"c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3"}
Jul 12 08:54:36.312382 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:36.312017    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:36.327971 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:36.327909    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx" podStartSLOduration=1.903329963 podStartE2EDuration="2.327893924s" totalImagesPullingTime="424.563961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:54:36.327117618 +0000 UTC m=+1978.906576114" watchObservedRunningTime="2026-07-12 08:54:36.327893924 +0000 UTC m=+1978.907352401"
Jul 12 08:54:42.324046 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.324010    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:42.735426 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.735393    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"]
Jul 12 08:54:42.738925 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.738902    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:42.741341 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.741319    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ad9984-serving-cert\""
Jul 12 08:54:42.748607 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.748573    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"]
Jul 12 08:54:42.864478 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.864442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e35e87-1247-45a2-a1ed-0ecd763b4b38-openshift-service-ca\") pod \"maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:42.864478 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.864482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsv2j\" (UniqueName: \"kubernetes.io/projected/94e35e87-1247-45a2-a1ed-0ecd763b4b38-kube-api-access-lsv2j\") pod \"maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:42.864699 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.864637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94e35e87-1247-45a2-a1ed-0ecd763b4b38-maas-api-tls\") pod \"maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:42.966107 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.966063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e35e87-1247-45a2-a1ed-0ecd763b4b38-openshift-service-ca\") pod \"maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:42.966107 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.966109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsv2j\" (UniqueName: \"kubernetes.io/projected/94e35e87-1247-45a2-a1ed-0ecd763b4b38-kube-api-access-lsv2j\") pod \"maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:42.966332 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.966197    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94e35e87-1247-45a2-a1ed-0ecd763b4b38-maas-api-tls\") pod \"maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:42.966813 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.966793    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e35e87-1247-45a2-a1ed-0ecd763b4b38-openshift-service-ca\") pod \"maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:42.968589 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.968561    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94e35e87-1247-45a2-a1ed-0ecd763b4b38-maas-api-tls\") pod \"maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:42.977153 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:42.977133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsv2j\" (UniqueName: \"kubernetes.io/projected/94e35e87-1247-45a2-a1ed-0ecd763b4b38-kube-api-access-lsv2j\") pod \"maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:43.051146 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:43.051065    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:43.185992 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:43.185965    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"]
Jul 12 08:54:43.187657 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:54:43.187627    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e35e87_1247_45a2_a1ed_0ecd763b4b38.slice/crio-5b051399f531118a9dcb85a815a4479d06dbb229ba0226fd329aeae84a0ee50e WatchSource:0}: Error finding container 5b051399f531118a9dcb85a815a4479d06dbb229ba0226fd329aeae84a0ee50e: Status 404 returned error can't find the container with id 5b051399f531118a9dcb85a815a4479d06dbb229ba0226fd329aeae84a0ee50e
Jul 12 08:54:43.351232 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:43.351147    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5" event={"ID":"94e35e87-1247-45a2-a1ed-0ecd763b4b38","Type":"ContainerStarted","Data":"5b051399f531118a9dcb85a815a4479d06dbb229ba0226fd329aeae84a0ee50e"}
Jul 12 08:54:44.357906 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:44.357868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5" event={"ID":"94e35e87-1247-45a2-a1ed-0ecd763b4b38","Type":"ContainerStarted","Data":"37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d"}
Jul 12 08:54:44.358318 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:44.358002    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:44.374557 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:44.374512    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5" podStartSLOduration=2.064295066 podStartE2EDuration="2.37449745s" totalImagesPullingTime="310.202384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:54:44.372695103 +0000 UTC m=+1986.952153583" watchObservedRunningTime="2026-07-12 08:54:44.37449745 +0000 UTC m=+1986.953955929"
Jul 12 08:54:50.370271 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:50.370242    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:54:56.023175 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.023140    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"]
Jul 12 08:54:56.023578 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.023376    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx" podUID="edfac023-6f9d-4be1-bb90-fffc71601e52" containerName="maas-api" containerID="cri-o://c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3" gracePeriod=30
Jul 12 08:54:56.272352 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.272328    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:56.296747 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.296673    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edfac023-6f9d-4be1-bb90-fffc71601e52-openshift-service-ca\") pod \"edfac023-6f9d-4be1-bb90-fffc71601e52\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") "
Jul 12 08:54:56.296747 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.296721    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edfac023-6f9d-4be1-bb90-fffc71601e52-maas-api-tls\") pod \"edfac023-6f9d-4be1-bb90-fffc71601e52\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") "
Jul 12 08:54:56.296975 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.296796    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxq28\" (UniqueName: \"kubernetes.io/projected/edfac023-6f9d-4be1-bb90-fffc71601e52-kube-api-access-kxq28\") pod \"edfac023-6f9d-4be1-bb90-fffc71601e52\" (UID: \"edfac023-6f9d-4be1-bb90-fffc71601e52\") "
Jul 12 08:54:56.297039 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.296998    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edfac023-6f9d-4be1-bb90-fffc71601e52-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edfac023-6f9d-4be1-bb90-fffc71601e52" (UID: "edfac023-6f9d-4be1-bb90-fffc71601e52"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:54:56.298834 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.298806    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edfac023-6f9d-4be1-bb90-fffc71601e52-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edfac023-6f9d-4be1-bb90-fffc71601e52" (UID: "edfac023-6f9d-4be1-bb90-fffc71601e52"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:54:56.298834 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.298814    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edfac023-6f9d-4be1-bb90-fffc71601e52-kube-api-access-kxq28" (OuterVolumeSpecName: "kube-api-access-kxq28") pod "edfac023-6f9d-4be1-bb90-fffc71601e52" (UID: "edfac023-6f9d-4be1-bb90-fffc71601e52"). InnerVolumeSpecName "kube-api-access-kxq28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:54:56.398255 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.398222    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxq28\" (UniqueName: \"kubernetes.io/projected/edfac023-6f9d-4be1-bb90-fffc71601e52-kube-api-access-kxq28\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:54:56.398255 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.398258    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edfac023-6f9d-4be1-bb90-fffc71601e52-openshift-service-ca\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:54:56.398458 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.398274    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edfac023-6f9d-4be1-bb90-fffc71601e52-maas-api-tls\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:54:56.428392 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.428349    2583 generic.go:356] "Generic (PLEG): container finished" podID="edfac023-6f9d-4be1-bb90-fffc71601e52" containerID="c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3" exitCode=0
Jul 12 08:54:56.428392 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.428389    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"
Jul 12 08:54:56.428590 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.428432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx" event={"ID":"edfac023-6f9d-4be1-bb90-fffc71601e52","Type":"ContainerDied","Data":"c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3"}
Jul 12 08:54:56.428590 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.428486    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx" event={"ID":"edfac023-6f9d-4be1-bb90-fffc71601e52","Type":"ContainerDied","Data":"480fa099e5fab86dcf825e1342949d03772dd83de38bbba0c1fad92ace2639b2"}
Jul 12 08:54:56.428590 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.428514    2583 scope.go:117] "RemoveContainer" containerID="c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3"
Jul 12 08:54:56.437297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.437279    2583 scope.go:117] "RemoveContainer" containerID="c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3"
Jul 12 08:54:56.437571 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:54:56.437545    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3\": container with ID starting with c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3 not found: ID does not exist" containerID="c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3"
Jul 12 08:54:56.437631 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.437573    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3"} err="failed to get container status \"c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3\": rpc error: code = NotFound desc = could not find container \"c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3\": container with ID starting with c347c75f367c01de2873fc727837b0bd95fd3d9850be223a14d2d4777dbd99e3 not found: ID does not exist"
Jul 12 08:54:56.445066 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.445040    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"]
Jul 12 08:54:56.448747 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:56.448725    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-91c269-559466f864-b9jxx"]
Jul 12 08:54:58.368379 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:54:58.368343    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edfac023-6f9d-4be1-bb90-fffc71601e52" path="/var/lib/kubelet/pods/edfac023-6f9d-4be1-bb90-fffc71601e52/volumes"
Jul 12 08:55:02.709041 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:02.709004    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"]
Jul 12 08:55:02.709824 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:02.709770    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5" podUID="94e35e87-1247-45a2-a1ed-0ecd763b4b38" containerName="maas-api" containerID="cri-o://37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d" gracePeriod=30
Jul 12 08:55:02.960427 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:02.960367    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:55:03.060498 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.060471    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e35e87-1247-45a2-a1ed-0ecd763b4b38-openshift-service-ca\") pod \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") "
Jul 12 08:55:03.060679 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.060666    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94e35e87-1247-45a2-a1ed-0ecd763b4b38-maas-api-tls\") pod \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") "
Jul 12 08:55:03.060721 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.060708    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsv2j\" (UniqueName: \"kubernetes.io/projected/94e35e87-1247-45a2-a1ed-0ecd763b4b38-kube-api-access-lsv2j\") pod \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\" (UID: \"94e35e87-1247-45a2-a1ed-0ecd763b4b38\") "
Jul 12 08:55:03.060867 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.060826    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94e35e87-1247-45a2-a1ed-0ecd763b4b38-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94e35e87-1247-45a2-a1ed-0ecd763b4b38" (UID: "94e35e87-1247-45a2-a1ed-0ecd763b4b38"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:55:03.060945 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.060933    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e35e87-1247-45a2-a1ed-0ecd763b4b38-openshift-service-ca\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:55:03.062797 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.062767    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94e35e87-1247-45a2-a1ed-0ecd763b4b38-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94e35e87-1247-45a2-a1ed-0ecd763b4b38" (UID: "94e35e87-1247-45a2-a1ed-0ecd763b4b38"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:55:03.062952 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.062822    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e35e87-1247-45a2-a1ed-0ecd763b4b38-kube-api-access-lsv2j" (OuterVolumeSpecName: "kube-api-access-lsv2j") pod "94e35e87-1247-45a2-a1ed-0ecd763b4b38" (UID: "94e35e87-1247-45a2-a1ed-0ecd763b4b38"). InnerVolumeSpecName "kube-api-access-lsv2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:55:03.161508 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.161476    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsv2j\" (UniqueName: \"kubernetes.io/projected/94e35e87-1247-45a2-a1ed-0ecd763b4b38-kube-api-access-lsv2j\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:55:03.161508 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.161504    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94e35e87-1247-45a2-a1ed-0ecd763b4b38-maas-api-tls\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:55:03.465826 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.465794    2583 generic.go:356] "Generic (PLEG): container finished" podID="94e35e87-1247-45a2-a1ed-0ecd763b4b38" containerID="37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d" exitCode=0
Jul 12 08:55:03.466049 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.465836    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"
Jul 12 08:55:03.466049 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.465885    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5" event={"ID":"94e35e87-1247-45a2-a1ed-0ecd763b4b38","Type":"ContainerDied","Data":"37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d"}
Jul 12 08:55:03.466049 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.465942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5" event={"ID":"94e35e87-1247-45a2-a1ed-0ecd763b4b38","Type":"ContainerDied","Data":"5b051399f531118a9dcb85a815a4479d06dbb229ba0226fd329aeae84a0ee50e"}
Jul 12 08:55:03.466049 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.465972    2583 scope.go:117] "RemoveContainer" containerID="37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d"
Jul 12 08:55:03.475393 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.475375    2583 scope.go:117] "RemoveContainer" containerID="37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d"
Jul 12 08:55:03.475628 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:55:03.475612    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d\": container with ID starting with 37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d not found: ID does not exist" containerID="37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d"
Jul 12 08:55:03.475673 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.475635    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d"} err="failed to get container status \"37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d\": rpc error: code = NotFound desc = could not find container \"37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d\": container with ID starting with 37126881e20c682b4ed9974794da0b710b29b8d36795d9275a9cb7571b8bdd7d not found: ID does not exist"
Jul 12 08:55:03.486595 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.486572    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"]
Jul 12 08:55:03.490095 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:03.490070    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad9984-67d55dbdc4-5tkg5"]
Jul 12 08:55:04.368696 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:04.368663    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94e35e87-1247-45a2-a1ed-0ecd763b4b38" path="/var/lib/kubelet/pods/94e35e87-1247-45a2-a1ed-0ecd763b4b38/volumes"
Jul 12 08:55:11.928297 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.928261    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"]
Jul 12 08:55:11.928870 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.928833    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94e35e87-1247-45a2-a1ed-0ecd763b4b38" containerName="maas-api"
Jul 12 08:55:11.928870 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.928866    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e35e87-1247-45a2-a1ed-0ecd763b4b38" containerName="maas-api"
Jul 12 08:55:11.928956 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.928907    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edfac023-6f9d-4be1-bb90-fffc71601e52" containerName="maas-api"
Jul 12 08:55:11.928956 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.928914    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="edfac023-6f9d-4be1-bb90-fffc71601e52" containerName="maas-api"
Jul 12 08:55:11.929026 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.928989    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="edfac023-6f9d-4be1-bb90-fffc71601e52" containerName="maas-api"
Jul 12 08:55:11.929026 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.929005    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="94e35e87-1247-45a2-a1ed-0ecd763b4b38" containerName="maas-api"
Jul 12 08:55:11.932182 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.932162    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:11.934949 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.934927    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 08:55:11.935047 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.934930    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8ggw6\""
Jul 12 08:55:11.935898 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.935881    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a67649-serving-cert\""
Jul 12 08:55:11.935994 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.935960    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 08:55:11.945726 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:11.945706    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"]
Jul 12 08:55:12.046191 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:12.046157    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:12.046369 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:12.046197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7384992c-4ce4-4c88-a8c0-b887bc47f575-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:12.046369 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:12.046288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m45dn\" (UniqueName: \"kubernetes.io/projected/7384992c-4ce4-4c88-a8c0-b887bc47f575-kube-api-access-m45dn\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:12.147517 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:12.147485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:12.147517 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:12.147520    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7384992c-4ce4-4c88-a8c0-b887bc47f575-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:12.147727 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:12.147565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m45dn\" (UniqueName: \"kubernetes.io/projected/7384992c-4ce4-4c88-a8c0-b887bc47f575-kube-api-access-m45dn\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:12.147727 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:55:12.147627    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-serving-cert: secret "maas-api-e2e-shared-a-a67649-serving-cert" not found
Jul 12 08:55:12.147727 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:55:12.147702    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls podName:7384992c-4ce4-4c88-a8c0-b887bc47f575 nodeName:}" failed. No retries permitted until 2026-07-12 08:55:12.64768524 +0000 UTC m=+2015.227143696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls") pod "maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm" (UID: "7384992c-4ce4-4c88-a8c0-b887bc47f575") : secret "maas-api-e2e-shared-a-a67649-serving-cert" not found
Jul 12 08:55:12.148312 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:12.148293    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7384992c-4ce4-4c88-a8c0-b887bc47f575-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:12.159842 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:12.159810    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m45dn\" (UniqueName: \"kubernetes.io/projected/7384992c-4ce4-4c88-a8c0-b887bc47f575-kube-api-access-m45dn\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:12.652586 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:12.652543    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:12.652784 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:55:12.652695    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-serving-cert: secret "maas-api-e2e-shared-a-a67649-serving-cert" not found
Jul 12 08:55:12.652784 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:55:12.652769    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls podName:7384992c-4ce4-4c88-a8c0-b887bc47f575 nodeName:}" failed. No retries permitted until 2026-07-12 08:55:13.652753663 +0000 UTC m=+2016.232212124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls") pod "maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm" (UID: "7384992c-4ce4-4c88-a8c0-b887bc47f575") : secret "maas-api-e2e-shared-a-a67649-serving-cert" not found
Jul 12 08:55:13.662136 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:13.662098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:13.664628 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:13.664602    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls\") pod \"maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:13.742039 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:13.742001    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:13.872228 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:13.872204    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"]
Jul 12 08:55:13.874284 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:55:13.874245    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7384992c_4ce4_4c88_a8c0_b887bc47f575.slice/crio-4ec25d1fcc58ad481fa62a95c5dedd2d37cca85eba9454437c3eb9e10b4593a3 WatchSource:0}: Error finding container 4ec25d1fcc58ad481fa62a95c5dedd2d37cca85eba9454437c3eb9e10b4593a3: Status 404 returned error can't find the container with id 4ec25d1fcc58ad481fa62a95c5dedd2d37cca85eba9454437c3eb9e10b4593a3
Jul 12 08:55:13.875627 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:13.875610    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:55:14.529752 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:14.529656    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm" event={"ID":"7384992c-4ce4-4c88-a8c0-b887bc47f575","Type":"ContainerStarted","Data":"bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240"}
Jul 12 08:55:14.529752 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:14.529715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm" event={"ID":"7384992c-4ce4-4c88-a8c0-b887bc47f575","Type":"ContainerStarted","Data":"4ec25d1fcc58ad481fa62a95c5dedd2d37cca85eba9454437c3eb9e10b4593a3"}
Jul 12 08:55:14.529752 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:14.529736    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:14.546087 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:14.546038    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm" podStartSLOduration=3.149597924 podStartE2EDuration="3.546023274s" totalImagesPullingTime="396.42535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:55:14.544086148 +0000 UTC m=+2017.123544626" watchObservedRunningTime="2026-07-12 08:55:14.546023274 +0000 UTC m=+2017.125481752"
Jul 12 08:55:20.060096 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.060061    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"]
Jul 12 08:55:20.064180 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.064153    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.068520 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.068493    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-a7f934-serving-cert\""
Jul 12 08:55:20.078047 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.078013    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"]
Jul 12 08:55:20.229443 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.229403    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8642d94-435d-40bb-b18b-7e81d7d0592f-maas-api-tls\") pod \"maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.229653 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.229488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxd2x\" (UniqueName: \"kubernetes.io/projected/c8642d94-435d-40bb-b18b-7e81d7d0592f-kube-api-access-cxd2x\") pod \"maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.229653 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.229517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8642d94-435d-40bb-b18b-7e81d7d0592f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.331206 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.331109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxd2x\" (UniqueName: \"kubernetes.io/projected/c8642d94-435d-40bb-b18b-7e81d7d0592f-kube-api-access-cxd2x\") pod \"maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.331206 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.331154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8642d94-435d-40bb-b18b-7e81d7d0592f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.331402 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.331233    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8642d94-435d-40bb-b18b-7e81d7d0592f-maas-api-tls\") pod \"maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.332017 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.331990    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8642d94-435d-40bb-b18b-7e81d7d0592f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.333872 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.333838    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8642d94-435d-40bb-b18b-7e81d7d0592f-maas-api-tls\") pod \"maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.338661 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.338640    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxd2x\" (UniqueName: \"kubernetes.io/projected/c8642d94-435d-40bb-b18b-7e81d7d0592f-kube-api-access-cxd2x\") pod \"maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.376059 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.376027    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:20.520979 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.520950    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"]
Jul 12 08:55:20.522335 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:55:20.522308    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8642d94_435d_40bb_b18b_7e81d7d0592f.slice/crio-8196835556c897adf555e9e60f982fe56b7b8f0b007fe95220ee7dc5f8f400f9 WatchSource:0}: Error finding container 8196835556c897adf555e9e60f982fe56b7b8f0b007fe95220ee7dc5f8f400f9: Status 404 returned error can't find the container with id 8196835556c897adf555e9e60f982fe56b7b8f0b007fe95220ee7dc5f8f400f9
Jul 12 08:55:20.540205 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.540180    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:55:20.562542 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:20.562511    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q" event={"ID":"c8642d94-435d-40bb-b18b-7e81d7d0592f","Type":"ContainerStarted","Data":"8196835556c897adf555e9e60f982fe56b7b8f0b007fe95220ee7dc5f8f400f9"}
Jul 12 08:55:21.569781 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:21.569738    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q" event={"ID":"c8642d94-435d-40bb-b18b-7e81d7d0592f","Type":"ContainerStarted","Data":"6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74"}
Jul 12 08:55:21.570251 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:21.569868    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:55:21.587698 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:21.587647    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q" podStartSLOduration=1.094223609 podStartE2EDuration="1.587629252s" totalImagesPullingTime="493.405643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:55:21.585087635 +0000 UTC m=+2024.164546111" watchObservedRunningTime="2026-07-12 08:55:21.587629252 +0000 UTC m=+2024.167087730"
Jul 12 08:55:27.583443 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:55:27.583410    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:56:37.968058 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:56:37.968009    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:56:37.975725 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:56:37.975702    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:58:30.183431 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.183396    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"]
Jul 12 08:58:30.185812 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.183626    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm" podUID="7384992c-4ce4-4c88-a8c0-b887bc47f575" containerName="maas-api" containerID="cri-o://bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240" gracePeriod=30
Jul 12 08:58:30.441669 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.441609    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:58:30.537648 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.537616    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls\") pod \"7384992c-4ce4-4c88-a8c0-b887bc47f575\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") "
Jul 12 08:58:30.537830 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.537669    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7384992c-4ce4-4c88-a8c0-b887bc47f575-openshift-service-ca\") pod \"7384992c-4ce4-4c88-a8c0-b887bc47f575\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") "
Jul 12 08:58:30.537830 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.537742    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m45dn\" (UniqueName: \"kubernetes.io/projected/7384992c-4ce4-4c88-a8c0-b887bc47f575-kube-api-access-m45dn\") pod \"7384992c-4ce4-4c88-a8c0-b887bc47f575\" (UID: \"7384992c-4ce4-4c88-a8c0-b887bc47f575\") "
Jul 12 08:58:30.538141 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.538119    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7384992c-4ce4-4c88-a8c0-b887bc47f575-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7384992c-4ce4-4c88-a8c0-b887bc47f575" (UID: "7384992c-4ce4-4c88-a8c0-b887bc47f575"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:58:30.539801 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.539775    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7384992c-4ce4-4c88-a8c0-b887bc47f575-kube-api-access-m45dn" (OuterVolumeSpecName: "kube-api-access-m45dn") pod "7384992c-4ce4-4c88-a8c0-b887bc47f575" (UID: "7384992c-4ce4-4c88-a8c0-b887bc47f575"). InnerVolumeSpecName "kube-api-access-m45dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:58:30.539949 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.539892    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7384992c-4ce4-4c88-a8c0-b887bc47f575" (UID: "7384992c-4ce4-4c88-a8c0-b887bc47f575"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:58:30.579344 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.579309    2583 generic.go:356] "Generic (PLEG): container finished" podID="7384992c-4ce4-4c88-a8c0-b887bc47f575" containerID="bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240" exitCode=0
Jul 12 08:58:30.579507 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.579357    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"
Jul 12 08:58:30.579507 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.579396    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm" event={"ID":"7384992c-4ce4-4c88-a8c0-b887bc47f575","Type":"ContainerDied","Data":"bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240"}
Jul 12 08:58:30.579507 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.579446    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm" event={"ID":"7384992c-4ce4-4c88-a8c0-b887bc47f575","Type":"ContainerDied","Data":"4ec25d1fcc58ad481fa62a95c5dedd2d37cca85eba9454437c3eb9e10b4593a3"}
Jul 12 08:58:30.579507 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.579469    2583 scope.go:117] "RemoveContainer" containerID="bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240"
Jul 12 08:58:30.593750 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.593731    2583 scope.go:117] "RemoveContainer" containerID="bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240"
Jul 12 08:58:30.594070 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:58:30.594048    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240\": container with ID starting with bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240 not found: ID does not exist" containerID="bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240"
Jul 12 08:58:30.594142 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.594080    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240"} err="failed to get container status \"bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240\": rpc error: code = NotFound desc = could not find container \"bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240\": container with ID starting with bc2ccf16cdaa1d305cc635f5530ea1aeb9bc5dddf9ba374d0878ed42720d2240 not found: ID does not exist"
Jul 12 08:58:30.605823 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.605798    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"]
Jul 12 08:58:30.611765 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.611741    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a67649-5cb7c778c4-rmsfm"]
Jul 12 08:58:30.638887 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.638830    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m45dn\" (UniqueName: \"kubernetes.io/projected/7384992c-4ce4-4c88-a8c0-b887bc47f575-kube-api-access-m45dn\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:58:30.638887 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.638883    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7384992c-4ce4-4c88-a8c0-b887bc47f575-maas-api-tls\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:58:30.638887 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:30.638895    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7384992c-4ce4-4c88-a8c0-b887bc47f575-openshift-service-ca\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:58:32.368348 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:32.368314    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7384992c-4ce4-4c88-a8c0-b887bc47f575" path="/var/lib/kubelet/pods/7384992c-4ce4-4c88-a8c0-b887bc47f575/volumes"
Jul 12 08:58:37.227642 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.227606    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"]
Jul 12 08:58:37.228121 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.227872    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q" podUID="c8642d94-435d-40bb-b18b-7e81d7d0592f" containerName="maas-api" containerID="cri-o://6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74" gracePeriod=30
Jul 12 08:58:37.480498 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.480438    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:58:37.604249 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.604214    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8642d94-435d-40bb-b18b-7e81d7d0592f-maas-api-tls\") pod \"c8642d94-435d-40bb-b18b-7e81d7d0592f\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") "
Jul 12 08:58:37.604438 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.604280    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8642d94-435d-40bb-b18b-7e81d7d0592f-openshift-service-ca\") pod \"c8642d94-435d-40bb-b18b-7e81d7d0592f\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") "
Jul 12 08:58:37.604513 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.604435    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxd2x\" (UniqueName: \"kubernetes.io/projected/c8642d94-435d-40bb-b18b-7e81d7d0592f-kube-api-access-cxd2x\") pod \"c8642d94-435d-40bb-b18b-7e81d7d0592f\" (UID: \"c8642d94-435d-40bb-b18b-7e81d7d0592f\") "
Jul 12 08:58:37.604687 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.604663    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8642d94-435d-40bb-b18b-7e81d7d0592f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8642d94-435d-40bb-b18b-7e81d7d0592f" (UID: "c8642d94-435d-40bb-b18b-7e81d7d0592f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:58:37.606419 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.606387    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8642d94-435d-40bb-b18b-7e81d7d0592f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8642d94-435d-40bb-b18b-7e81d7d0592f" (UID: "c8642d94-435d-40bb-b18b-7e81d7d0592f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:58:37.606521 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.606426    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8642d94-435d-40bb-b18b-7e81d7d0592f-kube-api-access-cxd2x" (OuterVolumeSpecName: "kube-api-access-cxd2x") pod "c8642d94-435d-40bb-b18b-7e81d7d0592f" (UID: "c8642d94-435d-40bb-b18b-7e81d7d0592f"). InnerVolumeSpecName "kube-api-access-cxd2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:58:37.616321 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.616290    2583 generic.go:356] "Generic (PLEG): container finished" podID="c8642d94-435d-40bb-b18b-7e81d7d0592f" containerID="6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74" exitCode=0
Jul 12 08:58:37.616438 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.616326    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"
Jul 12 08:58:37.616438 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.616361    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q" event={"ID":"c8642d94-435d-40bb-b18b-7e81d7d0592f","Type":"ContainerDied","Data":"6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74"}
Jul 12 08:58:37.616438 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.616414    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q" event={"ID":"c8642d94-435d-40bb-b18b-7e81d7d0592f","Type":"ContainerDied","Data":"8196835556c897adf555e9e60f982fe56b7b8f0b007fe95220ee7dc5f8f400f9"}
Jul 12 08:58:37.616438 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.616438    2583 scope.go:117] "RemoveContainer" containerID="6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74"
Jul 12 08:58:37.625172 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.625151    2583 scope.go:117] "RemoveContainer" containerID="6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74"
Jul 12 08:58:37.625455 ip-10-0-136-78 kubenswrapper[2583]: E0712 08:58:37.625434    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74\": container with ID starting with 6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74 not found: ID does not exist" containerID="6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74"
Jul 12 08:58:37.625517 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.625464    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74"} err="failed to get container status \"6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74\": rpc error: code = NotFound desc = could not find container \"6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74\": container with ID starting with 6f71c8056335b93af26b76ece0c81d89ad42686f7e761355e1b40a38dd2c3e74 not found: ID does not exist"
Jul 12 08:58:37.642298 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.642272    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"]
Jul 12 08:58:37.646731 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.646711    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7f934-cc77f679d-vjn8q"]
Jul 12 08:58:37.705336 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.705303    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8642d94-435d-40bb-b18b-7e81d7d0592f-openshift-service-ca\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:58:37.705336 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.705330    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxd2x\" (UniqueName: \"kubernetes.io/projected/c8642d94-435d-40bb-b18b-7e81d7d0592f-kube-api-access-cxd2x\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:58:37.705336 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:37.705340    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8642d94-435d-40bb-b18b-7e81d7d0592f-maas-api-tls\") on node \"ip-10-0-136-78.ec2.internal\" DevicePath \"\""
Jul 12 08:58:38.368990 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:38.368918    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8642d94-435d-40bb-b18b-7e81d7d0592f" path="/var/lib/kubelet/pods/c8642d94-435d-40bb-b18b-7e81d7d0592f/volumes"
Jul 12 08:58:48.730091 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:48.730058    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lj8sf_69623788-1986-4f09-8807-43bc0312834c/server/0.log"
Jul 12 08:58:48.839534 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:48.839501    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7jclt_da53cd6a-2463-4d8d-81af-de3ba90e3429/manager/0.log"
Jul 12 08:58:48.950988 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:48.950961    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg_134d816b-7600-46e7-8147-61a0a3158773/copy-manifests/0.log"
Jul 12 08:58:48.962965 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:48.962937    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg_134d816b-7600-46e7-8147-61a0a3158773/manager/0.log"
Jul 12 08:58:49.989768 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:49.989742    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m_74c678bc-6d58-48eb-9c4b-2eca0f641b50/util/0.log"
Jul 12 08:58:49.997048 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:49.997030    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m_74c678bc-6d58-48eb-9c4b-2eca0f641b50/pull/0.log"
Jul 12 08:58:50.003552 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.003534    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m_74c678bc-6d58-48eb-9c4b-2eca0f641b50/extract/0.log"
Jul 12 08:58:50.122402 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.122374    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv_d4105692-14fa-4466-b30a-db52e34654a9/util/0.log"
Jul 12 08:58:50.128973 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.128951    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv_d4105692-14fa-4466-b30a-db52e34654a9/pull/0.log"
Jul 12 08:58:50.135225 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.135205    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv_d4105692-14fa-4466-b30a-db52e34654a9/extract/0.log"
Jul 12 08:58:50.243103 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.243031    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx_0074a57f-2c71-4aef-8df9-d02b7a8b1c34/util/0.log"
Jul 12 08:58:50.250053 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.250033    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx_0074a57f-2c71-4aef-8df9-d02b7a8b1c34/pull/0.log"
Jul 12 08:58:50.256313 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.256293    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx_0074a57f-2c71-4aef-8df9-d02b7a8b1c34/extract/0.log"
Jul 12 08:58:50.370119 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.370097    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4_6abd4595-3811-4b99-be53-b8fe3cedc6d4/util/0.log"
Jul 12 08:58:50.375822 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.375802    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4_6abd4595-3811-4b99-be53-b8fe3cedc6d4/pull/0.log"
Jul 12 08:58:50.381626 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.381608    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4_6abd4595-3811-4b99-be53-b8fe3cedc6d4/extract/0.log"
Jul 12 08:58:50.828859 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:50.828831    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s7xrb_cd088a8d-c49c-4ae7-b011-ebebdf028adb/kuadrant-console-plugin/0.log"
Jul 12 08:58:51.646214 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:51.646188    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zgrqh_06f2ff14-cdef-424d-80fc-1f4e8126676f/istio-proxy/0.log"
Jul 12 08:58:51.999721 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:51.999695    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c9f9759d-vvdwl_66ba9701-0ebc-4cb3-bca2-32e4eb04f026/kube-auth-proxy/0.log"
Jul 12 08:58:52.115574 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:52.115547    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ghbrs_f80e31c7-2d11-458a-93b7-9ee689eb5c00/istio-proxy/1.log"
Jul 12 08:58:52.804275 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:52.804240    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-58d8v_4bf25407-20ec-49ef-8fe3-393c6e9877c6/main/0.log"
Jul 12 08:58:53.144004 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:53.143924    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtfd2x_b226c998-1061-418a-bd6b-6298acb65021/main/0.log"
Jul 12 08:58:53.359946 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:53.359919    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-s7kwd_92e7816b-6a31-403c-a556-57616e12eb98/main/0.log"
Jul 12 08:58:57.441120 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.441081    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zjv2n/must-gather-fvkf2"]
Jul 12 08:58:57.441523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.441470    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7384992c-4ce4-4c88-a8c0-b887bc47f575" containerName="maas-api"
Jul 12 08:58:57.441523 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.441503    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7384992c-4ce4-4c88-a8c0-b887bc47f575" containerName="maas-api"
Jul 12 08:58:57.441652 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.441536    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8642d94-435d-40bb-b18b-7e81d7d0592f" containerName="maas-api"
Jul 12 08:58:57.441652 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.441543    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8642d94-435d-40bb-b18b-7e81d7d0592f" containerName="maas-api"
Jul 12 08:58:57.441652 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.441634    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8642d94-435d-40bb-b18b-7e81d7d0592f" containerName="maas-api"
Jul 12 08:58:57.441652 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.441652    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7384992c-4ce4-4c88-a8c0-b887bc47f575" containerName="maas-api"
Jul 12 08:58:57.445097 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.445073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjv2n/must-gather-fvkf2"
Jul 12 08:58:57.447541 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.447521    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjv2n\"/\"openshift-service-ca.crt\""
Jul 12 08:58:57.448660 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.448642    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjv2n\"/\"kube-root-ca.crt\""
Jul 12 08:58:57.448751 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.448672    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zjv2n\"/\"default-dockercfg-rz8s7\""
Jul 12 08:58:57.452681 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.452469    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjv2n/must-gather-fvkf2"]
Jul 12 08:58:57.488102 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.488080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf7kw\" (UniqueName: \"kubernetes.io/projected/aa6a0fe8-817d-48fb-807a-c74125002742-kube-api-access-rf7kw\") pod \"must-gather-fvkf2\" (UID: \"aa6a0fe8-817d-48fb-807a-c74125002742\") " pod="openshift-must-gather-zjv2n/must-gather-fvkf2"
Jul 12 08:58:57.488223 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.488148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa6a0fe8-817d-48fb-807a-c74125002742-must-gather-output\") pod \"must-gather-fvkf2\" (UID: \"aa6a0fe8-817d-48fb-807a-c74125002742\") " pod="openshift-must-gather-zjv2n/must-gather-fvkf2"
Jul 12 08:58:57.589231 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.589198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf7kw\" (UniqueName: \"kubernetes.io/projected/aa6a0fe8-817d-48fb-807a-c74125002742-kube-api-access-rf7kw\") pod \"must-gather-fvkf2\" (UID: \"aa6a0fe8-817d-48fb-807a-c74125002742\") " pod="openshift-must-gather-zjv2n/must-gather-fvkf2"
Jul 12 08:58:57.589384 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.589283    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa6a0fe8-817d-48fb-807a-c74125002742-must-gather-output\") pod \"must-gather-fvkf2\" (UID: \"aa6a0fe8-817d-48fb-807a-c74125002742\") " pod="openshift-must-gather-zjv2n/must-gather-fvkf2"
Jul 12 08:58:57.589620 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.589603    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa6a0fe8-817d-48fb-807a-c74125002742-must-gather-output\") pod \"must-gather-fvkf2\" (UID: \"aa6a0fe8-817d-48fb-807a-c74125002742\") " pod="openshift-must-gather-zjv2n/must-gather-fvkf2"
Jul 12 08:58:57.596915 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.596896    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf7kw\" (UniqueName: \"kubernetes.io/projected/aa6a0fe8-817d-48fb-807a-c74125002742-kube-api-access-rf7kw\") pod \"must-gather-fvkf2\" (UID: \"aa6a0fe8-817d-48fb-807a-c74125002742\") " pod="openshift-must-gather-zjv2n/must-gather-fvkf2"
Jul 12 08:58:57.756100 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.756023    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjv2n/must-gather-fvkf2"
Jul 12 08:58:57.884741 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:57.884711    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjv2n/must-gather-fvkf2"]
Jul 12 08:58:57.886158 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:58:57.886133    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa6a0fe8_817d_48fb_807a_c74125002742.slice/crio-35f008d9b88092caedf153ba96858880be6e382be283123d0290854c67c93891 WatchSource:0}: Error finding container 35f008d9b88092caedf153ba96858880be6e382be283123d0290854c67c93891: Status 404 returned error can't find the container with id 35f008d9b88092caedf153ba96858880be6e382be283123d0290854c67c93891
Jul 12 08:58:58.724144 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:58.724105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjv2n/must-gather-fvkf2" event={"ID":"aa6a0fe8-817d-48fb-807a-c74125002742","Type":"ContainerStarted","Data":"35f008d9b88092caedf153ba96858880be6e382be283123d0290854c67c93891"}
Jul 12 08:58:59.731680 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:59.731634    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjv2n/must-gather-fvkf2" event={"ID":"aa6a0fe8-817d-48fb-807a-c74125002742","Type":"ContainerStarted","Data":"89d11df0fe98bbf84109608595051638393102e9a5bcd532c2dc55098a0a05ea"}
Jul 12 08:58:59.732188 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:59.731696    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjv2n/must-gather-fvkf2" event={"ID":"aa6a0fe8-817d-48fb-807a-c74125002742","Type":"ContainerStarted","Data":"80830a973fa6c9f744f90a8e5c839c171db9e283c8c02a9c3777cf7ba2cb5e20"}
Jul 12 08:58:59.749943 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:58:59.749881    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zjv2n/must-gather-fvkf2" podStartSLOduration=1.8413473420000002 podStartE2EDuration="2.749833348s" totalImagesPullingTime="908.486006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:58:59.747666796 +0000 UTC m=+2242.327125275" watchObservedRunningTime="2026-07-12 08:58:59.749833348 +0000 UTC m=+2242.329291829"
Jul 12 08:59:00.317132 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:00.317099    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jxwt9_0ee8bff8-4db5-4454-987b-3efcfffbddd1/global-pull-secret-syncer/0.log"
Jul 12 08:59:00.460375 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:00.460346    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kq8rb_8d9db5e4-204a-40f2-b622-15c6c10b3119/konnectivity-agent/0.log"
Jul 12 08:59:00.523312 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:00.523283    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-78.ec2.internal_87370b001b85040879f54a70444f0d05/haproxy/0.log"
Jul 12 08:59:04.907789 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:04.907760    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m_74c678bc-6d58-48eb-9c4b-2eca0f641b50/extract/0.log"
Jul 12 08:59:04.931336 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:04.931257    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m_74c678bc-6d58-48eb-9c4b-2eca0f641b50/util/0.log"
Jul 12 08:59:04.954035 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:04.953999    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d962m_74c678bc-6d58-48eb-9c4b-2eca0f641b50/pull/0.log"
Jul 12 08:59:04.997586 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:04.997554    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv_d4105692-14fa-4466-b30a-db52e34654a9/extract/0.log"
Jul 12 08:59:05.019501 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:05.019476    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv_d4105692-14fa-4466-b30a-db52e34654a9/util/0.log"
Jul 12 08:59:05.041047 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:05.041020    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dbv_d4105692-14fa-4466-b30a-db52e34654a9/pull/0.log"
Jul 12 08:59:05.069977 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:05.069943    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx_0074a57f-2c71-4aef-8df9-d02b7a8b1c34/extract/0.log"
Jul 12 08:59:05.093227 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:05.093201    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx_0074a57f-2c71-4aef-8df9-d02b7a8b1c34/util/0.log"
Jul 12 08:59:05.113154 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:05.113128    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltvbx_0074a57f-2c71-4aef-8df9-d02b7a8b1c34/pull/0.log"
Jul 12 08:59:05.137985 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:05.137924    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4_6abd4595-3811-4b99-be53-b8fe3cedc6d4/extract/0.log"
Jul 12 08:59:05.158654 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:05.158572    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4_6abd4595-3811-4b99-be53-b8fe3cedc6d4/util/0.log"
Jul 12 08:59:05.178640 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:05.178613    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1htpq4_6abd4595-3811-4b99-be53-b8fe3cedc6d4/pull/0.log"
Jul 12 08:59:05.516591 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:05.516499    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s7xrb_cd088a8d-c49c-4ae7-b011-ebebdf028adb/kuadrant-console-plugin/0.log"
Jul 12 08:59:07.678082 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:07.678047    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-89bjc_ef721109-271f-4004-9892-ce40a3723c14/kube-state-metrics/0.log"
Jul 12 08:59:07.697449 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:07.697378    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-89bjc_ef721109-271f-4004-9892-ce40a3723c14/kube-rbac-proxy-main/0.log"
Jul 12 08:59:07.720693 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:07.720659    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-89bjc_ef721109-271f-4004-9892-ce40a3723c14/kube-rbac-proxy-self/0.log"
Jul 12 08:59:07.744995 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:07.744938    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59c4c8ddcf-7mtsq_a94a97d2-c1a1-4cf0-9b10-12f9e50dcd8f/metrics-server/0.log"
Jul 12 08:59:07.805202 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:07.805173    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4spxs_58e09f08-d0ed-4f3e-ae2f-33890ddf223d/node-exporter/0.log"
Jul 12 08:59:07.827047 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:07.826978    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4spxs_58e09f08-d0ed-4f3e-ae2f-33890ddf223d/kube-rbac-proxy/0.log"
Jul 12 08:59:07.852591 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:07.852551    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4spxs_58e09f08-d0ed-4f3e-ae2f-33890ddf223d/init-textfile/0.log"
Jul 12 08:59:08.280937 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.280888    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-gqslb_741b9f63-c233-4752-94ba-f347961a892a/prometheus-operator/0.log"
Jul 12 08:59:08.302581 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.302528    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-gqslb_741b9f63-c233-4752-94ba-f347961a892a/kube-rbac-proxy/0.log"
Jul 12 08:59:08.358190 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.358083    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7978b4897d-jdqrx_6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c/telemeter-client/0.log"
Jul 12 08:59:08.383008 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.382981    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7978b4897d-jdqrx_6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c/reload/0.log"
Jul 12 08:59:08.404562 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.404520    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7978b4897d-jdqrx_6ea0e14c-ac31-4e37-b8cf-a635d9c39f3c/kube-rbac-proxy/0.log"
Jul 12 08:59:08.437101 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.437072    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c77f7985d-jwdlg_0da482da-fa8d-435d-9921-53cd61678c9d/thanos-query/0.log"
Jul 12 08:59:08.457020 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.456986    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c77f7985d-jwdlg_0da482da-fa8d-435d-9921-53cd61678c9d/kube-rbac-proxy-web/0.log"
Jul 12 08:59:08.477120 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.477093    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c77f7985d-jwdlg_0da482da-fa8d-435d-9921-53cd61678c9d/kube-rbac-proxy/0.log"
Jul 12 08:59:08.500090 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.500058    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c77f7985d-jwdlg_0da482da-fa8d-435d-9921-53cd61678c9d/prom-label-proxy/0.log"
Jul 12 08:59:08.522931 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.522902    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c77f7985d-jwdlg_0da482da-fa8d-435d-9921-53cd61678c9d/kube-rbac-proxy-rules/0.log"
Jul 12 08:59:08.546570 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:08.546464    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c77f7985d-jwdlg_0da482da-fa8d-435d-9921-53cd61678c9d/kube-rbac-proxy-metrics/0.log"
Jul 12 08:59:10.483357 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.483302    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"]
Jul 12 08:59:10.487290 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.487256    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.497161 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.497136    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"]
Jul 12 08:59:10.538376 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.538330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjp28\" (UniqueName: \"kubernetes.io/projected/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-kube-api-access-kjp28\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.538586 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.538392    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-lib-modules\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.538586 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.538424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-podres\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.538586 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.538564    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-sys\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.538743 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.538606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-proc\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.640387 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.639883    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-sys\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.640387 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.639949    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-proc\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.640387 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.639983    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp28\" (UniqueName: \"kubernetes.io/projected/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-kube-api-access-kjp28\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.640387 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.640019    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-lib-modules\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.640387 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.640048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-podres\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.640387 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.640046    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-sys\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.640387 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.640088    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-proc\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.640387 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.640221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-podres\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.640387 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.640325    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-lib-modules\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.648593 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.648539    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjp28\" (UniqueName: \"kubernetes.io/projected/f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b-kube-api-access-kjp28\") pod \"perf-node-gather-daemonset-krxfc\" (UID: \"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b\") " pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.801587 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.801506    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:10.885893 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.885775    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-844b84f5cb-dqrvm_ab86a721-cdd9-48ac-bd77-9ab46f95905f/console/0.log"
Jul 12 08:59:10.972749 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:10.972702    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"]
Jul 12 08:59:10.978036 ip-10-0-136-78 kubenswrapper[2583]: W0712 08:59:10.977992    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf2f1b0be_a3a4_4c23_8c1b_0a4b8eaded3b.slice/crio-b63f1ae310acf70da70dd65cb2df7b8121ea70ce1f2db5b24e8ea9c6772ab004 WatchSource:0}: Error finding container b63f1ae310acf70da70dd65cb2df7b8121ea70ce1f2db5b24e8ea9c6772ab004: Status 404 returned error can't find the container with id b63f1ae310acf70da70dd65cb2df7b8121ea70ce1f2db5b24e8ea9c6772ab004
Jul 12 08:59:11.853831 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:11.853784    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc" event={"ID":"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b","Type":"ContainerStarted","Data":"ec01b19adf1a3f262b8abbc43cbcc587ad3c73ded21866ec78e80c99f325b39d"}
Jul 12 08:59:11.854350 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:11.853918    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc" event={"ID":"f2f1b0be-a3a4-4c23-8c1b-0a4b8eaded3b","Type":"ContainerStarted","Data":"b63f1ae310acf70da70dd65cb2df7b8121ea70ce1f2db5b24e8ea9c6772ab004"}
Jul 12 08:59:11.876318 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:11.876250    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc" podStartSLOduration=1.8762282 podStartE2EDuration="1.8762282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:59:11.874226983 +0000 UTC m=+2254.453685463" watchObservedRunningTime="2026-07-12 08:59:11.8762282 +0000 UTC m=+2254.455686680"
Jul 12 08:59:12.564570 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:12.564541    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wg6wn_0c4e6ba3-2696-4312-a489-3e8f80c8759e/dns/0.log"
Jul 12 08:59:12.586016 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:12.585988    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wg6wn_0c4e6ba3-2696-4312-a489-3e8f80c8759e/kube-rbac-proxy/0.log"
Jul 12 08:59:12.608498 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:12.608463    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-frrv5_91f8d79a-5fb6-4aa9-9390-9ba97195452a/dns-node-resolver/0.log"
Jul 12 08:59:12.861450 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:12.861367    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:13.251377 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:13.251343    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wdt85_226a5392-db4a-451e-b2f3-180ccffb2a91/node-ca/0.log"
Jul 12 08:59:14.157947 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:14.157910    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zgrqh_06f2ff14-cdef-424d-80fc-1f4e8126676f/istio-proxy/0.log"
Jul 12 08:59:14.297559 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:14.297533    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c9f9759d-vvdwl_66ba9701-0ebc-4cb3-bca2-32e4eb04f026/kube-auth-proxy/0.log"
Jul 12 08:59:14.324357 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:14.324328    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ghbrs_f80e31c7-2d11-458a-93b7-9ee689eb5c00/istio-proxy/0.log"
Jul 12 08:59:14.360521 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:14.360488    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ghbrs_f80e31c7-2d11-458a-93b7-9ee689eb5c00/istio-proxy/1.log"
Jul 12 08:59:15.111203 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:15.111174    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4nqdp_ea3b4eee-35c1-44a6-a21e-2cd9378dc08b/serve-healthcheck-canary/0.log"
Jul 12 08:59:15.752035 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:15.751999    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zz8qc_97ba9557-ae0b-4311-a800-c8aacf79ce00/kube-rbac-proxy/0.log"
Jul 12 08:59:15.771398 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:15.771365    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zz8qc_97ba9557-ae0b-4311-a800-c8aacf79ce00/exporter/0.log"
Jul 12 08:59:15.791290 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:15.791266    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zz8qc_97ba9557-ae0b-4311-a800-c8aacf79ce00/extractor/0.log"
Jul 12 08:59:18.073981 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:18.073957    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lj8sf_69623788-1986-4f09-8807-43bc0312834c/server/0.log"
Jul 12 08:59:18.144128 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:18.144072    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7jclt_da53cd6a-2463-4d8d-81af-de3ba90e3429/manager/0.log"
Jul 12 08:59:18.224267 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:18.224231    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg_134d816b-7600-46e7-8147-61a0a3158773/manager/0.log"
Jul 12 08:59:18.239790 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:18.239758    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9c68b7-4pzdg_134d816b-7600-46e7-8147-61a0a3158773/copy-manifests/0.log"
Jul 12 08:59:18.877491 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:18.877459    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zjv2n/perf-node-gather-daemonset-krxfc"
Jul 12 08:59:19.427270 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:19.427238    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7cb89b9bb7-s6wm6_1a9a96bb-3978-4378-8c4a-7be77fbde70c/manager/0.log"
Jul 12 08:59:19.451650 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:19.451621    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-6lr45_c5829be0-d0c6-4204-a496-e46b4548e4bd/openshift-lws-operator/0.log"
Jul 12 08:59:20.916960 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:20.916925    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zgrqh_06f2ff14-cdef-424d-80fc-1f4e8126676f/istio-proxy/0.log"
Jul 12 08:59:21.029310 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:21.029283    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c9f9759d-vvdwl_66ba9701-0ebc-4cb3-bca2-32e4eb04f026/kube-auth-proxy/0.log"
Jul 12 08:59:21.049006 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:21.048963    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ghbrs_f80e31c7-2d11-458a-93b7-9ee689eb5c00/istio-proxy/0.log"
Jul 12 08:59:21.092774 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:21.092726    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ghbrs_f80e31c7-2d11-458a-93b7-9ee689eb5c00/istio-proxy/1.log"
Jul 12 08:59:22.460921 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:22.460887    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zgrqh_06f2ff14-cdef-424d-80fc-1f4e8126676f/istio-proxy/0.log"
Jul 12 08:59:22.586776 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:22.586751    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c9f9759d-vvdwl_66ba9701-0ebc-4cb3-bca2-32e4eb04f026/kube-auth-proxy/0.log"
Jul 12 08:59:22.611676 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:22.611646    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ghbrs_f80e31c7-2d11-458a-93b7-9ee689eb5c00/istio-proxy/0.log"
Jul 12 08:59:22.650526 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:22.650499    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ghbrs_f80e31c7-2d11-458a-93b7-9ee689eb5c00/istio-proxy/1.log"
Jul 12 08:59:26.143784 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:26.143755    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nd2bw_1d2ca934-d6db-4d0a-84ef-239138d1e139/kube-multus-additional-cni-plugins/0.log"
Jul 12 08:59:26.165495 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:26.165466    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nd2bw_1d2ca934-d6db-4d0a-84ef-239138d1e139/egress-router-binary-copy/0.log"
Jul 12 08:59:26.187224 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:26.187197    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nd2bw_1d2ca934-d6db-4d0a-84ef-239138d1e139/cni-plugins/0.log"
Jul 12 08:59:26.206416 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:26.206386    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nd2bw_1d2ca934-d6db-4d0a-84ef-239138d1e139/bond-cni-plugin/0.log"
Jul 12 08:59:26.226941 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:26.226912    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nd2bw_1d2ca934-d6db-4d0a-84ef-239138d1e139/routeoverride-cni/0.log"
Jul 12 08:59:26.247960 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:26.247928    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nd2bw_1d2ca934-d6db-4d0a-84ef-239138d1e139/whereabouts-cni-bincopy/0.log"
Jul 12 08:59:26.267599 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:26.267569    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nd2bw_1d2ca934-d6db-4d0a-84ef-239138d1e139/whereabouts-cni/0.log"
Jul 12 08:59:26.693494 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:26.693463    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lbm6t_da0503a0-bb72-4d84-91c1-bd05920452f2/kube-multus/0.log"
Jul 12 08:59:26.768748 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:26.768717    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2j6ld_b85eed6f-96aa-48c8-90dd-f1c621b10bec/network-metrics-daemon/0.log"
Jul 12 08:59:26.790028 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:26.790002    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2j6ld_b85eed6f-96aa-48c8-90dd-f1c621b10bec/kube-rbac-proxy/0.log"
Jul 12 08:59:28.064591 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:28.064550    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-controller/0.log"
Jul 12 08:59:28.080894 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:28.080837    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/1.log"
Jul 12 08:59:28.081082 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:28.080925    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovn-acl-logging/0.log"
Jul 12 08:59:28.097905 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:28.097874    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/kube-rbac-proxy-node/0.log"
Jul 12 08:59:28.117866 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:28.117817    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/kube-rbac-proxy-ovn-metrics/0.log"
Jul 12 08:59:28.136338 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:28.136310    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/northd/0.log"
Jul 12 08:59:28.154672 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:28.154649    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/nbdb/0.log"
Jul 12 08:59:28.172984 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:28.172957    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/sbdb/0.log"
Jul 12 08:59:28.225518 ip-10-0-136-78 kubenswrapper[2583]: I0712 08:59:28.225488    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nl2br_c871963b-3941-42fb-8821-8064c666bea6/ovnkube-controller/0.log"