Jul 09 18:43:27.829981 ip-10-0-139-1 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 18:43:27.829992 ip-10-0-139-1 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 18:43:27.829999 ip-10-0-139-1 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 18:43:27.830244 ip-10-0-139-1 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 18:43:37.977506 ip-10-0-139-1 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 18:43:37.977522 ip-10-0-139-1 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 553c25c8c2fe410ea92146a7649c734d --
Jul 09 18:45:14.078831 ip-10-0-139-1 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 18:45:14.521747 ip-10-0-139-1 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:45:14.521747 ip-10-0-139-1 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 18:45:14.521747 ip-10-0-139-1 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:45:14.521747 ip-10-0-139-1 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 18:45:14.521747 ip-10-0-139-1 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:45:14.524059 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.523954    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 18:45:14.529041 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529013    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:14.529041 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529040    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:14.529041 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529044    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:14.529041 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529047    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:14.529041 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529050    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:14.529041 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529053    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529058    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529061    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529064    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529067    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529070    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529072    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529075    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529078    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529080    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529083    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529085    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529088    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529091    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529094    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529096    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529099    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529101    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529104    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529107    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:14.529233 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529109    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529112    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529114    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529117    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529119    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529122    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529124    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529127    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529129    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529132    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529134    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529137    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529140    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529143    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529145    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529148    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529152    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529156    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529159    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:14.529724 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529162    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529165    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529168    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529170    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529175    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529178    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529181    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529184    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529186    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529188    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529191    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529193    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529196    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529198    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529201    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529204    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529206    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529209    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529211    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:14.530230 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529214    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529216    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529218    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529221    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529224    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529226    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529229    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529232    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529235    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529238    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529240    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529243    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529245    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529248    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529251    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529253    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529255    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529259    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529262    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529267    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:14.530701 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529270    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529273    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529275    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529278    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529280    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529282    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529285    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529287    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529290    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529292    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529295    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529297    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529300    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529302    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529304    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:14.531169 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.529308    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:14.532493 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532479    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:14.532493 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532492    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532496    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532499    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532502    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532505    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532508    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532511    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532513    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532516    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532518    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532521    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532523    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532526    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532529    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532531    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532549    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532552    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532554    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532557    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532559    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:14.532565 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532562    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532564    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532567    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532570    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532573    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532575    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532578    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532581    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532583    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532586    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532588    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532591    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532593    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532596    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532598    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532601    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532603    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532606    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532609    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532611    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:14.533059 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532613    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532616    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532618    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532620    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532623    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532625    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532628    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532631    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532633    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532635    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532638    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532640    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532643    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532645    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532649    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532652    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532654    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532657    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532659    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532661    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:14.533578 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532664    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532666    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532669    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532671    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532673    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532676    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532679    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532681    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532684    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532686    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532691    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532694    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532697    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532700    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532703    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532705    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532708    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532710    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532713    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:14.534092 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532715    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532718    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532720    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532723    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532728    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532731    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532734    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532738    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532741    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532745    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532748    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532751    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532754    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532758    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532762    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532765    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532767    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532770    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.532772    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:14.534571 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533138    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533142    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533145    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533148    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533151    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533155    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533159    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533162    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533165    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533167    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533170    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533173    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533176    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533178    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533181    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533184    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533186    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533188    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533191    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:14.535033 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533193    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533196    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533199    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533201    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533204    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533207    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533209    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533212    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533214    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533216    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533219    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533221    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533223    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533226    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533228    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533231    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533233    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533236    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533239    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533241    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:14.535495 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533244    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533246    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533249    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533251    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533254    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533257    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533259    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533263    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533265    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533267    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533270    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533272    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533274    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533277    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533279    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533282    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533284    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533287    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533289    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533292    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:14.535983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533296    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533299    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533302    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533305    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533308    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533311    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533313    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533316    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533319    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533321    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533324    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533327    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533330    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533332    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533334    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533337    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533339    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533342    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533345    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533347    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:14.536474 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533349    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533352    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533354    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533357    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533359    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533366    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533369    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533371    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533374    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533376    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533380    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533383    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533386    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533388    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533391    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533393    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533396    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533398    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533400    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:14.536963 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.533403    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533479    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533489    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533496    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533500    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533508    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533511    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533515    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533520    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533523    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533526    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533529    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533547    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533552    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533557    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533561    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533565    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533568    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533573    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533577    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533580    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533583    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533586    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533589    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 18:45:14.537411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533593    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533596    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533599    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533602    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533605    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533608    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533611    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533614    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533616    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533621    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533624    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533627    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533630    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533632    2581 flags.go:64] FLAG: --enable-server="true"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533636    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533640    2581 flags.go:64] FLAG: --event-burst="100"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533644    2581 flags.go:64] FLAG: --event-qps="50"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533646    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533649    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533652    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533656    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533659    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533662    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533664    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533667    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 18:45:14.538004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533670    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533674    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533676    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533679    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533682    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533685    2581 flags.go:64] FLAG: --feature-gates=""
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533688    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533691    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533694    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533697    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533700    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533703    2581 flags.go:64] FLAG: --help="false"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533705    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-139-1.ec2.internal"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533708    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533711    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533714    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533717    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533720    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533722    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533725    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533728    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533730    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533734    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533737    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 18:45:14.538650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533740    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533743    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533745    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533748    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533751    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533753    2581 flags.go:64] FLAG: --lock-file=""
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533756    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533759    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533761    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533767    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533770    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533772    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533775    2581 flags.go:64] FLAG: --logging-format="text"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533778    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533781    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533784    2581 flags.go:64] FLAG: --manifest-url=""
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533786    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533791    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533793    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533797    2581 flags.go:64] FLAG: --max-pods="110"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533800    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533803    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533806    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533809    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533812    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 18:45:14.539274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533815    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533818    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533824    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533827    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533830    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533834    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533837    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533843    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533845    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533848    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533851    2581 flags.go:64] FLAG: --port="10250"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533854    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533857    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f3763910f697280"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533860    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533863    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533866    2581 flags.go:64] FLAG: --register-node="true"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533868    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533872    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533874    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533877    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533880    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533883    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533886    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533889    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533891    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 18:45:14.539910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533894    2581 flags.go:64] FLAG: --runonce="false"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533897    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533900    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533902    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533905    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533908    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533912    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533915    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533918    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533921    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533924    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533926    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533929    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533932    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533935    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533938    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533943    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533946    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533949    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533953    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533955    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533958    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533960    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533963    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533966    2581 flags.go:64] FLAG: --v="2"
Jul 09 18:45:14.540637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533970    2581 flags.go:64] FLAG: --version="false"
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533974    2581 flags.go:64] FLAG: --vmodule=""
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533977    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.533980    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534091    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534095    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534099    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534102    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534106    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534109    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534112    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534115    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534118    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534122    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534124    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534128    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534131    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534134    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534137    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:14.541262 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534140    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534142    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534145    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534156    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534159    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534162    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534165    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534169    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534171    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534174    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534177    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534179    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534182    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534184    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534187    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534189    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534192    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534194    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534197    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534199    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:14.541744 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534202    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534204    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534207    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534209    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534212    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534214    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534218    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534220    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534223    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534225    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534227    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534230    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534232    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534235    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534237    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534240    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534243    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534246    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534248    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534252    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:14.542229 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534254    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534257    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534259    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534262    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534265    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534267    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534269    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534290    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534293    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534296    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534299    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534301    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534304    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534307    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534309    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534312    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534314    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534316    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534321    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534323    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:14.542732 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534326    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534328    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534331    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534333    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534335    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534338    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534342    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534345    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534348    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534351    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534354    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534357    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534360    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534362    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534365    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534367    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534370    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534372    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534375    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534377    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:14.543245 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534380    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534382    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534385    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.534387    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.535070    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.542366    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.542382    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.543276    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.543285    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543356    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543363    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543367    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543370    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543373    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543376    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:14.543789 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543378    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543381    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543384    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543386    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543389    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543391    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543394    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543396    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543399    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543401    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543404    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543406    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543409    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543411    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543414    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543416    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543418    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543421    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543423    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:14.544172 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543426    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543428    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543431    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543433    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543437    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543440    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543442    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543445    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543448    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543450    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543452    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543455    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543457    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543460    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543463    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543467    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543470    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543472    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543475    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:14.544642 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543477    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543479    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543482    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543484    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543487    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543489    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543491    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543494    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543496    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543499    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543501    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543504    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543506    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543508    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543511    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543513    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543516    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543519    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543522    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:14.545099 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543526    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543529    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543532    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543546    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543549    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543552    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543555    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543557    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543560    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543563    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543566    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543568    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543571    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543573    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543576    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543578    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543581    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543583    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543586    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543588    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:14.545683 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543591    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543593    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543596    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543599    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543601    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543603    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543606    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543608    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543611    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543614    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543617    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543619    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543623    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543626    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543628    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:14.546289 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543630    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.543636    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543748    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543753    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543756    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543759    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543762    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543764    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543767    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543770    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543772    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543775    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543777    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543780    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543782    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:14.546719 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543785    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543787    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543790    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543792    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543795    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543798    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543801    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543803    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543806    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543808    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543811    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543816    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543818    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543821    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543823    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543826    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543829    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543831    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543833    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543836    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:14.547084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543838    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543840    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543843    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543859    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543864    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543867    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543870    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543873    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543876    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543879    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543882    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543885    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543887    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543890    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543893    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543895    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543898    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543900    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543903    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:14.547587 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543906    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543908    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543911    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543913    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543916    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543918    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543921    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543924    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543926    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543929    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543932    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543934    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543937    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543939    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543941    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543943    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543947    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543950    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543953    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543955    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:14.548060 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543958    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543960    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543963    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543965    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543967    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543970    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543972    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543975    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543977    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543979    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543981    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543984    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543986    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543989    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543991    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543993    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.543996    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.544008    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.544011    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:14.548563 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.544013    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:14.549017 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.544016    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:14.549017 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.544019    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:14.549017 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.544022    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:14.549017 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.544025    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:14.549017 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.544027    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:14.549017 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.544029    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:14.549017 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:14.544032    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:14.549017 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.544036    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:45:14.549017 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.544162    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 18:45:14.549017 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.547726    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 18:45:14.549271 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.549186    2581 server.go:1019] "Starting client certificate rotation"
Jul 09 18:45:14.549301 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.549285    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:45:14.549329 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.549323    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:45:14.552568 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.552553    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:45:14.553662 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.553644    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:45:14.570221 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.570191    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 09 18:45:14.572399 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.572383    2581 log.go:25] "Validated CRI v1 image API"
Jul 09 18:45:14.573152 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.573138    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 18:45:14.575461 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.575434    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 f6d3ca51-22ec-4911-991d-3e91a599be11:/dev/nvme0n1p3 fd6968e5-0da9-49f0-9f70-a6697daec963:/dev/nvme0n1p4]
Jul 09 18:45:14.575531 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.575459    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 18:45:14.581604 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.581586    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:45:14.582197 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.582089    2581 manager.go:216] Machine: {Timestamp:2026-07-09 18:45:14.580892479 +0000 UTC m=+0.375016498 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3057395 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22e1deeddacc170fffee5f43c39460 SystemUUID:ec22e1de-edda-cc17-0fff-ee5f43c39460 BootID:553c25c8-c2fe-410e-a921-46a7649c734d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8b:d9:c6:fe:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8b:d9:c6:fe:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:60:53:86:f1:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 18:45:14.582197 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.582196    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 18:45:14.582290 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.582278    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 18:45:14.585382 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.585359    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 18:45:14.585520 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.585386    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 18:45:14.586072 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.586062    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 18:45:14.586102 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.586075    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 18:45:14.586102 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.586083    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:45:14.586741 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.586731    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:45:14.587589 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.587578    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 18:45:14.590585 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.590573    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:45:14.590867 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.590857    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 18:45:14.590907 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.590889    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 18:45:14.590907 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.590899    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 18:45:14.590967 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.590914    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 18:45:14.590967 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.590925    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 09 18:45:14.590967 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.590933    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 18:45:14.591290 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.591279    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:45:14.591324 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.591299    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:45:14.593557 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.593519    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 18:45:14.596702 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.596682    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 18:45:14.596777 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.596727    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 18:45:14.600441 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600427    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600444    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600451    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600456    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600464    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600469    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600477    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600482    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600489    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600494    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600502    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 18:45:14.600518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.600507    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 18:45:14.601390 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.601377    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 18:45:14.601419 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.601393    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 18:45:14.603592 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.603565    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 18:45:14.604324 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.604290    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 18:45:14.604403 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.604289    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 18:45:14.604653 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.604637    2581 server.go:1268] "Started kubelet"
Jul 09 18:45:14.604845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.604742    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 18:45:14.604919 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.604743    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 18:45:14.604919 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.604893    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 18:45:14.605647 ip-10-0-139-1 systemd[1]: Started Kubernetes Kubelet.
Jul 09 18:45:14.606229 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.606174    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 18:45:14.606835 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.606817    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6txzl"
Jul 09 18:45:14.607384 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.607373    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 18:45:14.610483 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.609444    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-1.ec2.internal.18c0b368ad535c8e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-1.ec2.internal,UID:ip-10-0-139-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-1.ec2.internal,},FirstTimestamp:2026-07-09 18:45:14.604608654 +0000 UTC m=+0.398732674,LastTimestamp:2026-07-09 18:45:14.604608654 +0000 UTC m=+0.398732674,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-1.ec2.internal,}"
Jul 09 18:45:14.610813 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.610796    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 18:45:14.611658 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.611646    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 18:45:14.611722 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.611663    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 18:45:14.611722 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.611713    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:14.612356 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612340    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 18:45:14.612356 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612340    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 18:45:14.612481 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612363    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 18:45:14.612481 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612379    2581 factory.go:55] Registering systemd factory
Jul 09 18:45:14.612481 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612393    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 09 18:45:14.612481 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612462    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 18:45:14.612481 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612469    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 18:45:14.612789 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612777    2581 factory.go:153] Registering CRI-O factory
Jul 09 18:45:14.612855 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612792    2581 factory.go:223] Registration of the crio container factory successfully
Jul 09 18:45:14.612855 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612843    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 18:45:14.612952 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612866    2581 factory.go:103] Registering Raw factory
Jul 09 18:45:14.612952 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.612881    2581 manager.go:1196] Started watching for new ooms in manager
Jul 09 18:45:14.613228 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.613215    2581 manager.go:349] Starting recovery of all containers
Jul 09 18:45:14.614842 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.614825    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6txzl"
Jul 09 18:45:14.624204 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.624040    2581 manager.go:354] Recovery completed
Jul 09 18:45:14.626044 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.625813    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": readdirent /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 09 18:45:14.626377 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.626359    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:14.630145 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.630125    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:14.632106 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.632086    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-1.ec2.internal\" not found" node="ip-10-0-139-1.ec2.internal"
Jul 09 18:45:14.633010 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.632990    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:14.633082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.633023    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:14.633082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.633038    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:14.633500 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.633485    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 18:45:14.633579 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.633502    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 18:45:14.633579 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.633491    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:14.633579 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.633523    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:45:14.634225 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.634209    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:14.634289 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.634236    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:14.634289 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.634250    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:14.634944 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.634933    2581 policy_none.go:49] "None policy: Start"
Jul 09 18:45:14.634978 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.634947    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 18:45:14.634978 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.634957    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 18:45:14.636687 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.636677    2581 policy_none.go:47] "Start"
Jul 09 18:45:14.680179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.680162    2581 manager.go:337] "Starting Device Plugin manager"
Jul 09 18:45:14.688136 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.680204    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 18:45:14.688136 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.680217    2581 server.go:87] "Starting device plugin registration server"
Jul 09 18:45:14.688136 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.680487    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 18:45:14.688136 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.680498    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 18:45:14.688136 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.680607    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 18:45:14.688136 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.680710    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 18:45:14.688136 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.680719    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 18:45:14.688136 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.681280    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 18:45:14.688136 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.681322    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:14.730156 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.730123    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 18:45:14.731519 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.731501    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 18:45:14.731637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.731566    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 18:45:14.731637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.731602    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 18:45:14.731736 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.731641    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 18:45:14.734118 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.734098    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:14.781561 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.781480    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:14.782628 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.782607    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:14.782709 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.782636    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:14.782709 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.782646    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:14.782709 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.782669    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-1.ec2.internal"
Jul 09 18:45:14.789464 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.789450    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-1.ec2.internal"
Jul 09 18:45:14.789507 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.789471    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-1.ec2.internal\": node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:14.806875 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.806851    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:14.832644 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.832616    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"]
Jul 09 18:45:14.832725 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.832705    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:14.834387 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.834372    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:14.834470 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.834399    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:14.834470 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.834414    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:14.835650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.835637    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:14.835749 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.835735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:14.835813 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.835764    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:14.836375 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.836358    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:14.836444 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.836389    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:14.836444 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.836395    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:14.836444 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.836404    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:14.836444 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.836411    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:14.836444 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.836425    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:14.837577 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.837564    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:14.837647 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.837589    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:14.838209 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.838194    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:14.838275 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.838222    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:14.838275 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.838236    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:14.869329 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.869306    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-1.ec2.internal\" not found" node="ip-10-0-139-1.ec2.internal"
Jul 09 18:45:14.873768 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.873752    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-1.ec2.internal\" not found" node="ip-10-0-139-1.ec2.internal"
Jul 09 18:45:14.907150 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:14.907120    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:14.914998 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.914970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b500d70da3cf2cd4e34be1f2b83e6615-config\") pod \"kube-apiserver-proxy-ip-10-0-139-1.ec2.internal\" (UID: \"b500d70da3cf2cd4e34be1f2b83e6615\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:14.915088 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.915006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9dc67c69ca581dcacfd92f2924f3ec2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"9dc67c69ca581dcacfd92f2924f3ec2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:14.915088 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:14.915033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dc67c69ca581dcacfd92f2924f3ec2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"9dc67c69ca581dcacfd92f2924f3ec2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:15.007922 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:15.007892    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:15.015331 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.015310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b500d70da3cf2cd4e34be1f2b83e6615-config\") pod \"kube-apiserver-proxy-ip-10-0-139-1.ec2.internal\" (UID: \"b500d70da3cf2cd4e34be1f2b83e6615\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:15.015382 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.015340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9dc67c69ca581dcacfd92f2924f3ec2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"9dc67c69ca581dcacfd92f2924f3ec2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:15.015382 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.015359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dc67c69ca581dcacfd92f2924f3ec2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"9dc67c69ca581dcacfd92f2924f3ec2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:15.015455 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.015399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dc67c69ca581dcacfd92f2924f3ec2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"9dc67c69ca581dcacfd92f2924f3ec2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:15.015455 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.015419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b500d70da3cf2cd4e34be1f2b83e6615-config\") pod \"kube-apiserver-proxy-ip-10-0-139-1.ec2.internal\" (UID: \"b500d70da3cf2cd4e34be1f2b83e6615\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:15.015455 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.015425    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9dc67c69ca581dcacfd92f2924f3ec2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"9dc67c69ca581dcacfd92f2924f3ec2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:15.108803 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:15.108733    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:15.172304 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.172280    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:15.176612 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.176427    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:15.209671 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:15.209640    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:15.310186 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:15.310142    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:15.410767 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:15.410687    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:15.511215 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:15.511176    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:15.548667 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.548638    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 18:45:15.549332 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.548782    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:45:15.549332 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.548819    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:45:15.611576 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:15.611530    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:15.620307 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.620280    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 18:40:15 +0000 UTC" deadline="2028-03-05 11:54:45.756750814 +0000 UTC"
Jul 09 18:45:15.620307 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.620305    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14513h9m30.136448948s"
Jul 09 18:45:15.712518 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:15.712492    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:15.765317 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:15.765289    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc67c69ca581dcacfd92f2924f3ec2c.slice/crio-8dd04ed7100198aff4019e4a2c7ef471c9aeba0c2c6ebe9fa124271b598b2916 WatchSource:0}: Error finding container 8dd04ed7100198aff4019e4a2c7ef471c9aeba0c2c6ebe9fa124271b598b2916: Status 404 returned error can't find the container with id 8dd04ed7100198aff4019e4a2c7ef471c9aeba0c2c6ebe9fa124271b598b2916
Jul 09 18:45:15.767359 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:15.767326    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb500d70da3cf2cd4e34be1f2b83e6615.slice/crio-11e270483b7b0a22b6469ad2978b5b0fd6c6028d76b8cb84631fc9a3322bbfb6 WatchSource:0}: Error finding container 11e270483b7b0a22b6469ad2978b5b0fd6c6028d76b8cb84631fc9a3322bbfb6: Status 404 returned error can't find the container with id 11e270483b7b0a22b6469ad2978b5b0fd6c6028d76b8cb84631fc9a3322bbfb6
Jul 09 18:45:15.771803 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:15.771785    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:45:15.813376 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:15.813347    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:15.913798 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:15.913767    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:16.014302 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.014237    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found"
Jul 09 18:45:16.099708 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.099686    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:16.112725 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.112703    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:16.126478 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.126457    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:45:16.128252 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.128239    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"
Jul 09 18:45:16.136894 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.136880    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:45:16.152065 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.152046    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:16.592934 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.592902    2581 apiserver.go:52] "Watching apiserver"
Jul 09 18:45:16.603542 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.603519    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 18:45:16.604899 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.604867    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-htlst","openshift-image-registry/node-ca-zrgtd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal","openshift-multus/multus-additional-cni-plugins-p2cjm","openshift-ovn-kubernetes/ovnkube-node-kksj7","kube-system/global-pull-secret-syncer-g8kxr","kube-system/konnectivity-agent-vvq6l","kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qmwc2","openshift-multus/multus-t8wc8","openshift-multus/network-metrics-daemon-m2z8q","openshift-network-diagnostics/network-check-target-llcml","openshift-network-operator/iptables-alerter-9rcc8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"]
Jul 09 18:45:16.606409 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.606387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:16.607770 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.607749    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.608924 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.608905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.610667 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.610215    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 18:45:16.610667 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.610405    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 18:45:16.611903 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.610867    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qchhs\""
Jul 09 18:45:16.611903 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.611157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.611903 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.611781    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 18:45:16.612403 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.612382    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 18:45:16.612797 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.612777    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 18:45:16.613228 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.613207    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 18:45:16.613504 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.613474    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:45:16.613795 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.613776    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 18:45:16.614393 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.614375    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q67rm\""
Jul 09 18:45:16.614638 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.614611    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t746c\""
Jul 09 18:45:16.614780 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.614755    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 18:45:16.615003 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.614971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.616325 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.616300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:16.616403 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.616378    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:16.616855 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.616749    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 18:45:16.617283 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.617267    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vcr7d\""
Jul 09 18:45:16.617747 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.617727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.618476 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.618273    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 18:45:16.618893 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.618872    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 18:45:16.618995 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.618916    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 18:45:16.618995 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.618949    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 18:45:16.619115 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.619024    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 18:45:16.619115 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.619072    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 18:45:16.619358 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.619339    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 18:45:16.619358 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.619352    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5dkss\""
Jul 09 18:45:16.619885 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.619865    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.620800 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.620361    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 18:45:16.620800 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.620405    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 18:45:16.620800 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.620571    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 18:45:16.620800 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.620706    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:45:16.621047 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.620931    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 18:45:16.621047 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.620987    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jqwrx\""
Jul 09 18:45:16.622080 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.622062    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.622455 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.622435    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 18:45:16.622982 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.622964    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bpqpt\""
Jul 09 18:45:16.623305 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.623287    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 18:45:16.623644 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.623626    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.624741 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.624693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xqmq\" (UniqueName: \"kubernetes.io/projected/50e7bc18-fcb6-451e-b4c4-c588082e69aa-kube-api-access-8xqmq\") pod \"iptables-alerter-9rcc8\" (UID: \"50e7bc18-fcb6-451e-b4c4-c588082e69aa\") " pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.624741 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.624731    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqlxt\" (UniqueName: \"kubernetes.io/projected/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-kube-api-access-zqlxt\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.624894 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.624759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.624894 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.624785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j46wk\" (UniqueName: \"kubernetes.io/projected/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-kube-api-access-j46wk\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.624894 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.624840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-run-openvswitch\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.624894 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.624865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50e7bc18-fcb6-451e-b4c4-c588082e69aa-host-slash\") pod \"iptables-alerter-9rcc8\" (UID: \"50e7bc18-fcb6-451e-b4c4-c588082e69aa\") " pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.625087 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.624888    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 18:45:16.625087 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.624916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-registration-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.625087 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.624954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-cnibin\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.625087 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.624981    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.625087 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-var-lib-openvswitch\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625087 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:16.625087 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-node-log\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b9a8392-e896-4032-a97b-645d8fba6b45-ovnkube-config\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.625092    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b9a8392-e896-4032-a97b-645d8fba6b45-env-overrides\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-sys-fs\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-os-release\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-run-netns\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-log-socket\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-cni-bin\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b9a8392-e896-4032-a97b-645d8fba6b45-ovnkube-script-lib\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50e7bc18-fcb6-451e-b4c4-c588082e69aa-iptables-alerter-script\") pod \"iptables-alerter-9rcc8\" (UID: \"50e7bc18-fcb6-451e-b4c4-c588082e69aa\") " pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-socket-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-etc-openvswitch\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvkj\" (UniqueName: \"kubernetes.io/projected/4b9a8392-e896-4032-a97b-645d8fba6b45-kube-api-access-nqvkj\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5561e5bc-2db6-45b2-ba6f-02f141a62cd8-agent-certs\") pod \"konnectivity-agent-vvq6l\" (UID: \"5561e5bc-2db6-45b2-ba6f-02f141a62cd8\") " pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-systemd-units\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-run-ovn\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b9a8392-e896-4032-a97b-645d8fba6b45-ovn-node-metrics-cert\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-device-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-kubelet\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-run-ovn-kubernetes\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625792    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625811    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-cni-netd\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-system-cni-dir\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.625876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-slash\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.626758 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.626758 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5561e5bc-2db6-45b2-ba6f-02f141a62cd8-konnectivity-ca\") pod \"konnectivity-agent-vvq6l\" (UID: \"5561e5bc-2db6-45b2-ba6f-02f141a62cd8\") " pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:16.626758 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.626758 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.625990    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-run-systemd\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.626758 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.626023    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 18:45:16.626758 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.626264    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dmh2t\""
Jul 09 18:45:16.626758 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.626319    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 18:45:16.626758 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.626323    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-npdwd\""
Jul 09 18:45:16.626758 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.626701    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:16.627038 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.626761    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:16.635948 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.635920    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:45:16.660060 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.660034    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wrlfh"
Jul 09 18:45:16.669628 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.669593    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wrlfh"
Jul 09 18:45:16.714259 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.714234    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 18:45:16.726643 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-sys\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.726643 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-cni-dir\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.726845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4091e474-68c7-4a0e-9c55-7bd741bd65cc-cni-binary-copy\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.726845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.726845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-sys-fs\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.726845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-run-netns\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.726845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-dbus\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:16.726845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-socket-dir-parent\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.726845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-etc-kubernetes\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.726845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:16.726845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726846    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-modprobe-d\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxbq7\" (UniqueName: \"kubernetes.io/projected/735851e3-381c-495a-a69b-ab40850b0010-kube-api-access-jxbq7\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5561e5bc-2db6-45b2-ba6f-02f141a62cd8-agent-certs\") pod \"konnectivity-agent-vvq6l\" (UID: \"5561e5bc-2db6-45b2-ba6f-02f141a62cd8\") " pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-systemd-units\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-run-ovn\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.726989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-kubelet-config\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-sysctl-d\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76039738-c73a-4be3-95a1-2f46e01435ad-tmp-dir\") pod \"node-resolver-htlst\" (UID: \"76039738-c73a-4be3-95a1-2f46e01435ad\") " pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727068    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-var-lib-cni-bin\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-device-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727118    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbe257a6-701c-4e95-8bd5-327628080f1f-host\") pod \"node-ca-zrgtd\" (UID: \"cbe257a6-701c-4e95-8bd5-327628080f1f\") " pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727147    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8tcz\" (UniqueName: \"kubernetes.io/projected/cbe257a6-701c-4e95-8bd5-327628080f1f-kube-api-access-t8tcz\") pod \"node-ca-zrgtd\" (UID: \"cbe257a6-701c-4e95-8bd5-327628080f1f\") " pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-hostroot\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5561e5bc-2db6-45b2-ba6f-02f141a62cd8-konnectivity-ca\") pod \"konnectivity-agent-vvq6l\" (UID: \"5561e5bc-2db6-45b2-ba6f-02f141a62cd8\") " pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727227    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-var-lib-cni-multus\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.727298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xqmq\" (UniqueName: \"kubernetes.io/projected/50e7bc18-fcb6-451e-b4c4-c588082e69aa-kube-api-access-8xqmq\") pod \"iptables-alerter-9rcc8\" (UID: \"50e7bc18-fcb6-451e-b4c4-c588082e69aa\") " pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqlxt\" (UniqueName: \"kubernetes.io/projected/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-kube-api-access-zqlxt\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j46wk\" (UniqueName: \"kubernetes.io/projected/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-kube-api-access-j46wk\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727406    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-run-openvswitch\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-sysconfig\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727463    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbe257a6-701c-4e95-8bd5-327628080f1f-serviceca\") pod \"node-ca-zrgtd\" (UID: \"cbe257a6-701c-4e95-8bd5-327628080f1f\") " pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-run-multus-certs\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50e7bc18-fcb6-451e-b4c4-c588082e69aa-host-slash\") pod \"iptables-alerter-9rcc8\" (UID: \"50e7bc18-fcb6-451e-b4c4-c588082e69aa\") " pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-node-log\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b9a8392-e896-4032-a97b-645d8fba6b45-ovnkube-config\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b9a8392-e896-4032-a97b-645d8fba6b45-ovnkube-script-lib\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-tmp\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727683    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f6dn\" (UniqueName: \"kubernetes.io/projected/4091e474-68c7-4a0e-9c55-7bd741bd65cc-kube-api-access-4f6dn\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-os-release\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-log-socket\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.728212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-cni-bin\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727852    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76039738-c73a-4be3-95a1-2f46e01435ad-hosts-file\") pod \"node-resolver-htlst\" (UID: \"76039738-c73a-4be3-95a1-2f46e01435ad\") " pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-system-cni-dir\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-os-release\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50e7bc18-fcb6-451e-b4c4-c588082e69aa-iptables-alerter-script\") pod \"iptables-alerter-9rcc8\" (UID: \"50e7bc18-fcb6-451e-b4c4-c588082e69aa\") " pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727956    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-socket-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.727983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-etc-openvswitch\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvkj\" (UniqueName: \"kubernetes.io/projected/4b9a8392-e896-4032-a97b-645d8fba6b45-kube-api-access-nqvkj\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-run\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-tuned\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728091    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27c4b\" (UniqueName: \"kubernetes.io/projected/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-kube-api-access-27c4b\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-run-k8s-cni-cncf-io\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b9a8392-e896-4032-a97b-645d8fba6b45-ovn-node-metrics-cert\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-kubernetes\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-sysctl-conf\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-lib-modules\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.729085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-daemon-config\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-kubelet\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-run-ovn-kubernetes\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-cni-netd\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nrsc\" (UniqueName: \"kubernetes.io/projected/76039738-c73a-4be3-95a1-2f46e01435ad-kube-api-access-5nrsc\") pod \"node-resolver-htlst\" (UID: \"76039738-c73a-4be3-95a1-2f46e01435ad\") " pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728421    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tcbf\" (UniqueName: \"kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf\") pod \"network-check-target-llcml\" (UID: \"fc403380-da26-468c-b063-64eb91ce0744\") " pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-system-cni-dir\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-slash\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728548    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-conf-dir\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-run-systemd\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-var-lib-kubelet\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-cnibin\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-run-netns\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-systemd\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-host\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.729909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-var-lib-kubelet\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.730648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-registration-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.730648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-cnibin\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.730648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.730648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-var-lib-openvswitch\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.730648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.728920    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b9a8392-e896-4032-a97b-645d8fba6b45-env-overrides\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.730648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.729433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b9a8392-e896-4032-a97b-645d8fba6b45-env-overrides\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.730648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.729547    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.730648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.729601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-sys-fs\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.730648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.729650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-run-netns\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.730648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.729996    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 18:45:16.731369 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.731345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.731478 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.731423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-systemd-units\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.731478 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.731474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-run-ovn\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.731663 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.731579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-socket-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.731663 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.731653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-etc-openvswitch\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.732056 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.732027    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50e7bc18-fcb6-451e-b4c4-c588082e69aa-iptables-alerter-script\") pod \"iptables-alerter-9rcc8\" (UID: \"50e7bc18-fcb6-451e-b4c4-c588082e69aa\") " pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.732188 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.732165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-device-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.732763 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.732737    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5561e5bc-2db6-45b2-ba6f-02f141a62cd8-konnectivity-ca\") pod \"konnectivity-agent-vvq6l\" (UID: \"5561e5bc-2db6-45b2-ba6f-02f141a62cd8\") " pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:16.732856 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.732801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-kubelet\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.732931 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.732863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-run-ovn-kubernetes\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.732931 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.732909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-cni-netd\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.733067 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.732971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-system-cni-dir\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.733067 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-slash\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.733212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733068    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.733212 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.733324 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-run-systemd\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.733382 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-registration-dir\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.733442 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733377    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-cnibin\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.733442 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733420    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-var-lib-openvswitch\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.733546 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733497    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.733604 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-os-release\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.733604 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733557    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-run-openvswitch\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.733756 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-node-log\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.733756 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-log-socket\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.733756 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733698    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50e7bc18-fcb6-451e-b4c4-c588082e69aa-host-slash\") pod \"iptables-alerter-9rcc8\" (UID: \"50e7bc18-fcb6-451e-b4c4-c588082e69aa\") " pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.733756 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.733704    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9a8392-e896-4032-a97b-645d8fba6b45-host-cni-bin\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.734187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.734145    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b9a8392-e896-4032-a97b-645d8fba6b45-ovnkube-config\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.734398 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.734371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.734687 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.734669    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b9a8392-e896-4032-a97b-645d8fba6b45-ovnkube-script-lib\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.734770 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.734750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.735749 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.735722    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5561e5bc-2db6-45b2-ba6f-02f141a62cd8-agent-certs\") pod \"konnectivity-agent-vvq6l\" (UID: \"5561e5bc-2db6-45b2-ba6f-02f141a62cd8\") " pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:16.736743 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.736593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b9a8392-e896-4032-a97b-645d8fba6b45-ovn-node-metrics-cert\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.739299 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.739239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" event={"ID":"b500d70da3cf2cd4e34be1f2b83e6615","Type":"ContainerStarted","Data":"11e270483b7b0a22b6469ad2978b5b0fd6c6028d76b8cb84631fc9a3322bbfb6"}
Jul 09 18:45:16.741305 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.741278    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" event={"ID":"9dc67c69ca581dcacfd92f2924f3ec2c","Type":"ContainerStarted","Data":"8dd04ed7100198aff4019e4a2c7ef471c9aeba0c2c6ebe9fa124271b598b2916"}
Jul 09 18:45:16.748644 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.748568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xqmq\" (UniqueName: \"kubernetes.io/projected/50e7bc18-fcb6-451e-b4c4-c588082e69aa-kube-api-access-8xqmq\") pod \"iptables-alerter-9rcc8\" (UID: \"50e7bc18-fcb6-451e-b4c4-c588082e69aa\") " pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.749277 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.749234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvkj\" (UniqueName: \"kubernetes.io/projected/4b9a8392-e896-4032-a97b-645d8fba6b45-kube-api-access-nqvkj\") pod \"ovnkube-node-kksj7\" (UID: \"4b9a8392-e896-4032-a97b-645d8fba6b45\") " pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.749512 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.749487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqlxt\" (UniqueName: \"kubernetes.io/projected/aaaafc11-a974-4e04-aed4-e6cdafde5f9b-kube-api-access-zqlxt\") pod \"aws-ebs-csi-driver-node-h8rr7\" (UID: \"aaaafc11-a974-4e04-aed4-e6cdafde5f9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.749606 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.749566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j46wk\" (UniqueName: \"kubernetes.io/projected/a9158700-77bf-4a4c-bcd0-7b4044d2cafc-kube-api-access-j46wk\") pod \"multus-additional-cni-plugins-p2cjm\" (UID: \"a9158700-77bf-4a4c-bcd0-7b4044d2cafc\") " pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-run-k8s-cni-cncf-io\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-kubernetes\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829792    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-run-k8s-cni-cncf-io\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-sysctl-conf\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-lib-modules\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-daemon-config\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-kubernetes\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nrsc\" (UniqueName: \"kubernetes.io/projected/76039738-c73a-4be3-95a1-2f46e01435ad-kube-api-access-5nrsc\") pod \"node-resolver-htlst\" (UID: \"76039738-c73a-4be3-95a1-2f46e01435ad\") " pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcbf\" (UniqueName: \"kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf\") pod \"network-check-target-llcml\" (UID: \"fc403380-da26-468c-b063-64eb91ce0744\") " pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-conf-dir\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.829962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-conf-dir\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-lib-modules\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830063    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-var-lib-kubelet\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-sysctl-conf\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-cnibin\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-run-netns\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.830125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830138    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-var-lib-kubelet\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-systemd\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-host\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-cnibin\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-var-lib-kubelet\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-sys\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-systemd\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-cni-dir\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4091e474-68c7-4a0e-9c55-7bd741bd65cc-cni-binary-copy\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830273    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-run-netns\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830280    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-var-lib-kubelet\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-dbus\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-socket-dir-parent\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-etc-kubernetes\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-sys\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830336    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-cni-dir\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-etc-kubernetes\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:16.831179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830410    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-socket-dir-parent\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830249    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-host\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-dbus\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.830491    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.830561    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs podName:735851e3-381c-495a-a69b-ab40850b0010 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:17.330530394 +0000 UTC m=+3.124654403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs") pod "network-metrics-daemon-m2z8q" (UID: "735851e3-381c-495a-a69b-ab40850b0010") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4091e474-68c7-4a0e-9c55-7bd741bd65cc-multus-daemon-config\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-modprobe-d\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxbq7\" (UniqueName: \"kubernetes.io/projected/735851e3-381c-495a-a69b-ab40850b0010-kube-api-access-jxbq7\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-kubelet-config\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-sysctl-d\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76039738-c73a-4be3-95a1-2f46e01435ad-tmp-dir\") pod \"node-resolver-htlst\" (UID: \"76039738-c73a-4be3-95a1-2f46e01435ad\") " pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-modprobe-d\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-kubelet-config\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-var-lib-cni-bin\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-var-lib-cni-bin\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4091e474-68c7-4a0e-9c55-7bd741bd65cc-cni-binary-copy\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-sysctl-d\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbe257a6-701c-4e95-8bd5-327628080f1f-host\") pod \"node-ca-zrgtd\" (UID: \"cbe257a6-701c-4e95-8bd5-327628080f1f\") " pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.832187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbe257a6-701c-4e95-8bd5-327628080f1f-host\") pod \"node-ca-zrgtd\" (UID: \"cbe257a6-701c-4e95-8bd5-327628080f1f\") " pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.830977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8tcz\" (UniqueName: \"kubernetes.io/projected/cbe257a6-701c-4e95-8bd5-327628080f1f-kube-api-access-t8tcz\") pod \"node-ca-zrgtd\" (UID: \"cbe257a6-701c-4e95-8bd5-327628080f1f\") " pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-hostroot\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-var-lib-cni-multus\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-sysconfig\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831085    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbe257a6-701c-4e95-8bd5-327628080f1f-serviceca\") pod \"node-ca-zrgtd\" (UID: \"cbe257a6-701c-4e95-8bd5-327628080f1f\") " pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-run-multus-certs\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-tmp\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831174    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76039738-c73a-4be3-95a1-2f46e01435ad-tmp-dir\") pod \"node-resolver-htlst\" (UID: \"76039738-c73a-4be3-95a1-2f46e01435ad\") " pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f6dn\" (UniqueName: \"kubernetes.io/projected/4091e474-68c7-4a0e-9c55-7bd741bd65cc-kube-api-access-4f6dn\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76039738-c73a-4be3-95a1-2f46e01435ad-hosts-file\") pod \"node-resolver-htlst\" (UID: \"76039738-c73a-4be3-95a1-2f46e01435ad\") " pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831258    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-hostroot\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-var-lib-cni-multus\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-system-cni-dir\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-system-cni-dir\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-os-release\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-run\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.833082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-tuned\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.834027 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27c4b\" (UniqueName: \"kubernetes.io/projected/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-kube-api-access-27c4b\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.834027 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.831529    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:16.834027 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.831579    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret podName:b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd nodeName:}" failed. No retries permitted until 2026-07-09 18:45:17.33156601 +0000 UTC m=+3.125690049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret") pod "global-pull-secret-syncer-g8kxr" (UID: "b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:16.834027 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-sysconfig\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.834027 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831768    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-os-release\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.834027 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831814    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-run\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.834027 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbe257a6-701c-4e95-8bd5-327628080f1f-serviceca\") pod \"node-ca-zrgtd\" (UID: \"cbe257a6-701c-4e95-8bd5-327628080f1f\") " pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.834027 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.831963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4091e474-68c7-4a0e-9c55-7bd741bd65cc-host-run-multus-certs\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.834027 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.832014    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76039738-c73a-4be3-95a1-2f46e01435ad-hosts-file\") pod \"node-resolver-htlst\" (UID: \"76039738-c73a-4be3-95a1-2f46e01435ad\") " pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.834514 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.834492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-etc-tuned\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.834827 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.834791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-tmp\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.838330 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.838307    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:16.838436 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.838337    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:16.838436 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.838353    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2tcbf for pod openshift-network-diagnostics/network-check-target-llcml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:16.838436 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:16.838416    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf podName:fc403380-da26-468c-b063-64eb91ce0744 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:17.338397946 +0000 UTC m=+3.132521973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2tcbf" (UniqueName: "kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf") pod "network-check-target-llcml" (UID: "fc403380-da26-468c-b063-64eb91ce0744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:16.841808 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.841754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nrsc\" (UniqueName: \"kubernetes.io/projected/76039738-c73a-4be3-95a1-2f46e01435ad-kube-api-access-5nrsc\") pod \"node-resolver-htlst\" (UID: \"76039738-c73a-4be3-95a1-2f46e01435ad\") " pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.846859 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.846796    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f6dn\" (UniqueName: \"kubernetes.io/projected/4091e474-68c7-4a0e-9c55-7bd741bd65cc-kube-api-access-4f6dn\") pod \"multus-t8wc8\" (UID: \"4091e474-68c7-4a0e-9c55-7bd741bd65cc\") " pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.847968 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.847935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27c4b\" (UniqueName: \"kubernetes.io/projected/020156c9-40a9-4a45-bca2-f7be8c8a8bb2-kube-api-access-27c4b\") pod \"tuned-qmwc2\" (UID: \"020156c9-40a9-4a45-bca2-f7be8c8a8bb2\") " pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.850119 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.850097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8tcz\" (UniqueName: \"kubernetes.io/projected/cbe257a6-701c-4e95-8bd5-327628080f1f-kube-api-access-t8tcz\") pod \"node-ca-zrgtd\" (UID: \"cbe257a6-701c-4e95-8bd5-327628080f1f\") " pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.850684 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.850658    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxbq7\" (UniqueName: \"kubernetes.io/projected/735851e3-381c-495a-a69b-ab40850b0010-kube-api-access-jxbq7\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:16.856659 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.856634    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:16.915926 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.915890    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:16.921754 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.921727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:16.930611 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.930568    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9rcc8"
Jul 09 18:45:16.938411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.938363    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7"
Jul 09 18:45:16.941430 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:16.941403    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e7bc18_fcb6_451e_b4c4_c588082e69aa.slice/crio-1f7e068a0e4111292bdaa3144c9d7da2d51ef857bdc07d7e9d1233c5fd06a09b WatchSource:0}: Error finding container 1f7e068a0e4111292bdaa3144c9d7da2d51ef857bdc07d7e9d1233c5fd06a09b: Status 404 returned error can't find the container with id 1f7e068a0e4111292bdaa3144c9d7da2d51ef857bdc07d7e9d1233c5fd06a09b
Jul 09 18:45:16.945369 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.945345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p2cjm"
Jul 09 18:45:16.948709 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:16.948683    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaaafc11_a974_4e04_aed4_e6cdafde5f9b.slice/crio-4cb4fd69232c4b7ff7ec9d8bd69c68ddc388e939a8a3c77269018405d4ab90d6 WatchSource:0}: Error finding container 4cb4fd69232c4b7ff7ec9d8bd69c68ddc388e939a8a3c77269018405d4ab90d6: Status 404 returned error can't find the container with id 4cb4fd69232c4b7ff7ec9d8bd69c68ddc388e939a8a3c77269018405d4ab90d6
Jul 09 18:45:16.955296 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.955272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:16.957087 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:16.957061    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9158700_77bf_4a4c_bcd0_7b4044d2cafc.slice/crio-0d1b140da441e1e4d1db234d229749f7bf53aba83a79ee4b83b39e4b15a5350e WatchSource:0}: Error finding container 0d1b140da441e1e4d1db234d229749f7bf53aba83a79ee4b83b39e4b15a5350e: Status 404 returned error can't find the container with id 0d1b140da441e1e4d1db234d229749f7bf53aba83a79ee4b83b39e4b15a5350e
Jul 09 18:45:16.964091 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.964066    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qmwc2"
Jul 09 18:45:16.966317 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:16.966234    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9a8392_e896_4032_a97b_645d8fba6b45.slice/crio-688ac662c4ad832a422ca11f2ca4c320b421248aa7758c79e83485a9b3df660c WatchSource:0}: Error finding container 688ac662c4ad832a422ca11f2ca4c320b421248aa7758c79e83485a9b3df660c: Status 404 returned error can't find the container with id 688ac662c4ad832a422ca11f2ca4c320b421248aa7758c79e83485a9b3df660c
Jul 09 18:45:16.971919 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.971898    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-htlst"
Jul 09 18:45:16.976083 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:16.976053    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020156c9_40a9_4a45_bca2_f7be8c8a8bb2.slice/crio-8d93a54ed94119287b0a5f9b4709542584385897ff0a019947f21c70ab6703ee WatchSource:0}: Error finding container 8d93a54ed94119287b0a5f9b4709542584385897ff0a019947f21c70ab6703ee: Status 404 returned error can't find the container with id 8d93a54ed94119287b0a5f9b4709542584385897ff0a019947f21c70ab6703ee
Jul 09 18:45:16.979760 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.979613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zrgtd"
Jul 09 18:45:16.985377 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:16.985348    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76039738_c73a_4be3_95a1_2f46e01435ad.slice/crio-32aa9f6fe3b37c0d8ae04b6a857e848fd68c9a485f34b71d64a988ea9af74c95 WatchSource:0}: Error finding container 32aa9f6fe3b37c0d8ae04b6a857e848fd68c9a485f34b71d64a988ea9af74c95: Status 404 returned error can't find the container with id 32aa9f6fe3b37c0d8ae04b6a857e848fd68c9a485f34b71d64a988ea9af74c95
Jul 09 18:45:16.986645 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:16.986584    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t8wc8"
Jul 09 18:45:16.992310 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:16.992274    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe257a6_701c_4e95_8bd5_327628080f1f.slice/crio-5ecf53186b0c0ac2b43f138b28d124814f46ef53fab537f85a4fb967e43fa396 WatchSource:0}: Error finding container 5ecf53186b0c0ac2b43f138b28d124814f46ef53fab537f85a4fb967e43fa396: Status 404 returned error can't find the container with id 5ecf53186b0c0ac2b43f138b28d124814f46ef53fab537f85a4fb967e43fa396
Jul 09 18:45:17.001873 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:16.999948    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4091e474_68c7_4a0e_9c55_7bd741bd65cc.slice/crio-6c585e5522f4922dee0e26033a64e33f9d360fb648af25d583662c3062514b20 WatchSource:0}: Error finding container 6c585e5522f4922dee0e26033a64e33f9d360fb648af25d583662c3062514b20: Status 404 returned error can't find the container with id 6c585e5522f4922dee0e26033a64e33f9d360fb648af25d583662c3062514b20
Jul 09 18:45:17.335827 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.335734    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:17.336006 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.335854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:17.336066 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:17.336057    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:17.336115 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:17.336057    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:17.336169 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:17.336132    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret podName:b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd nodeName:}" failed. No retries permitted until 2026-07-09 18:45:18.336112573 +0000 UTC m=+4.130236597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret") pod "global-pull-secret-syncer-g8kxr" (UID: "b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:17.336169 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:17.336153    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs podName:735851e3-381c-495a-a69b-ab40850b0010 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:18.336141074 +0000 UTC m=+4.130265088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs") pod "network-metrics-daemon-m2z8q" (UID: "735851e3-381c-495a-a69b-ab40850b0010") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:17.436556 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.436502    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcbf\" (UniqueName: \"kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf\") pod \"network-check-target-llcml\" (UID: \"fc403380-da26-468c-b063-64eb91ce0744\") " pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:17.436701 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:17.436683    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:17.436701 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:17.436700    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:17.436786 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:17.436710    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2tcbf for pod openshift-network-diagnostics/network-check-target-llcml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:17.436786 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:17.436762    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf podName:fc403380-da26-468c-b063-64eb91ce0744 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:18.436748185 +0000 UTC m=+4.230872193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tcbf" (UniqueName: "kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf") pod "network-check-target-llcml" (UID: "fc403380-da26-468c-b063-64eb91ce0744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:17.672060 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.671696    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:40:17 +0000 UTC" deadline="2028-03-20 18:30:33.035724922 +0000 UTC"
Jul 09 18:45:17.672060 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.672011    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14879h45m15.363723151s"
Jul 09 18:45:17.745342 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.745308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t8wc8" event={"ID":"4091e474-68c7-4a0e-9c55-7bd741bd65cc","Type":"ContainerStarted","Data":"6c585e5522f4922dee0e26033a64e33f9d360fb648af25d583662c3062514b20"}
Jul 09 18:45:17.746723 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.746693    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-htlst" event={"ID":"76039738-c73a-4be3-95a1-2f46e01435ad","Type":"ContainerStarted","Data":"32aa9f6fe3b37c0d8ae04b6a857e848fd68c9a485f34b71d64a988ea9af74c95"}
Jul 09 18:45:17.748514 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.748485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qmwc2" event={"ID":"020156c9-40a9-4a45-bca2-f7be8c8a8bb2","Type":"ContainerStarted","Data":"8d93a54ed94119287b0a5f9b4709542584385897ff0a019947f21c70ab6703ee"}
Jul 09 18:45:17.750082 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.750059    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" event={"ID":"4b9a8392-e896-4032-a97b-645d8fba6b45","Type":"ContainerStarted","Data":"688ac662c4ad832a422ca11f2ca4c320b421248aa7758c79e83485a9b3df660c"}
Jul 09 18:45:17.751397 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.751373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2cjm" event={"ID":"a9158700-77bf-4a4c-bcd0-7b4044d2cafc","Type":"ContainerStarted","Data":"0d1b140da441e1e4d1db234d229749f7bf53aba83a79ee4b83b39e4b15a5350e"}
Jul 09 18:45:17.753146 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.753076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7" event={"ID":"aaaafc11-a974-4e04-aed4-e6cdafde5f9b","Type":"ContainerStarted","Data":"4cb4fd69232c4b7ff7ec9d8bd69c68ddc388e939a8a3c77269018405d4ab90d6"}
Jul 09 18:45:17.754505 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.754442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9rcc8" event={"ID":"50e7bc18-fcb6-451e-b4c4-c588082e69aa","Type":"ContainerStarted","Data":"1f7e068a0e4111292bdaa3144c9d7da2d51ef857bdc07d7e9d1233c5fd06a09b"}
Jul 09 18:45:17.755764 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.755700    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zrgtd" event={"ID":"cbe257a6-701c-4e95-8bd5-327628080f1f","Type":"ContainerStarted","Data":"5ecf53186b0c0ac2b43f138b28d124814f46ef53fab537f85a4fb967e43fa396"}
Jul 09 18:45:17.758184 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:17.758124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vvq6l" event={"ID":"5561e5bc-2db6-45b2-ba6f-02f141a62cd8","Type":"ContainerStarted","Data":"871dce5bde502361d2f106d13a224036fb79d620b17d168941cae6f41571e880"}
Jul 09 18:45:18.345453 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:18.345410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:18.345678 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:18.345543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:18.345756 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.345704    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:18.345814 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.345771    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs podName:735851e3-381c-495a-a69b-ab40850b0010 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:20.345750015 +0000 UTC m=+6.139874030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs") pod "network-metrics-daemon-m2z8q" (UID: "735851e3-381c-495a-a69b-ab40850b0010") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:18.346201 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.346180    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:18.346285 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.346244    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret podName:b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd nodeName:}" failed. No retries permitted until 2026-07-09 18:45:20.346226325 +0000 UTC m=+6.140350336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret") pod "global-pull-secret-syncer-g8kxr" (UID: "b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:18.446468 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:18.446435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcbf\" (UniqueName: \"kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf\") pod \"network-check-target-llcml\" (UID: \"fc403380-da26-468c-b063-64eb91ce0744\") " pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:18.446686 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.446602    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:18.446686 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.446620    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:18.446686 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.446630    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2tcbf for pod openshift-network-diagnostics/network-check-target-llcml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:18.446686 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.446688    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf podName:fc403380-da26-468c-b063-64eb91ce0744 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:20.446673193 +0000 UTC m=+6.240797216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tcbf" (UniqueName: "kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf") pod "network-check-target-llcml" (UID: "fc403380-da26-468c-b063-64eb91ce0744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:18.673909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:18.673864    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:40:17 +0000 UTC" deadline="2028-04-01 17:05:36.515857258 +0000 UTC"
Jul 09 18:45:18.673909 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:18.673900    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15166h20m17.841962168s"
Jul 09 18:45:18.736662 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:18.733801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:18.736662 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.733953    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:18.736662 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:18.734414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:18.736662 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.734524    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:18.736662 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:18.735879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:18.736662 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:18.735999    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:18.772815 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:18.772072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" event={"ID":"b500d70da3cf2cd4e34be1f2b83e6615","Type":"ContainerStarted","Data":"e777fcbbfd89f619fe2c825a6668c03f04d407fa345e759a65699ba9daada941"}
Jul 09 18:45:19.778557 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:19.778521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" event={"ID":"9dc67c69ca581dcacfd92f2924f3ec2c","Type":"ContainerStarted","Data":"39c3edbe38f31b08aad77ffd8923755c77e7112dadc9fb1cc73bcbb741237624"}
Jul 09 18:45:19.798007 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:19.797947    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" podStartSLOduration=3.797925952 podStartE2EDuration="3.797925952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:18.792713976 +0000 UTC m=+4.586838010" watchObservedRunningTime="2026-07-09 18:45:19.797925952 +0000 UTC m=+5.592049982"
Jul 09 18:45:20.362503 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:20.362462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:20.362731 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:20.362534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:20.362731 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.362698    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:20.362858 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.362764    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret podName:b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd nodeName:}" failed. No retries permitted until 2026-07-09 18:45:24.362743993 +0000 UTC m=+10.156868017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret") pod "global-pull-secret-syncer-g8kxr" (UID: "b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:20.363244 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.363221    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:20.363350 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.363282    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs podName:735851e3-381c-495a-a69b-ab40850b0010 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:24.363266017 +0000 UTC m=+10.157390048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs") pod "network-metrics-daemon-m2z8q" (UID: "735851e3-381c-495a-a69b-ab40850b0010") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:20.463420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:20.463381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcbf\" (UniqueName: \"kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf\") pod \"network-check-target-llcml\" (UID: \"fc403380-da26-468c-b063-64eb91ce0744\") " pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:20.463651 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.463590    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:20.463651 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.463612    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:20.463651 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.463624    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2tcbf for pod openshift-network-diagnostics/network-check-target-llcml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:20.463828 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.463686    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf podName:fc403380-da26-468c-b063-64eb91ce0744 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:24.463666753 +0000 UTC m=+10.257790780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tcbf" (UniqueName: "kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf") pod "network-check-target-llcml" (UID: "fc403380-da26-468c-b063-64eb91ce0744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:20.733844 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:20.733755    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:20.733844 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:20.733788    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:20.734069 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.733918    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:20.734069 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.734011    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:20.735240 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:20.735218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:20.735353 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:20.735314    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:22.733687 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:22.733645    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:22.734089 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:22.733653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:22.734089 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:22.733793    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:22.734089 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:22.733881    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:22.734089 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:22.733918    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:22.734089 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:22.733972    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:22.786689 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:22.786652    2581 generic.go:356] "Generic (PLEG): container finished" podID="9dc67c69ca581dcacfd92f2924f3ec2c" containerID="39c3edbe38f31b08aad77ffd8923755c77e7112dadc9fb1cc73bcbb741237624" exitCode=0
Jul 09 18:45:22.786843 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:22.786709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" event={"ID":"9dc67c69ca581dcacfd92f2924f3ec2c","Type":"ContainerDied","Data":"39c3edbe38f31b08aad77ffd8923755c77e7112dadc9fb1cc73bcbb741237624"}
Jul 09 18:45:24.398926 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:24.398883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:24.399349 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:24.398975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:24.399349 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.399110    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:24.399349 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.399171    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs podName:735851e3-381c-495a-a69b-ab40850b0010 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:32.399151096 +0000 UTC m=+18.193275107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs") pod "network-metrics-daemon-m2z8q" (UID: "735851e3-381c-495a-a69b-ab40850b0010") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:24.399630 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.399605    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:24.399711 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.399663    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret podName:b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd nodeName:}" failed. No retries permitted until 2026-07-09 18:45:32.399649575 +0000 UTC m=+18.193773583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret") pod "global-pull-secret-syncer-g8kxr" (UID: "b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:24.500240 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:24.500196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcbf\" (UniqueName: \"kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf\") pod \"network-check-target-llcml\" (UID: \"fc403380-da26-468c-b063-64eb91ce0744\") " pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:24.500439 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.500384    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:24.500439 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.500398    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:24.500439 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.500410    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2tcbf for pod openshift-network-diagnostics/network-check-target-llcml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:24.500585 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.500472    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf podName:fc403380-da26-468c-b063-64eb91ce0744 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:32.500452343 +0000 UTC m=+18.294576375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tcbf" (UniqueName: "kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf") pod "network-check-target-llcml" (UID: "fc403380-da26-468c-b063-64eb91ce0744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:24.733918 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:24.733228    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:24.733918 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.733332    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:24.733918 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:24.733690    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:24.733918 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.733821    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:24.734300 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:24.734268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:24.734394 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:24.734363    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:26.732224 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:26.732188    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:26.732224 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:26.732208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:26.732224 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:26.732208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:26.732697 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:26.732292    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:26.732697 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:26.732386    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:26.732697 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:26.732433    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:28.732301 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.732037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:28.732301 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:28.732287    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:28.732978 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.732351    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:28.732978 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:28.732481    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:28.732978 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.732567    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:28.732978 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:28.732642    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:28.820267 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.820234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" event={"ID":"9dc67c69ca581dcacfd92f2924f3ec2c","Type":"ContainerStarted","Data":"622de140dddc9f39076f36d6bb4781c7bc235f092c51446a97846df8ba481304"}
Jul 09 18:45:28.822006 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.821979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-htlst" event={"ID":"76039738-c73a-4be3-95a1-2f46e01435ad","Type":"ContainerStarted","Data":"16acf4ca279012a76d8fe51d2177f34888cd740e7c1fd1ce80a41f7b5cdc0d39"}
Jul 09 18:45:28.823552 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.823508    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qmwc2" event={"ID":"020156c9-40a9-4a45-bca2-f7be8c8a8bb2","Type":"ContainerStarted","Data":"045dd918c36b498a7781af2950d6d922635daafc792c8e9e5e663e98818c2964"}
Jul 09 18:45:28.825223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.825196    2581 generic.go:356] "Generic (PLEG): container finished" podID="a9158700-77bf-4a4c-bcd0-7b4044d2cafc" containerID="7b4d52916522f4d92e245670b9caf6902909683138a1906e031118d08f9cc9fa" exitCode=0
Jul 09 18:45:28.825324 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.825279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2cjm" event={"ID":"a9158700-77bf-4a4c-bcd0-7b4044d2cafc","Type":"ContainerDied","Data":"7b4d52916522f4d92e245670b9caf6902909683138a1906e031118d08f9cc9fa"}
Jul 09 18:45:28.826901 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.826885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7" event={"ID":"aaaafc11-a974-4e04-aed4-e6cdafde5f9b","Type":"ContainerStarted","Data":"f928b14449b9f9fae4f950b653bcf4902a58aa3816ce78d7d08fea2be7ee02e7"}
Jul 09 18:45:28.828353 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.828320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zrgtd" event={"ID":"cbe257a6-701c-4e95-8bd5-327628080f1f","Type":"ContainerStarted","Data":"4da1a6b74a837326e2d96486e17a82afeaf1c87987fc5fcd85b5a2e8aa0677cf"}
Jul 09 18:45:28.829981 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.829962    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vvq6l" event={"ID":"5561e5bc-2db6-45b2-ba6f-02f141a62cd8","Type":"ContainerStarted","Data":"bc8f8aa65b411efb3292c23f00460630deed007674d37a9059707ccb5ec960dd"}
Jul 09 18:45:28.841850 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.841799    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" podStartSLOduration=12.841782467 podStartE2EDuration="12.841782467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:28.841432441 +0000 UTC m=+14.635556497" watchObservedRunningTime="2026-07-09 18:45:28.841782467 +0000 UTC m=+14.635906497"
Jul 09 18:45:28.857087 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.857045    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-htlst" podStartSLOduration=2.755985495 podStartE2EDuration="13.85702763s" totalImagesPullingTime="11.101042135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:28.856827246 +0000 UTC m=+14.650951303" watchObservedRunningTime="2026-07-09 18:45:28.85702763 +0000 UTC m=+14.651151660"
Jul 09 18:45:28.873023 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.872975    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zrgtd" podStartSLOduration=2.783026575 podStartE2EDuration="13.872956972s" totalImagesPullingTime="11.089930397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:28.872595079 +0000 UTC m=+14.666719135" watchObservedRunningTime="2026-07-09 18:45:28.872956972 +0000 UTC m=+14.667081004"
Jul 09 18:45:28.914358 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.914298    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vvq6l" podStartSLOduration=2.772050763 podStartE2EDuration="13.914281174s" totalImagesPullingTime="11.142230411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:28.888245686 +0000 UTC m=+14.682369716" watchObservedRunningTime="2026-07-09 18:45:28.914281174 +0000 UTC m=+14.708405205"
Jul 09 18:45:28.931178 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:28.931133    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qmwc2" podStartSLOduration=2.524419665 podStartE2EDuration="13.931119596s" totalImagesPullingTime="11.406699931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:28.93056736 +0000 UTC m=+14.724691380" watchObservedRunningTime="2026-07-09 18:45:28.931119596 +0000 UTC m=+14.725243625"
Jul 09 18:45:29.834389 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:29.834302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9rcc8" event={"ID":"50e7bc18-fcb6-451e-b4c4-c588082e69aa","Type":"ContainerStarted","Data":"fa88f92dd9027aad5e3bc46aa9ef47545b52cb6d2f7c3583005dbcd254fde220"}
Jul 09 18:45:29.852366 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:29.852321    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9rcc8" podStartSLOduration=3.740087301 podStartE2EDuration="14.852301502s" totalImagesPullingTime="11.112214201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:29.851683875 +0000 UTC m=+15.645807907" watchObservedRunningTime="2026-07-09 18:45:29.852301502 +0000 UTC m=+15.646425532"
Jul 09 18:45:30.567907 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:30.567860    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:30.568518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:30.568485    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:30.732519 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:30.732488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:30.732712 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:30.732488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:30.732712 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:30.732488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:30.732712 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:30.732639    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:30.732712 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:30.732689    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:30.732845 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:30.732775    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:30.837214 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:30.837138    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:30.837664 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:30.837487    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vvq6l"
Jul 09 18:45:32.462272 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:32.462240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:32.462829 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:32.462290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:32.462829 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.462388    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:32.462829 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.462392    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:32.462829 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.462435    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret podName:b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd nodeName:}" failed. No retries permitted until 2026-07-09 18:45:48.462421518 +0000 UTC m=+34.256545525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret") pod "global-pull-secret-syncer-g8kxr" (UID: "b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:32.462829 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.462447    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs podName:735851e3-381c-495a-a69b-ab40850b0010 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:48.462441189 +0000 UTC m=+34.256565196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs") pod "network-metrics-daemon-m2z8q" (UID: "735851e3-381c-495a-a69b-ab40850b0010") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:32.563083 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:32.563043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcbf\" (UniqueName: \"kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf\") pod \"network-check-target-llcml\" (UID: \"fc403380-da26-468c-b063-64eb91ce0744\") " pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:32.563258 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.563209    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:32.563258 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.563229    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:32.563258 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.563239    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2tcbf for pod openshift-network-diagnostics/network-check-target-llcml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:32.563422 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.563293    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf podName:fc403380-da26-468c-b063-64eb91ce0744 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:48.563279544 +0000 UTC m=+34.357403554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tcbf" (UniqueName: "kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf") pod "network-check-target-llcml" (UID: "fc403380-da26-468c-b063-64eb91ce0744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:32.732752 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:32.732659    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:32.732916 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:32.732658    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:32.732916 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:32.732821    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:32.732916 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.732786    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:32.733049 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.732936    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:32.733049 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:32.733014    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:34.733511 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:34.733322    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:34.733959 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:34.733392    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:34.733959 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:34.733629    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:34.733959 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:34.733736    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:34.733959 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:34.733413    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:34.733959 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:34.733850    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:36.733436 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:36.732726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:36.733436 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:36.732858    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:36.733436 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:36.732726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:36.733436 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:36.733231    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:36.733436 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:36.733322    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:36.733436 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:36.733400    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:36.987470 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:36.987439    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 18:45:37.692833 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.692416    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T18:45:36.987457835Z","UUID":"910ba264-e395-4b0f-9d4c-a46469bca0a4","Handler":null,"Name":"","Endpoint":""}
Jul 09 18:45:37.695481 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.695455    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 18:45:37.695656 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.695503    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 18:45:37.853274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.853238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7" event={"ID":"aaaafc11-a974-4e04-aed4-e6cdafde5f9b","Type":"ContainerStarted","Data":"89c8ea9e880a13f9d651923b3608729761a2670cab402f40a03de9d2e81b9f64"}
Jul 09 18:45:37.855114 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.855080    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t8wc8" event={"ID":"4091e474-68c7-4a0e-9c55-7bd741bd65cc","Type":"ContainerStarted","Data":"428085ee422d22a23ec541ff262938b92d775e7dd7e34a17e5ebafc4863bfec8"}
Jul 09 18:45:37.858078 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.858055    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 18:45:37.858428 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.858400    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b9a8392-e896-4032-a97b-645d8fba6b45" containerID="ac2629376d2531a48f8c666fc98b6e63c00362c8ed4e66121f8a2a286d59aac2" exitCode=1
Jul 09 18:45:37.858604 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.858439    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" event={"ID":"4b9a8392-e896-4032-a97b-645d8fba6b45","Type":"ContainerStarted","Data":"a07915c89199955e25f3a7f769b43fcb87ea29ef488e568fdeca5cc0adf1ae0a"}
Jul 09 18:45:37.858604 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.858500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" event={"ID":"4b9a8392-e896-4032-a97b-645d8fba6b45","Type":"ContainerStarted","Data":"a957fb449de91aa7a93bfc4b9233f4984bb08016fc9ae5f9059b2aa6ad7ae4c7"}
Jul 09 18:45:37.858604 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.858530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" event={"ID":"4b9a8392-e896-4032-a97b-645d8fba6b45","Type":"ContainerStarted","Data":"783bd20a8d5046ec7db23a74ebbde0cc8915c3c4b09678d09ffd4d55a1cb07fb"}
Jul 09 18:45:37.858604 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.858575    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" event={"ID":"4b9a8392-e896-4032-a97b-645d8fba6b45","Type":"ContainerStarted","Data":"4b173f8d5efb2325dcf40f46d213e638b60c38b99a53e89faffb7d2c6febac8d"}
Jul 09 18:45:37.858604 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.858603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" event={"ID":"4b9a8392-e896-4032-a97b-645d8fba6b45","Type":"ContainerDied","Data":"ac2629376d2531a48f8c666fc98b6e63c00362c8ed4e66121f8a2a286d59aac2"}
Jul 09 18:45:37.858819 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.858658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" event={"ID":"4b9a8392-e896-4032-a97b-645d8fba6b45","Type":"ContainerStarted","Data":"32aae6127d33905b24d1aa65ba2c6e79617f0dab23448488c25d855499630ac2"}
Jul 09 18:45:37.874288 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:37.874244    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t8wc8" podStartSLOduration=3.011608651 podStartE2EDuration="22.874228783s" totalImagesPullingTime="19.862620132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:37.873891724 +0000 UTC m=+23.668015757" watchObservedRunningTime="2026-07-09 18:45:37.874228783 +0000 UTC m=+23.668352814"
Jul 09 18:45:38.732654 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:38.732614    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:38.732845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:38.732614    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:38.732845 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:38.732750    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:38.732845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:38.732760    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:38.733003 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:38.732852    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:38.733003 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:38.732926    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:38.863323 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:38.863289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7" event={"ID":"aaaafc11-a974-4e04-aed4-e6cdafde5f9b","Type":"ContainerStarted","Data":"7882950ab6f1b423e9b2e55142c5bb5a68e4e056b26966af13662c8875397a24"}
Jul 09 18:45:38.887371 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:38.887290    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8rr7" podStartSLOduration=2.743694829 podStartE2EDuration="23.887277185s" totalImagesPullingTime="21.143582356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:38.886853152 +0000 UTC m=+24.680977179" watchObservedRunningTime="2026-07-09 18:45:38.887277185 +0000 UTC m=+24.681401214"
Jul 09 18:45:39.868115 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:39.868041    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 18:45:39.868514 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:39.868384    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" event={"ID":"4b9a8392-e896-4032-a97b-645d8fba6b45","Type":"ContainerStarted","Data":"222ee0d5e6628471ce318dc9807ac57edc27c46206ae889afaa948b5d387e5ee"}
Jul 09 18:45:40.733010 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:40.732554    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:40.733010 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:40.732597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:40.733010 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:40.732567    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:40.733010 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:40.732694    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:40.733010 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:40.732830    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:40.733010 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:40.732906    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:42.732090 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:42.731837    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:42.732695 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:42.731854    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:42.732695 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:42.732117    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:42.732695 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:42.731889    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:42.732695 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:42.732211    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:42.732695 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:42.732287    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:42.878801 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:42.878775    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 18:45:42.879223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:42.879204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" event={"ID":"4b9a8392-e896-4032-a97b-645d8fba6b45","Type":"ContainerStarted","Data":"fe7712a95a5f96dd364abb8a27a187792bdbdfa0d4a8de70a8b06753080a4677"}
Jul 09 18:45:42.879460 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:42.879438    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:42.879647 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:42.879625    2581 scope.go:117] "RemoveContainer" containerID="ac2629376d2531a48f8c666fc98b6e63c00362c8ed4e66121f8a2a286d59aac2"
Jul 09 18:45:42.881320 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:42.881296    2581 generic.go:356] "Generic (PLEG): container finished" podID="a9158700-77bf-4a4c-bcd0-7b4044d2cafc" containerID="f92d42d70ba1ec84aa52eb436a2b169294cf09245ee9415f8aceecd5d90c0710" exitCode=0
Jul 09 18:45:42.881414 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:42.881339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2cjm" event={"ID":"a9158700-77bf-4a4c-bcd0-7b4044d2cafc","Type":"ContainerDied","Data":"f92d42d70ba1ec84aa52eb436a2b169294cf09245ee9415f8aceecd5d90c0710"}
Jul 09 18:45:42.896261 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:42.896242    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:43.888452 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:43.888432    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 18:45:43.888883 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:43.888854    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" event={"ID":"4b9a8392-e896-4032-a97b-645d8fba6b45","Type":"ContainerStarted","Data":"1c2130c8e21fc1ce4d1d10dedbe4be2aceb63a53d908d39f755d5c02f36fa2eb"}
Jul 09 18:45:43.889311 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:43.889025    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:43.889311 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:43.889217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:43.907411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:43.907385    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:45:43.927877 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:43.927804    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7" podStartSLOduration=9.032982793 podStartE2EDuration="28.927783653s" totalImagesPullingTime="19.89480086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:43.926991792 +0000 UTC m=+29.721115853" watchObservedRunningTime="2026-07-09 18:45:43.927783653 +0000 UTC m=+29.721907682"
Jul 09 18:45:44.175730 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:44.175650    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g8kxr"]
Jul 09 18:45:44.175875 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:44.175792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:44.175934 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:44.175896    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:44.176332 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:44.176310    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-llcml"]
Jul 09 18:45:44.176407 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:44.176397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:44.176477 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:44.176462    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:44.177861 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:44.177839    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m2z8q"]
Jul 09 18:45:44.177955 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:44.177943    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:44.178061 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:44.178043    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:44.893344 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:44.893305    2581 generic.go:356] "Generic (PLEG): container finished" podID="a9158700-77bf-4a4c-bcd0-7b4044d2cafc" containerID="d0709888501e0122d04cf7ca621192a6ce307e74f4e46231e9595e7b840ec27d" exitCode=0
Jul 09 18:45:44.893746 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:44.893390    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2cjm" event={"ID":"a9158700-77bf-4a4c-bcd0-7b4044d2cafc","Type":"ContainerDied","Data":"d0709888501e0122d04cf7ca621192a6ce307e74f4e46231e9595e7b840ec27d"}
Jul 09 18:45:45.733348 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:45.732764    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:45.733348 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:45.733120    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:45.733348 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:45.733237    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:45.733348 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:45.733345    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:45.733786 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:45.733418    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:45.733786 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:45.733511    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:46.900507 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:46.900478    2581 generic.go:356] "Generic (PLEG): container finished" podID="a9158700-77bf-4a4c-bcd0-7b4044d2cafc" containerID="4933f2a30784aec20056e249a116dda9caaab2a0299bd590364d47877d437364" exitCode=0
Jul 09 18:45:46.901229 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:46.900530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2cjm" event={"ID":"a9158700-77bf-4a4c-bcd0-7b4044d2cafc","Type":"ContainerDied","Data":"4933f2a30784aec20056e249a116dda9caaab2a0299bd590364d47877d437364"}
Jul 09 18:45:47.732690 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:47.732656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:47.732690 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:47.732694    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:47.732690 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:47.732695    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:47.732991 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:47.732773    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-llcml" podUID="fc403380-da26-468c-b063-64eb91ce0744"
Jul 09 18:45:47.732991 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:47.732879    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2z8q" podUID="735851e3-381c-495a-a69b-ab40850b0010"
Jul 09 18:45:47.732991 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:47.732948    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8kxr" podUID="b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd"
Jul 09 18:45:48.482688 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:48.482657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:48.483229 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:48.482708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:48.483229 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:48.482821    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:48.483229 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:48.482821    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:48.483229 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:48.482890    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs podName:735851e3-381c-495a-a69b-ab40850b0010 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:20.482869467 +0000 UTC m=+66.276993477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs") pod "network-metrics-daemon-m2z8q" (UID: "735851e3-381c-495a-a69b-ab40850b0010") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:48.483229 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:48.482904    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret podName:b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd nodeName:}" failed. No retries permitted until 2026-07-09 18:46:20.482898129 +0000 UTC m=+66.277022136 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret") pod "global-pull-secret-syncer-g8kxr" (UID: "b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:48.584004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:48.583964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcbf\" (UniqueName: \"kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf\") pod \"network-check-target-llcml\" (UID: \"fc403380-da26-468c-b063-64eb91ce0744\") " pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:48.584174 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:48.584152    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:48.584220 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:48.584186    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:48.584220 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:48.584201    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2tcbf for pod openshift-network-diagnostics/network-check-target-llcml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:48.584285 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:48.584269    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf podName:fc403380-da26-468c-b063-64eb91ce0744 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:20.584250446 +0000 UTC m=+66.378374457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tcbf" (UniqueName: "kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf") pod "network-check-target-llcml" (UID: "fc403380-da26-468c-b063-64eb91ce0744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:49.508343 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.508312    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeReady"
Jul 09 18:45:49.508777 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.508479    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 18:45:49.549895 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.549820    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c8ffbb88d-964xl"]
Jul 09 18:45:49.552288 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.551904    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.555327 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.555294    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 18:45:49.555861 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.555834    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 18:45:49.555952 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.555862    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 18:45:49.555952 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.555898    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l92kj\""
Jul 09 18:45:49.563741 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.563716    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 18:45:49.564997 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.564979    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xtq28"]
Jul 09 18:45:49.566667 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.566645    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.567363 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.567341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c8ffbb88d-964xl"]
Jul 09 18:45:49.569437 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.569418    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 18:45:49.569437 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.569434    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 18:45:49.569626 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.569455    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5t98t\""
Jul 09 18:45:49.571508 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.571488    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kfsz9"]
Jul 09 18:45:49.573337 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.573319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kfsz9"
Jul 09 18:45:49.575930 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.575909    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9zdkl\""
Jul 09 18:45:49.576033 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.575949    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 18:45:49.576406 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.576348    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 18:45:49.576406 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.576375    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 18:45:49.579650 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.579630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xtq28"]
Jul 09 18:45:49.583216 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.582868    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kfsz9"]
Jul 09 18:45:49.692916 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.692881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-trusted-ca\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.693068 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.692944    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-installation-pull-secrets\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.693068 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.692978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn27f\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-kube-api-access-zn27f\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.693068 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-certificates\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.693068 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-bound-sa-token\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.693068 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-tmp-dir\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.693254 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-config-volume\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.693254 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.693254 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4d9w\" (UniqueName: \"kubernetes.io/projected/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-kube-api-access-f4d9w\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.693254 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prvbp\" (UniqueName: \"kubernetes.io/projected/5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd-kube-api-access-prvbp\") pod \"ingress-canary-kfsz9\" (UID: \"5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd\") " pod="openshift-ingress-canary/ingress-canary-kfsz9"
Jul 09 18:45:49.693254 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdcac358-1e73-45c9-989b-762ea2c267bd-ca-trust-extracted\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.693254 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693226    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.693430 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693287    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd-cert\") pod \"ingress-canary-kfsz9\" (UID: \"5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd\") " pod="openshift-ingress-canary/ingress-canary-kfsz9"
Jul 09 18:45:49.693430 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.693314    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-image-registry-private-configuration\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.732798 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.732282    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:45:49.732798 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.732330    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:45:49.732798 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.732330    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:45:49.737664 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.737639    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:45:49.737664 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.737656    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:45:49.737875 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.737649    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:45:49.737875 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.737650    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-prgmc\""
Jul 09 18:45:49.738286 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.738268    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ckpt2\""
Jul 09 18:45:49.738286 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.738285    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:45:49.794636 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.794602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdcac358-1e73-45c9-989b-762ea2c267bd-ca-trust-extracted\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.794781 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.794650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.794781 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.794706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd-cert\") pod \"ingress-canary-kfsz9\" (UID: \"5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd\") " pod="openshift-ingress-canary/ingress-canary-kfsz9"
Jul 09 18:45:49.794781 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.794725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-image-registry-private-configuration\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.794781 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.794753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-trusted-ca\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.794964 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.794821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-installation-pull-secrets\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:49.795380    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:49.795406    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8ffbb88d-964xl: secret "image-registry-tls" not found
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:49.795475    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls podName:cdcac358-1e73-45c9-989b-762ea2c267bd nodeName:}" failed. No retries permitted until 2026-07-09 18:45:50.295455144 +0000 UTC m=+36.089579152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls") pod "image-registry-5c8ffbb88d-964xl" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd") : secret "image-registry-tls" not found
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.794848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn27f\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-kube-api-access-zn27f\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.796241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-certificates\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.796331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-trusted-ca\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.796855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-bound-sa-token\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.797122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdcac358-1e73-45c9-989b-762ea2c267bd-ca-trust-extracted\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.797391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-tmp-dir\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.797710    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-certificates\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.797625    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-config-volume\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.797871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.797914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4d9w\" (UniqueName: \"kubernetes.io/projected/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-kube-api-access-f4d9w\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.798191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-tmp-dir\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.798245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvbp\" (UniqueName: \"kubernetes.io/projected/5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd-kube-api-access-prvbp\") pod \"ingress-canary-kfsz9\" (UID: \"5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd\") " pod="openshift-ingress-canary/ingress-canary-kfsz9"
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:49.798581    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:45:49.799785 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.798760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-config-volume\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.800559 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:49.799810    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls podName:482b4db1-4b68-44ec-8b1d-eb5a8d720d43 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:50.299783024 +0000 UTC m=+36.093907035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls") pod "dns-default-xtq28" (UID: "482b4db1-4b68-44ec-8b1d-eb5a8d720d43") : secret "dns-default-metrics-tls" not found
Jul 09 18:45:49.800559 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.800497    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-image-registry-private-configuration\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.800638 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.800575    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd-cert\") pod \"ingress-canary-kfsz9\" (UID: \"5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd\") " pod="openshift-ingress-canary/ingress-canary-kfsz9"
Jul 09 18:45:49.800638 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.800578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-installation-pull-secrets\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.806836 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.806812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn27f\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-kube-api-access-zn27f\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.807218 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.807179    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-bound-sa-token\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:49.808965 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.808933    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvbp\" (UniqueName: \"kubernetes.io/projected/5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd-kube-api-access-prvbp\") pod \"ingress-canary-kfsz9\" (UID: \"5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd\") " pod="openshift-ingress-canary/ingress-canary-kfsz9"
Jul 09 18:45:49.809623 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.809602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4d9w\" (UniqueName: \"kubernetes.io/projected/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-kube-api-access-f4d9w\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:49.886854 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:49.886818    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kfsz9"
Jul 09 18:45:50.303740 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:50.303695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:50.303740 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:50.303747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:50.303976 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:50.303856    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:45:50.303976 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:50.303869    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8ffbb88d-964xl: secret "image-registry-tls" not found
Jul 09 18:45:50.303976 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:50.303869    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:45:50.303976 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:50.303937    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls podName:cdcac358-1e73-45c9-989b-762ea2c267bd nodeName:}" failed. No retries permitted until 2026-07-09 18:45:51.303922893 +0000 UTC m=+37.098046899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls") pod "image-registry-5c8ffbb88d-964xl" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd") : secret "image-registry-tls" not found
Jul 09 18:45:50.303976 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:50.303949    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls podName:482b4db1-4b68-44ec-8b1d-eb5a8d720d43 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:51.303943827 +0000 UTC m=+37.098067834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls") pod "dns-default-xtq28" (UID: "482b4db1-4b68-44ec-8b1d-eb5a8d720d43") : secret "dns-default-metrics-tls" not found
Jul 09 18:45:51.312040 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:51.311880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:51.312467 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:51.312062    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:45:51.312467 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:51.312083    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8ffbb88d-964xl: secret "image-registry-tls" not found
Jul 09 18:45:51.312467 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:51.312127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:51.312467 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:51.312147    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls podName:cdcac358-1e73-45c9-989b-762ea2c267bd nodeName:}" failed. No retries permitted until 2026-07-09 18:45:53.312126766 +0000 UTC m=+39.106250775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls") pod "image-registry-5c8ffbb88d-964xl" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd") : secret "image-registry-tls" not found
Jul 09 18:45:51.312467 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:51.312219    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:45:51.312467 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:51.312275    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls podName:482b4db1-4b68-44ec-8b1d-eb5a8d720d43 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:53.312259803 +0000 UTC m=+39.106383810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls") pod "dns-default-xtq28" (UID: "482b4db1-4b68-44ec-8b1d-eb5a8d720d43") : secret "dns-default-metrics-tls" not found
Jul 09 18:45:51.329025 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:51.328996    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kfsz9"]
Jul 09 18:45:51.333716 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:45:51.333685    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c237efc_5b7f_4eb1_b3e1_0e842ca51fdd.slice/crio-f2e8c268127d24895b18324d23f4a1302020a1a48d93d05adb209c0c8c6d108e WatchSource:0}: Error finding container f2e8c268127d24895b18324d23f4a1302020a1a48d93d05adb209c0c8c6d108e: Status 404 returned error can't find the container with id f2e8c268127d24895b18324d23f4a1302020a1a48d93d05adb209c0c8c6d108e
Jul 09 18:45:51.913789 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:51.913753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kfsz9" event={"ID":"5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd","Type":"ContainerStarted","Data":"f2e8c268127d24895b18324d23f4a1302020a1a48d93d05adb209c0c8c6d108e"}
Jul 09 18:45:51.916314 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:51.916285    2581 generic.go:356] "Generic (PLEG): container finished" podID="a9158700-77bf-4a4c-bcd0-7b4044d2cafc" containerID="a9ec97383b9b0ff9756e41d771624dc259b1c5fb11bc691768e9de8d2daca96e" exitCode=0
Jul 09 18:45:51.916419 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:51.916324    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2cjm" event={"ID":"a9158700-77bf-4a4c-bcd0-7b4044d2cafc","Type":"ContainerDied","Data":"a9ec97383b9b0ff9756e41d771624dc259b1c5fb11bc691768e9de8d2daca96e"}
Jul 09 18:45:52.920946 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:52.920913    2581 generic.go:356] "Generic (PLEG): container finished" podID="a9158700-77bf-4a4c-bcd0-7b4044d2cafc" containerID="92d681634340a94b309d784a587f7f8812f71b8116b1b729eb7d1dab5437f89f" exitCode=0
Jul 09 18:45:52.921285 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:52.920962    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2cjm" event={"ID":"a9158700-77bf-4a4c-bcd0-7b4044d2cafc","Type":"ContainerDied","Data":"92d681634340a94b309d784a587f7f8812f71b8116b1b729eb7d1dab5437f89f"}
Jul 09 18:45:53.217122 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.216894    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"]
Jul 09 18:45:53.218925 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.218908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:53.221656 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.221632    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 09 18:45:53.223102 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.223088    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 18:45:53.225622 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.225598    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 18:45:53.226487 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.226111    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hrchs\""
Jul 09 18:45:53.228247 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.227002    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 09 18:45:53.236185 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.236156    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"]
Jul 09 18:45:53.328897 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.328868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:53.329062 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.328904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:53.329062 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.328927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:53.329062 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.328950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:53.329062 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.329010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6c9g\" (UniqueName: \"kubernetes.io/projected/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-kube-api-access-w6c9g\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:53.329062 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.329050    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:45:53.329278 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.329076    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:45:53.329278 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.329091    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8ffbb88d-964xl: secret "image-registry-tls" not found
Jul 09 18:45:53.329278 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.329105    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls podName:482b4db1-4b68-44ec-8b1d-eb5a8d720d43 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:57.329087508 +0000 UTC m=+43.123211527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls") pod "dns-default-xtq28" (UID: "482b4db1-4b68-44ec-8b1d-eb5a8d720d43") : secret "dns-default-metrics-tls" not found
Jul 09 18:45:53.329278 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.329131    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls podName:cdcac358-1e73-45c9-989b-762ea2c267bd nodeName:}" failed. No retries permitted until 2026-07-09 18:45:57.3291187 +0000 UTC m=+43.123242707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls") pod "image-registry-5c8ffbb88d-964xl" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd") : secret "image-registry-tls" not found
Jul 09 18:45:53.336267 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.336239    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-dd6d8cb96-bbfgl"]
Jul 09 18:45:53.338160 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.338139    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.342488 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.342472    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 09 18:45:53.342790 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.342774    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 09 18:45:53.342875 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.342859    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 18:45:53.343318 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.343302    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 09 18:45:53.343439 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.343414    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vtrk8\""
Jul 09 18:45:53.343642 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.343627    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 18:45:53.343705 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.343655    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 09 18:45:53.360376 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.360337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dd6d8cb96-bbfgl"]
Jul 09 18:45:53.429712 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.429679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:53.429712 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.429715    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvv2l\" (UniqueName: \"kubernetes.io/projected/ad4227bf-dec9-4ad3-87f0-a369b054e449-kube-api-access-mvv2l\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.429932 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.429744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:53.429932 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.429763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-stats-auth\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.429932 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.429787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.429932 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.429816    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 18:45:53.429932 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.429922    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls podName:e5fe7c21-4264-4cd4-a06c-65ea61b3994f nodeName:}" failed. No retries permitted until 2026-07-09 18:45:53.929900306 +0000 UTC m=+39.724024314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-br5dg" (UID: "e5fe7c21-4264-4cd4-a06c-65ea61b3994f") : secret "cluster-monitoring-operator-tls" not found
Jul 09 18:45:53.430176 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.429948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6c9g\" (UniqueName: \"kubernetes.io/projected/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-kube-api-access-w6c9g\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:53.430176 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.430000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-default-certificate\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.430176 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.430041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.430513 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.430492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:53.447636 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.447613    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6c9g\" (UniqueName: \"kubernetes.io/projected/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-kube-api-access-w6c9g\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:53.530660 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.530581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-default-certificate\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.530660 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.530638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.530822 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.530718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvv2l\" (UniqueName: \"kubernetes.io/projected/ad4227bf-dec9-4ad3-87f0-a369b054e449-kube-api-access-mvv2l\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.530822 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.530744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-stats-auth\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.530822 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.530766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.530912 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.530841    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:54.030820531 +0000 UTC m=+39.824944558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : configmap references non-existent config key: service-ca.crt
Jul 09 18:45:53.530912 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.530872    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:45:53.530992 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.530932    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:54.030916715 +0000 UTC m=+39.825040722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : secret "router-metrics-certs-default" not found
Jul 09 18:45:53.533226 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.533201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-default-certificate\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.533329 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.533213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-stats-auth\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.540442 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.540421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvv2l\" (UniqueName: \"kubernetes.io/projected/ad4227bf-dec9-4ad3-87f0-a369b054e449-kube-api-access-mvv2l\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:53.928174 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.928133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2cjm" event={"ID":"a9158700-77bf-4a4c-bcd0-7b4044d2cafc","Type":"ContainerStarted","Data":"1328ced24a390636207a389502fa1b190d54869d7ce8437849a728e7dfa58782"}
Jul 09 18:45:53.934362 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.934326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:53.934494 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.934475    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 18:45:53.934590 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:53.934561    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls podName:e5fe7c21-4264-4cd4-a06c-65ea61b3994f nodeName:}" failed. No retries permitted until 2026-07-09 18:45:54.934525913 +0000 UTC m=+40.728649940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-br5dg" (UID: "e5fe7c21-4264-4cd4-a06c-65ea61b3994f") : secret "cluster-monitoring-operator-tls" not found
Jul 09 18:45:53.962064 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:53.962008    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p2cjm" podStartSLOduration=7.621851884 podStartE2EDuration="38.961988634s" totalImagesPullingTime="31.34013675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:53.960139269 +0000 UTC m=+39.754263323" watchObservedRunningTime="2026-07-09 18:45:53.961988634 +0000 UTC m=+39.756112663"
Jul 09 18:45:54.035064 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:54.035030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:54.035223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:54.035136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:54.035223 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:54.035203    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:55.035183662 +0000 UTC m=+40.829307684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : configmap references non-existent config key: service-ca.crt
Jul 09 18:45:54.035367 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:54.035316    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:45:54.035422 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:54.035385    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:55.035365748 +0000 UTC m=+40.829489772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : secret "router-metrics-certs-default" not found
Jul 09 18:45:54.932876 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:54.932839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kfsz9" event={"ID":"5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd","Type":"ContainerStarted","Data":"0dbdbb8d53e5e3957acea17a812dafebf89cd5891aab7aeb42b2c9c12670ce29"}
Jul 09 18:45:54.942678 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:54.942652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:54.942844 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:54.942823    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 18:45:54.942915 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:54.942904    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls podName:e5fe7c21-4264-4cd4-a06c-65ea61b3994f nodeName:}" failed. No retries permitted until 2026-07-09 18:45:56.942883879 +0000 UTC m=+42.737007886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-br5dg" (UID: "e5fe7c21-4264-4cd4-a06c-65ea61b3994f") : secret "cluster-monitoring-operator-tls" not found
Jul 09 18:45:54.955669 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:54.955629    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kfsz9" podStartSLOduration=2.491452931 podStartE2EDuration="5.955614343s" totalImagesPullingTime="3.464161412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:54.954871646 +0000 UTC m=+40.748995709" watchObservedRunningTime="2026-07-09 18:45:54.955614343 +0000 UTC m=+40.749738371"
Jul 09 18:45:55.043648 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:55.043612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:55.043910 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:55.043886    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:45:55.044002 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:55.043967    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:57.043945321 +0000 UTC m=+42.838069353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : secret "router-metrics-certs-default" not found
Jul 09 18:45:55.044002 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:55.043991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:55.044115 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:55.044098    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:57.044087123 +0000 UTC m=+42.838211130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : configmap references non-existent config key: service-ca.crt
Jul 09 18:45:56.960186 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:56.960152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:45:56.960696 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:56.960312    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 18:45:56.960696 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:56.960371    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls podName:e5fe7c21-4264-4cd4-a06c-65ea61b3994f nodeName:}" failed. No retries permitted until 2026-07-09 18:46:00.960355958 +0000 UTC m=+46.754479964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-br5dg" (UID: "e5fe7c21-4264-4cd4-a06c-65ea61b3994f") : secret "cluster-monitoring-operator-tls" not found
Jul 09 18:45:57.060945 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:57.060910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:57.061094 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:57.060986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:45:57.061094 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:57.061060    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:45:57.061206 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:57.061116    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:01.06109556 +0000 UTC m=+46.855219581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : configmap references non-existent config key: service-ca.crt
Jul 09 18:45:57.061206 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:57.061142    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:01.061131299 +0000 UTC m=+46.855255310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : secret "router-metrics-certs-default" not found
Jul 09 18:45:57.363062 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:57.363026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:45:57.363220 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:45:57.363132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:45:57.363220 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:57.363210    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:45:57.363336 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:57.363232    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8ffbb88d-964xl: secret "image-registry-tls" not found
Jul 09 18:45:57.363336 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:57.363240    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:45:57.363336 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:57.363289    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls podName:482b4db1-4b68-44ec-8b1d-eb5a8d720d43 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:05.363274332 +0000 UTC m=+51.157398339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls") pod "dns-default-xtq28" (UID: "482b4db1-4b68-44ec-8b1d-eb5a8d720d43") : secret "dns-default-metrics-tls" not found
Jul 09 18:45:57.363336 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:45:57.363301    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls podName:cdcac358-1e73-45c9-989b-762ea2c267bd nodeName:}" failed. No retries permitted until 2026-07-09 18:46:05.363295824 +0000 UTC m=+51.157419831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls") pod "image-registry-5c8ffbb88d-964xl" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd") : secret "image-registry-tls" not found
Jul 09 18:46:00.795840 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.795808    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x2bcx"]
Jul 09 18:46:00.804639 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.804614    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.807348 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.807322    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 18:46:00.807443 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.807345    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 18:46:00.808578 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.808521    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 18:46:00.808578 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.808576    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 18:46:00.808745 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.808653    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qssxl\""
Jul 09 18:46:00.810480 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.810463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x2bcx"]
Jul 09 18:46:00.886399 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.886366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-crio-socket\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.886572 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.886416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.886572 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.886483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxgjr\" (UniqueName: \"kubernetes.io/projected/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-api-access-xxgjr\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.886572 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.886527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-data-volume\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.886711 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.886602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.987640 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.987607    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxgjr\" (UniqueName: \"kubernetes.io/projected/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-api-access-xxgjr\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.987640 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.987645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-data-volume\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.987830 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.987676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:46:00.987830 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:00.987755    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 18:46:00.987830 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.987791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.987830 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:00.987806    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls podName:e5fe7c21-4264-4cd4-a06c-65ea61b3994f nodeName:}" failed. No retries permitted until 2026-07-09 18:46:08.987793786 +0000 UTC m=+54.781917794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-br5dg" (UID: "e5fe7c21-4264-4cd4-a06c-65ea61b3994f") : secret "cluster-monitoring-operator-tls" not found
Jul 09 18:46:00.988000 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.987903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-crio-socket\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.988000 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:00.987926    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:00.988000 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.987950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.988000 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.987973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-data-volume\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.988137 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:00.988042    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:01.488029033 +0000 UTC m=+47.282153039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:00.988137 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:00.988058    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:46:00.988137 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:00.988108    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:01.488094236 +0000 UTC m=+47.282218256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : configmap "kube-rbac-proxy" not found
Jul 09 18:46:00.988137 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.988113    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-crio-socket\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:00.997352 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:00.997320    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxgjr\" (UniqueName: \"kubernetes.io/projected/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-api-access-xxgjr\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:01.088458 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:01.088428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:01.088637 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:01.088511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:01.088637 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:01.088609    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:09.088590209 +0000 UTC m=+54.882714215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : configmap references non-existent config key: service-ca.crt
Jul 09 18:46:01.088637 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:01.088630    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:46:01.088774 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:01.088677    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:09.088665259 +0000 UTC m=+54.882789266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : secret "router-metrics-certs-default" not found
Jul 09 18:46:01.492076 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:01.491848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:01.492224 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:01.492087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:01.492224 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:01.492001    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:01.492224 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:01.492157    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:02.492142163 +0000 UTC m=+48.286266169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:01.492224 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:01.492183    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:46:01.492365 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:01.492234    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:02.492222202 +0000 UTC m=+48.286346208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : configmap "kube-rbac-proxy" not found
Jul 09 18:46:02.371437 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:02.371409    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-htlst_76039738-c73a-4be3-95a1-2f46e01435ad/dns-node-resolver/0.log"
Jul 09 18:46:02.501826 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:02.501791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:02.501979 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:02.501871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:02.501979 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:02.501918    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:46:02.501979 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:02.501967    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:02.502078 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:02.501991    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:04.501975884 +0000 UTC m=+50.296099891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : configmap "kube-rbac-proxy" not found
Jul 09 18:46:02.502078 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:02.502007    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:04.50199668 +0000 UTC m=+50.296120688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:03.372440 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.372415    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zrgtd_cbe257a6-701c-4e95-8bd5-327628080f1f/node-ca/0.log"
Jul 09 18:46:03.628064 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.627955    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-xpw6c"]
Jul 09 18:46:03.641447 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.641427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-xpw6c"]
Jul 09 18:46:03.641592 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.641511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:03.644675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.644646    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 09 18:46:03.645922 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.645877    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 09 18:46:03.645922 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.645916    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 09 18:46:03.646077 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.646035    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tctl9\""
Jul 09 18:46:03.646263 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.646247    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 09 18:46:03.712303 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.712267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/22122ca6-1fc9-41dd-9735-7f2b9639ffe8-signing-key\") pod \"service-ca-79f68b9f4f-xpw6c\" (UID: \"22122ca6-1fc9-41dd-9735-7f2b9639ffe8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:03.712499 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.712322    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwlzf\" (UniqueName: \"kubernetes.io/projected/22122ca6-1fc9-41dd-9735-7f2b9639ffe8-kube-api-access-wwlzf\") pod \"service-ca-79f68b9f4f-xpw6c\" (UID: \"22122ca6-1fc9-41dd-9735-7f2b9639ffe8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:03.712499 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.712468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/22122ca6-1fc9-41dd-9735-7f2b9639ffe8-signing-cabundle\") pod \"service-ca-79f68b9f4f-xpw6c\" (UID: \"22122ca6-1fc9-41dd-9735-7f2b9639ffe8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:03.768135 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.768101    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kfsz9_5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd/serve-healthcheck-canary/0.log"
Jul 09 18:46:03.813483 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.813446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/22122ca6-1fc9-41dd-9735-7f2b9639ffe8-signing-cabundle\") pod \"service-ca-79f68b9f4f-xpw6c\" (UID: \"22122ca6-1fc9-41dd-9735-7f2b9639ffe8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:03.813661 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.813558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/22122ca6-1fc9-41dd-9735-7f2b9639ffe8-signing-key\") pod \"service-ca-79f68b9f4f-xpw6c\" (UID: \"22122ca6-1fc9-41dd-9735-7f2b9639ffe8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:03.813661 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.813595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwlzf\" (UniqueName: \"kubernetes.io/projected/22122ca6-1fc9-41dd-9735-7f2b9639ffe8-kube-api-access-wwlzf\") pod \"service-ca-79f68b9f4f-xpw6c\" (UID: \"22122ca6-1fc9-41dd-9735-7f2b9639ffe8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:03.814173 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.814149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/22122ca6-1fc9-41dd-9735-7f2b9639ffe8-signing-cabundle\") pod \"service-ca-79f68b9f4f-xpw6c\" (UID: \"22122ca6-1fc9-41dd-9735-7f2b9639ffe8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:03.816561 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.816531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/22122ca6-1fc9-41dd-9735-7f2b9639ffe8-signing-key\") pod \"service-ca-79f68b9f4f-xpw6c\" (UID: \"22122ca6-1fc9-41dd-9735-7f2b9639ffe8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:03.823468 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.823436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwlzf\" (UniqueName: \"kubernetes.io/projected/22122ca6-1fc9-41dd-9735-7f2b9639ffe8-kube-api-access-wwlzf\") pod \"service-ca-79f68b9f4f-xpw6c\" (UID: \"22122ca6-1fc9-41dd-9735-7f2b9639ffe8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:03.951579 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:03.951466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c"
Jul 09 18:46:04.091237 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:04.091201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-xpw6c"]
Jul 09 18:46:04.094120 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:04.094096    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22122ca6_1fc9_41dd_9735_7f2b9639ffe8.slice/crio-40cb3edf057761b1884c29b8b620e929c1e5aff87090a3a30b3a526a9b1a22d4 WatchSource:0}: Error finding container 40cb3edf057761b1884c29b8b620e929c1e5aff87090a3a30b3a526a9b1a22d4: Status 404 returned error can't find the container with id 40cb3edf057761b1884c29b8b620e929c1e5aff87090a3a30b3a526a9b1a22d4
Jul 09 18:46:04.520410 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:04.520368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:04.520858 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:04.520502    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:04.520858 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:04.520564    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:04.520858 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:04.520631    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:08.5206165 +0000 UTC m=+54.314740525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:04.520858 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:04.520631    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:46:04.520858 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:04.520683    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:08.520671345 +0000 UTC m=+54.314795352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : configmap "kube-rbac-proxy" not found
Jul 09 18:46:04.957068 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:04.957035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c" event={"ID":"22122ca6-1fc9-41dd-9735-7f2b9639ffe8","Type":"ContainerStarted","Data":"40cb3edf057761b1884c29b8b620e929c1e5aff87090a3a30b3a526a9b1a22d4"}
Jul 09 18:46:05.428181 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:05.428150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:46:05.428321 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:05.428249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:46:05.428321 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:05.428305    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:46:05.428400 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:05.428372    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls podName:482b4db1-4b68-44ec-8b1d-eb5a8d720d43 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:21.428356583 +0000 UTC m=+67.222480595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls") pod "dns-default-xtq28" (UID: "482b4db1-4b68-44ec-8b1d-eb5a8d720d43") : secret "dns-default-metrics-tls" not found
Jul 09 18:46:05.428400 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:05.428388    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:46:05.428470 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:05.428404    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8ffbb88d-964xl: secret "image-registry-tls" not found
Jul 09 18:46:05.428470 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:05.428451    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls podName:cdcac358-1e73-45c9-989b-762ea2c267bd nodeName:}" failed. No retries permitted until 2026-07-09 18:46:21.428438345 +0000 UTC m=+67.222562380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls") pod "image-registry-5c8ffbb88d-964xl" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd") : secret "image-registry-tls" not found
Jul 09 18:46:07.966632 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:07.966586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c" event={"ID":"22122ca6-1fc9-41dd-9735-7f2b9639ffe8","Type":"ContainerStarted","Data":"c2b3c2817f115364c34f49f8f9b338a1633d943b81a1d270c532363dca6a8439"}
Jul 09 18:46:07.982902 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:07.982851    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-xpw6c" podStartSLOduration=2.144765734 podStartE2EDuration="4.982834302s" totalImagesPullingTime="2.838068568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:07.982487208 +0000 UTC m=+53.776611239" watchObservedRunningTime="2026-07-09 18:46:07.982834302 +0000 UTC m=+53.776958332"
Jul 09 18:46:08.554795 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:08.554755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:08.555009 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:08.554894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:08.555009 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:08.554937    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:46:08.555009 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:08.555007    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:08.555183 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:08.555028    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:16.554993219 +0000 UTC m=+62.349117240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : configmap "kube-rbac-proxy" not found
Jul 09 18:46:08.555183 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:08.555068    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:16.555053214 +0000 UTC m=+62.349177225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:09.058966 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:09.058925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:46:09.059374 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:09.059051    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 18:46:09.059374 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:09.059141    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls podName:e5fe7c21-4264-4cd4-a06c-65ea61b3994f nodeName:}" failed. No retries permitted until 2026-07-09 18:46:25.059120346 +0000 UTC m=+70.853244356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-br5dg" (UID: "e5fe7c21-4264-4cd4-a06c-65ea61b3994f") : secret "cluster-monitoring-operator-tls" not found
Jul 09 18:46:09.159790 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:09.159752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:09.159962 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:09.159892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:09.159962 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:09.159909    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:46:09.160065 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:09.159984    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:25.159964682 +0000 UTC m=+70.954088691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : secret "router-metrics-certs-default" not found
Jul 09 18:46:09.160124 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:09.160076    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle podName:ad4227bf-dec9-4ad3-87f0-a369b054e449 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:25.160055682 +0000 UTC m=+70.954179703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle") pod "router-default-dd6d8cb96-bbfgl" (UID: "ad4227bf-dec9-4ad3-87f0-a369b054e449") : configmap references non-existent config key: service-ca.crt
Jul 09 18:46:15.910031 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:15.909997    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kksj7"
Jul 09 18:46:16.626196 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:16.626141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:16.626406 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:16.626273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:16.626457 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:16.626427    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:16.626518 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:46:16.626507    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls podName:edc1e2a7-b34b-4aa0-9258-4bad9d88d777 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:32.626491352 +0000 UTC m=+78.420615359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2bcx" (UID: "edc1e2a7-b34b-4aa0-9258-4bad9d88d777") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:46:16.626744 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:16.626725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:20.557126 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.557082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:46:20.557515 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.557223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:46:20.559972 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.559955    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:46:20.561056 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.561040    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:46:20.569522 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.569498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/735851e3-381c-495a-a69b-ab40850b0010-metrics-certs\") pod \"network-metrics-daemon-m2z8q\" (UID: \"735851e3-381c-495a-a69b-ab40850b0010\") " pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:46:20.569695 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.569675    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd-original-pull-secret\") pod \"global-pull-secret-syncer-g8kxr\" (UID: \"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd\") " pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:46:20.650456 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.650421    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8kxr"
Jul 09 18:46:20.658319 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.658294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcbf\" (UniqueName: \"kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf\") pod \"network-check-target-llcml\" (UID: \"fc403380-da26-468c-b063-64eb91ce0744\") " pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:46:20.658420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.658378    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ckpt2\""
Jul 09 18:46:20.661048 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.661026    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:46:20.666205 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.666187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2z8q"
Jul 09 18:46:20.671320 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.671302    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:46:20.682203 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.682178    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tcbf\" (UniqueName: \"kubernetes.io/projected/fc403380-da26-468c-b063-64eb91ce0744-kube-api-access-2tcbf\") pod \"network-check-target-llcml\" (UID: \"fc403380-da26-468c-b063-64eb91ce0744\") " pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:46:20.783329 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.783252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g8kxr"]
Jul 09 18:46:20.786084 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:20.786056    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45dd2b4_b722_4fbb_bdbd_ffbba1c194dd.slice/crio-ce628f60c3aae36647ca133d008cd1bf7807c2201c2f1aaab5097fbd756503fd WatchSource:0}: Error finding container ce628f60c3aae36647ca133d008cd1bf7807c2201c2f1aaab5097fbd756503fd: Status 404 returned error can't find the container with id ce628f60c3aae36647ca133d008cd1bf7807c2201c2f1aaab5097fbd756503fd
Jul 09 18:46:20.798310 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.798289    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m2z8q"]
Jul 09 18:46:20.801277 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:20.801251    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735851e3_381c_495a_a69b_ab40850b0010.slice/crio-7517f266f56d831cf0ce600c779cdb9ccfcd12a2cb9e7659b6cb0c67052b6ca0 WatchSource:0}: Error finding container 7517f266f56d831cf0ce600c779cdb9ccfcd12a2cb9e7659b6cb0c67052b6ca0: Status 404 returned error can't find the container with id 7517f266f56d831cf0ce600c779cdb9ccfcd12a2cb9e7659b6cb0c67052b6ca0
Jul 09 18:46:20.945378 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.945348    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-prgmc\""
Jul 09 18:46:20.953352 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.953330    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:46:20.999714 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:20.999641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2z8q" event={"ID":"735851e3-381c-495a-a69b-ab40850b0010","Type":"ContainerStarted","Data":"7517f266f56d831cf0ce600c779cdb9ccfcd12a2cb9e7659b6cb0c67052b6ca0"}
Jul 09 18:46:21.001031 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.001002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g8kxr" event={"ID":"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd","Type":"ContainerStarted","Data":"ce628f60c3aae36647ca133d008cd1bf7807c2201c2f1aaab5097fbd756503fd"}
Jul 09 18:46:21.075757 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.075729    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-llcml"]
Jul 09 18:46:21.078326 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:21.078304    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc403380_da26_468c_b063_64eb91ce0744.slice/crio-487f2c66bb5f14befd9e66514a83115eb3b2ff3ee3f52f87222cf7c1dd5ee8be WatchSource:0}: Error finding container 487f2c66bb5f14befd9e66514a83115eb3b2ff3ee3f52f87222cf7c1dd5ee8be: Status 404 returned error can't find the container with id 487f2c66bb5f14befd9e66514a83115eb3b2ff3ee3f52f87222cf7c1dd5ee8be
Jul 09 18:46:21.466532 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.466495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:46:21.466748 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.466585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:46:21.469488 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.469458    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482b4db1-4b68-44ec-8b1d-eb5a8d720d43-metrics-tls\") pod \"dns-default-xtq28\" (UID: \"482b4db1-4b68-44ec-8b1d-eb5a8d720d43\") " pod="openshift-dns/dns-default-xtq28"
Jul 09 18:46:21.469675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.469631    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") pod \"image-registry-5c8ffbb88d-964xl\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") " pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:46:21.666270 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.666237    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l92kj\""
Jul 09 18:46:21.673460 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.673420    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:46:21.679593 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.679308    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5t98t\""
Jul 09 18:46:21.688286 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.687570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xtq28"
Jul 09 18:46:21.846652 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.846410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c8ffbb88d-964xl"]
Jul 09 18:46:21.866851 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:21.866815    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xtq28"]
Jul 09 18:46:22.006882 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:22.006761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-llcml" event={"ID":"fc403380-da26-468c-b063-64eb91ce0744","Type":"ContainerStarted","Data":"487f2c66bb5f14befd9e66514a83115eb3b2ff3ee3f52f87222cf7c1dd5ee8be"}
Jul 09 18:46:22.103242 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:22.103202    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdcac358_1e73_45c9_989b_762ea2c267bd.slice/crio-a7cf37664ee538da417d4548dfd9f2afdd3b4fa5807e378e02caa51449d82009 WatchSource:0}: Error finding container a7cf37664ee538da417d4548dfd9f2afdd3b4fa5807e378e02caa51449d82009: Status 404 returned error can't find the container with id a7cf37664ee538da417d4548dfd9f2afdd3b4fa5807e378e02caa51449d82009
Jul 09 18:46:22.103684 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:22.103652    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482b4db1_4b68_44ec_8b1d_eb5a8d720d43.slice/crio-7adbfcf30bff44286f6b05e9dac815049e4e0778a092bf9389ca583b39ac7ebb WatchSource:0}: Error finding container 7adbfcf30bff44286f6b05e9dac815049e4e0778a092bf9389ca583b39ac7ebb: Status 404 returned error can't find the container with id 7adbfcf30bff44286f6b05e9dac815049e4e0778a092bf9389ca583b39ac7ebb
Jul 09 18:46:23.020157 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:23.020056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl" event={"ID":"cdcac358-1e73-45c9-989b-762ea2c267bd","Type":"ContainerStarted","Data":"a3f39e4829301ead9540d5c02b1d425f1c1aff3a0cd36a1263166ba757d44acc"}
Jul 09 18:46:23.020157 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:23.020155    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl" event={"ID":"cdcac358-1e73-45c9-989b-762ea2c267bd","Type":"ContainerStarted","Data":"a7cf37664ee538da417d4548dfd9f2afdd3b4fa5807e378e02caa51449d82009"}
Jul 09 18:46:23.020732 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:23.020663    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:46:23.022949 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:23.022914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2z8q" event={"ID":"735851e3-381c-495a-a69b-ab40850b0010","Type":"ContainerStarted","Data":"c544c645bbd3c3cae2d6a3e1e6d350f7ee1f0d3acb629b9945082fb3ad213b89"}
Jul 09 18:46:23.023179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:23.023122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2z8q" event={"ID":"735851e3-381c-495a-a69b-ab40850b0010","Type":"ContainerStarted","Data":"ef3b9385917ad3b2ce423846fe7b2344fdc8ccb0c70179edc41abf91c29454a7"}
Jul 09 18:46:23.024714 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:23.024691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xtq28" event={"ID":"482b4db1-4b68-44ec-8b1d-eb5a8d720d43","Type":"ContainerStarted","Data":"7adbfcf30bff44286f6b05e9dac815049e4e0778a092bf9389ca583b39ac7ebb"}
Jul 09 18:46:23.044520 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:23.044456    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl" podStartSLOduration=68.044434994 podStartE2EDuration="1m8.044434994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:23.042629182 +0000 UTC m=+68.836753211" watchObservedRunningTime="2026-07-09 18:46:23.044434994 +0000 UTC m=+68.838559028"
Jul 09 18:46:23.060256 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:23.059380    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m2z8q" podStartSLOduration=66.46416205 podStartE2EDuration="1m8.059360043s" totalImagesPullingTime="1.595197993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:23.058168355 +0000 UTC m=+68.852292385" watchObservedRunningTime="2026-07-09 18:46:23.059360043 +0000 UTC m=+68.853484074"
Jul 09 18:46:24.760354 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.760320    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"]
Jul 09 18:46:24.762463 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.762445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:24.766274 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.766256    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 18:46:24.766440 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.766288    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 18:46:24.766574 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.766289    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 18:46:24.766574 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.766294    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 18:46:24.774006 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.773986    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"]
Jul 09 18:46:24.857321 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.857291    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"]
Jul 09 18:46:24.859387 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.859362    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"
Jul 09 18:46:24.862528 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.862506    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 09 18:46:24.862735 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.862616    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nz4ts\""
Jul 09 18:46:24.863213 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.863190    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 09 18:46:24.870602 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.870576    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"]
Jul 09 18:46:24.899733 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.899694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn6rl\" (UniqueName: \"kubernetes.io/projected/7ab74bf7-c15e-4f3b-8e2d-8d33568799cf-kube-api-access-mn6rl\") pod \"klusterlet-addon-workmgr-68f97dbf5-9xvkl\" (UID: \"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:24.899906 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.899747    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ab74bf7-c15e-4f3b-8e2d-8d33568799cf-klusterlet-config\") pod \"klusterlet-addon-workmgr-68f97dbf5-9xvkl\" (UID: \"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:24.899967 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:24.899896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ab74bf7-c15e-4f3b-8e2d-8d33568799cf-tmp\") pod \"klusterlet-addon-workmgr-68f97dbf5-9xvkl\" (UID: \"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:25.001246 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.001211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0af19108-65d5-4eda-ae6a-6db2614bdf1b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-h6f6v\" (UID: \"0af19108-65d5-4eda-ae6a-6db2614bdf1b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"
Jul 09 18:46:25.001433 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.001287    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ab74bf7-c15e-4f3b-8e2d-8d33568799cf-tmp\") pod \"klusterlet-addon-workmgr-68f97dbf5-9xvkl\" (UID: \"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:25.001433 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.001322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn6rl\" (UniqueName: \"kubernetes.io/projected/7ab74bf7-c15e-4f3b-8e2d-8d33568799cf-kube-api-access-mn6rl\") pod \"klusterlet-addon-workmgr-68f97dbf5-9xvkl\" (UID: \"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:25.001433 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.001349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ab74bf7-c15e-4f3b-8e2d-8d33568799cf-klusterlet-config\") pod \"klusterlet-addon-workmgr-68f97dbf5-9xvkl\" (UID: \"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:25.001433 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.001386    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0af19108-65d5-4eda-ae6a-6db2614bdf1b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h6f6v\" (UID: \"0af19108-65d5-4eda-ae6a-6db2614bdf1b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"
Jul 09 18:46:25.001793 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.001770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ab74bf7-c15e-4f3b-8e2d-8d33568799cf-tmp\") pod \"klusterlet-addon-workmgr-68f97dbf5-9xvkl\" (UID: \"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:25.004326 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.004298    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ab74bf7-c15e-4f3b-8e2d-8d33568799cf-klusterlet-config\") pod \"klusterlet-addon-workmgr-68f97dbf5-9xvkl\" (UID: \"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:25.012977 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.012918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn6rl\" (UniqueName: \"kubernetes.io/projected/7ab74bf7-c15e-4f3b-8e2d-8d33568799cf-kube-api-access-mn6rl\") pod \"klusterlet-addon-workmgr-68f97dbf5-9xvkl\" (UID: \"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:25.074501 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.074271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:25.101798 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.101769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0af19108-65d5-4eda-ae6a-6db2614bdf1b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-h6f6v\" (UID: \"0af19108-65d5-4eda-ae6a-6db2614bdf1b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"
Jul 09 18:46:25.101963 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.101871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:46:25.101963 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.101922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0af19108-65d5-4eda-ae6a-6db2614bdf1b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h6f6v\" (UID: \"0af19108-65d5-4eda-ae6a-6db2614bdf1b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"
Jul 09 18:46:25.102615 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.102584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0af19108-65d5-4eda-ae6a-6db2614bdf1b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-h6f6v\" (UID: \"0af19108-65d5-4eda-ae6a-6db2614bdf1b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"
Jul 09 18:46:25.104781 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.104714    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0af19108-65d5-4eda-ae6a-6db2614bdf1b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h6f6v\" (UID: \"0af19108-65d5-4eda-ae6a-6db2614bdf1b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"
Jul 09 18:46:25.104781 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.104745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5fe7c21-4264-4cd4-a06c-65ea61b3994f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-br5dg\" (UID: \"e5fe7c21-4264-4cd4-a06c-65ea61b3994f\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:46:25.172965 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.172929    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"
Jul 09 18:46:25.202516 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.202479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:25.202700 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.202577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:25.203142 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.203116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4227bf-dec9-4ad3-87f0-a369b054e449-service-ca-bundle\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:25.205295 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.205273    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4227bf-dec9-4ad3-87f0-a369b054e449-metrics-certs\") pod \"router-default-dd6d8cb96-bbfgl\" (UID: \"ad4227bf-dec9-4ad3-87f0-a369b054e449\") " pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:25.332713 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.332635    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hrchs\""
Jul 09 18:46:25.340148 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.340118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"
Jul 09 18:46:25.449328 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.449296    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vtrk8\""
Jul 09 18:46:25.457308 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:25.457286    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:26.710837 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:26.710809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dd6d8cb96-bbfgl"]
Jul 09 18:46:26.712983 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:26.712947    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4227bf_dec9_4ad3_87f0_a369b054e449.slice/crio-5b90d72f288cfce664de0894790f0307e21d56c95c6d9d427035b632c354b00a WatchSource:0}: Error finding container 5b90d72f288cfce664de0894790f0307e21d56c95c6d9d427035b632c354b00a: Status 404 returned error can't find the container with id 5b90d72f288cfce664de0894790f0307e21d56c95c6d9d427035b632c354b00a
Jul 09 18:46:26.746946 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:26.746853    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"]
Jul 09 18:46:26.756879 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:26.756855    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab74bf7_c15e_4f3b_8e2d_8d33568799cf.slice/crio-25694a09a10b59312346788ac5b940dd5692a53d3167e3c21d5826c7d130be36 WatchSource:0}: Error finding container 25694a09a10b59312346788ac5b940dd5692a53d3167e3c21d5826c7d130be36: Status 404 returned error can't find the container with id 25694a09a10b59312346788ac5b940dd5692a53d3167e3c21d5826c7d130be36
Jul 09 18:46:26.913251 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:26.913217    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg"]
Jul 09 18:46:26.915899 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:26.915876    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-h6f6v"]
Jul 09 18:46:26.916845 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:26.916740    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fe7c21_4264_4cd4_a06c_65ea61b3994f.slice/crio-91685baef46cdfebbad3a919fdece3acc247130530da6b83adb317348c083698 WatchSource:0}: Error finding container 91685baef46cdfebbad3a919fdece3acc247130530da6b83adb317348c083698: Status 404 returned error can't find the container with id 91685baef46cdfebbad3a919fdece3acc247130530da6b83adb317348c083698
Jul 09 18:46:26.918743 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:26.918721    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af19108_65d5_4eda_ae6a_6db2614bdf1b.slice/crio-c954a724411b76e9f95e28bc3f3c14b68de04ec471eff678f21461eb2b49271c WatchSource:0}: Error finding container c954a724411b76e9f95e28bc3f3c14b68de04ec471eff678f21461eb2b49271c: Status 404 returned error can't find the container with id c954a724411b76e9f95e28bc3f3c14b68de04ec471eff678f21461eb2b49271c
Jul 09 18:46:27.042060 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.041958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dd6d8cb96-bbfgl" event={"ID":"ad4227bf-dec9-4ad3-87f0-a369b054e449","Type":"ContainerStarted","Data":"61d422330448d610c39c5ab77018b18365101532f8105802c99ffbfd513a1f11"}
Jul 09 18:46:27.042060 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.042015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dd6d8cb96-bbfgl" event={"ID":"ad4227bf-dec9-4ad3-87f0-a369b054e449","Type":"ContainerStarted","Data":"5b90d72f288cfce664de0894790f0307e21d56c95c6d9d427035b632c354b00a"}
Jul 09 18:46:27.043364 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.043330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g8kxr" event={"ID":"b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd","Type":"ContainerStarted","Data":"028d2c10f4541db23e65baa1d49b3bec9f53aa59e7fbbe46db903b3af04a4c53"}
Jul 09 18:46:27.045023 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.044998    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xtq28" event={"ID":"482b4db1-4b68-44ec-8b1d-eb5a8d720d43","Type":"ContainerStarted","Data":"d58837aea87efde306e105e0454d240445df948a45f21fa7339fc21625e4f99d"}
Jul 09 18:46:27.045125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.045043    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xtq28" event={"ID":"482b4db1-4b68-44ec-8b1d-eb5a8d720d43","Type":"ContainerStarted","Data":"d37386a8c63b5edcf50ddcc661b937fdfd4956153e36bfefbb7dc133d0ce2780"}
Jul 09 18:46:27.045125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.045073    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xtq28"
Jul 09 18:46:27.046372 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.046349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-llcml" event={"ID":"fc403380-da26-468c-b063-64eb91ce0744","Type":"ContainerStarted","Data":"1051c7164d30c4a5190e4ef386fc4df1e0bce2b4bec6465ec387cc3abbde3f47"}
Jul 09 18:46:27.046505 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.046400    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:46:27.047513 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.047496    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v" event={"ID":"0af19108-65d5-4eda-ae6a-6db2614bdf1b","Type":"ContainerStarted","Data":"c954a724411b76e9f95e28bc3f3c14b68de04ec471eff678f21461eb2b49271c"}
Jul 09 18:46:27.048444 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.048427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg" event={"ID":"e5fe7c21-4264-4cd4-a06c-65ea61b3994f","Type":"ContainerStarted","Data":"91685baef46cdfebbad3a919fdece3acc247130530da6b83adb317348c083698"}
Jul 09 18:46:27.049393 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.049376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl" event={"ID":"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf","Type":"ContainerStarted","Data":"25694a09a10b59312346788ac5b940dd5692a53d3167e3c21d5826c7d130be36"}
Jul 09 18:46:27.069101 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.069051    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-dd6d8cb96-bbfgl" podStartSLOduration=34.069035823 podStartE2EDuration="34.069035823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:27.068236006 +0000 UTC m=+72.862360035" watchObservedRunningTime="2026-07-09 18:46:27.069035823 +0000 UTC m=+72.863159851"
Jul 09 18:46:27.090189 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.090138    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xtq28" podStartSLOduration=33.697053939 podStartE2EDuration="38.090123341s" totalImagesPullingTime="4.393069402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:27.089464898 +0000 UTC m=+72.883588948" watchObservedRunningTime="2026-07-09 18:46:27.090123341 +0000 UTC m=+72.884247370"
Jul 09 18:46:27.110009 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.109960    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-llcml" podStartSLOduration=66.697348291 podStartE2EDuration="1m12.109942458s" totalImagesPullingTime="5.412594167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:27.109337017 +0000 UTC m=+72.903461036" watchObservedRunningTime="2026-07-09 18:46:27.109942458 +0000 UTC m=+72.904066484"
Jul 09 18:46:27.130240 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.130189    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g8kxr" podStartSLOduration=66.417444636 podStartE2EDuration="1m12.130173109s" totalImagesPullingTime="5.712728473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:27.129329349 +0000 UTC m=+72.923453378" watchObservedRunningTime="2026-07-09 18:46:27.130173109 +0000 UTC m=+72.924297359"
Jul 09 18:46:27.457939 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.457899    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:27.460700 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:27.460676    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:28.056666 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:28.056496    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:28.059195 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:28.058576    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-dd6d8cb96-bbfgl"
Jul 09 18:46:32.071808 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.071776    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v" event={"ID":"0af19108-65d5-4eda-ae6a-6db2614bdf1b","Type":"ContainerStarted","Data":"ed9db4b8106c4c1d3378352c8c7844de259d263c0fe04d532c53da5f477ab927"}
Jul 09 18:46:32.073244 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.073221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg" event={"ID":"e5fe7c21-4264-4cd4-a06c-65ea61b3994f","Type":"ContainerStarted","Data":"cbcc0c7d4d97fbaebe98cc41558a20ceaf4d5b066d9e3e2b2cad395b33ed8175"}
Jul 09 18:46:32.074674 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.074642    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl" event={"ID":"7ab74bf7-c15e-4f3b-8e2d-8d33568799cf","Type":"ContainerStarted","Data":"821261c9316e227785de386ddf660993a43c69816cacd93a4b65212a8dc7fa63"}
Jul 09 18:46:32.074771 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.074748    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:32.076463 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.076447    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl"
Jul 09 18:46:32.094693 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.094634    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-h6f6v" podStartSLOduration=3.928659927 podStartE2EDuration="8.094620553s" totalImagesPullingTime="4.165960626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:32.094367578 +0000 UTC m=+77.888491629" watchObservedRunningTime="2026-07-09 18:46:32.094620553 +0000 UTC m=+77.888744598"
Jul 09 18:46:32.141293 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.141226    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-br5dg" podStartSLOduration=34.968847028 podStartE2EDuration="39.141204864s" totalImagesPullingTime="4.172357836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:32.117450767 +0000 UTC m=+77.911574815" watchObservedRunningTime="2026-07-09 18:46:32.141204864 +0000 UTC m=+77.935328893"
Jul 09 18:46:32.141434 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.141390    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f97dbf5-9xvkl" podStartSLOduration=3.751378317 podStartE2EDuration="8.141384868s" totalImagesPullingTime="4.390006551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:32.139023876 +0000 UTC m=+77.933147933" watchObservedRunningTime="2026-07-09 18:46:32.141384868 +0000 UTC m=+77.935508899"
Jul 09 18:46:32.666970 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.666910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:32.669460 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.669434    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/edc1e2a7-b34b-4aa0-9258-4bad9d88d777-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2bcx\" (UID: \"edc1e2a7-b34b-4aa0-9258-4bad9d88d777\") " pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:32.918715 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.918628    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qssxl\""
Jul 09 18:46:32.924754 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:32.924732    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x2bcx"
Jul 09 18:46:33.061284 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:33.061253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x2bcx"]
Jul 09 18:46:33.064190 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:33.064162    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc1e2a7_b34b_4aa0_9258_4bad9d88d777.slice/crio-82a3ae5f741e0d220d3fc94f8c2501961dce5ef1d8bb34ce779498ac313727c7 WatchSource:0}: Error finding container 82a3ae5f741e0d220d3fc94f8c2501961dce5ef1d8bb34ce779498ac313727c7: Status 404 returned error can't find the container with id 82a3ae5f741e0d220d3fc94f8c2501961dce5ef1d8bb34ce779498ac313727c7
Jul 09 18:46:33.078361 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:33.078316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2bcx" event={"ID":"edc1e2a7-b34b-4aa0-9258-4bad9d88d777","Type":"ContainerStarted","Data":"82a3ae5f741e0d220d3fc94f8c2501961dce5ef1d8bb34ce779498ac313727c7"}
Jul 09 18:46:37.057567 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:37.057464    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xtq28"
Jul 09 18:46:37.097825 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:37.097783    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2bcx" event={"ID":"edc1e2a7-b34b-4aa0-9258-4bad9d88d777","Type":"ContainerStarted","Data":"7584f1b24734535245e7c57e716b84f8fb206dc0c828bb60bf320d748bf4b562"}
Jul 09 18:46:38.104732 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:38.104693    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2bcx" event={"ID":"edc1e2a7-b34b-4aa0-9258-4bad9d88d777","Type":"ContainerStarted","Data":"37fded8cc6d80b55316014ca9a4d6de4131aaafb75a4a722afe12365142e44d2"}
Jul 09 18:46:40.113717 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:40.113686    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2bcx" event={"ID":"edc1e2a7-b34b-4aa0-9258-4bad9d88d777","Type":"ContainerStarted","Data":"db74237aabc9340c8b4c5f2a23aa25855f2923863cda5d66989c22d5041c9577"}
Jul 09 18:46:40.137971 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:40.137920    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x2bcx" podStartSLOduration=33.470555207 podStartE2EDuration="40.137903402s" totalImagesPullingTime="6.667348195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:46:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:40.137674295 +0000 UTC m=+85.931798348" watchObservedRunningTime="2026-07-09 18:46:40.137903402 +0000 UTC m=+85.932027455"
Jul 09 18:46:41.677905 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:41.677867    2581 patch_prober.go:28] interesting pod/image-registry-5c8ffbb88d-964xl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 18:46:41.678333 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:41.677927    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl" podUID="cdcac358-1e73-45c9-989b-762ea2c267bd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 18:46:44.033726 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.033700    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:46:44.446068 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.446034    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pdjks"]
Jul 09 18:46:44.448475 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.448458    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.452084 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.452055    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 18:46:44.452198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.452129    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 18:46:44.453420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.453400    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 18:46:44.453707 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.453689    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 18:46:44.454470 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.454455    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-svpf7\""
Jul 09 18:46:44.464834 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.464803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-wtmp\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.464978 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.464847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d44b442c-798a-49b5-8ad8-bc2b250be17b-metrics-client-ca\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.464978 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.464877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d44b442c-798a-49b5-8ad8-bc2b250be17b-root\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.464978 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.464902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-accelerators-collector-config\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.464978 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.464934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk6wb\" (UniqueName: \"kubernetes.io/projected/d44b442c-798a-49b5-8ad8-bc2b250be17b-kube-api-access-wk6wb\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.464978 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.464965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d44b442c-798a-49b5-8ad8-bc2b250be17b-sys\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.465198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.465000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-textfile\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.465198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.465042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-tls\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.465198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.465067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566054 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d44b442c-798a-49b5-8ad8-bc2b250be17b-metrics-client-ca\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566054 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d44b442c-798a-49b5-8ad8-bc2b250be17b-root\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566232 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-accelerators-collector-config\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566232 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d44b442c-798a-49b5-8ad8-bc2b250be17b-root\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566232 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk6wb\" (UniqueName: \"kubernetes.io/projected/d44b442c-798a-49b5-8ad8-bc2b250be17b-kube-api-access-wk6wb\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566366 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d44b442c-798a-49b5-8ad8-bc2b250be17b-sys\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566366 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-textfile\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566366 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-tls\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566366 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566566 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d44b442c-798a-49b5-8ad8-bc2b250be17b-sys\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566566 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-wtmp\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566566 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-wtmp\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566737 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-textfile\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566798 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566734    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d44b442c-798a-49b5-8ad8-bc2b250be17b-metrics-client-ca\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.566852 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.566829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-accelerators-collector-config\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.568763 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.568744    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.568953 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.568936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d44b442c-798a-49b5-8ad8-bc2b250be17b-node-exporter-tls\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.589933 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.589904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk6wb\" (UniqueName: \"kubernetes.io/projected/d44b442c-798a-49b5-8ad8-bc2b250be17b-kube-api-access-wk6wb\") pod \"node-exporter-pdjks\" (UID: \"d44b442c-798a-49b5-8ad8-bc2b250be17b\") " pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.758364 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:44.758287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pdjks"
Jul 09 18:46:44.771507 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:44.768660    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44b442c_798a_49b5_8ad8_bc2b250be17b.slice/crio-eb6575e8b3c92b6da331ee2b869a710e5be20551119201ab6234c033b5796804 WatchSource:0}: Error finding container eb6575e8b3c92b6da331ee2b869a710e5be20551119201ab6234c033b5796804: Status 404 returned error can't find the container with id eb6575e8b3c92b6da331ee2b869a710e5be20551119201ab6234c033b5796804
Jul 09 18:46:45.132162 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:45.132130    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pdjks" event={"ID":"d44b442c-798a-49b5-8ad8-bc2b250be17b","Type":"ContainerStarted","Data":"eb6575e8b3c92b6da331ee2b869a710e5be20551119201ab6234c033b5796804"}
Jul 09 18:46:46.137783 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:46.137689    2581 generic.go:356] "Generic (PLEG): container finished" podID="d44b442c-798a-49b5-8ad8-bc2b250be17b" containerID="2bde17a17efeb26b3dce8c926a1e2ffb7bd368bf609ce8fb04bbe7415d22d5f1" exitCode=0
Jul 09 18:46:46.137783 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:46.137744    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pdjks" event={"ID":"d44b442c-798a-49b5-8ad8-bc2b250be17b","Type":"ContainerDied","Data":"2bde17a17efeb26b3dce8c926a1e2ffb7bd368bf609ce8fb04bbe7415d22d5f1"}
Jul 09 18:46:47.018766 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:47.018732    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c8ffbb88d-964xl"]
Jul 09 18:46:47.143012 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:47.142979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pdjks" event={"ID":"d44b442c-798a-49b5-8ad8-bc2b250be17b","Type":"ContainerStarted","Data":"ffcf0ac5b5b90c5d2347d39c35c33ace6ca3f7e1a9dd8b0d0ea31074194dce66"}
Jul 09 18:46:47.143355 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:47.143035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pdjks" event={"ID":"d44b442c-798a-49b5-8ad8-bc2b250be17b","Type":"ContainerStarted","Data":"79963ec84aac6049159adef42169e95db5fc0819752cd6795cb3d07755602a48"}
Jul 09 18:46:47.176997 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:47.176951    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pdjks" podStartSLOduration=2.027965009 podStartE2EDuration="3.176933359s" totalImagesPullingTime="1.075571053s" totalInitContainerRuntime="73.397297ms" isStatefulPod=true podCreationTimestamp="2026-07-09 18:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:47.175303651 +0000 UTC m=+92.969427692" watchObservedRunningTime="2026-07-09 18:46:47.176933359 +0000 UTC m=+92.971057388"
Jul 09 18:46:54.386039 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.386006    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6d5fc677-vtjwb"]
Jul 09 18:46:54.389139 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.389123    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.392349 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.392325    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 18:46:54.392569 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.392552    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 18:46:54.392813 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.392594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 18:46:54.393701 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.393681    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 18:46:54.393815 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.393711    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 18:46:54.393977 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.393950    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 18:46:54.393977 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.393967    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w6h62\""
Jul 09 18:46:54.394169 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.393964    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 18:46:54.400730 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.400707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6d5fc677-vtjwb"]
Jul 09 18:46:54.444255 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.444211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-oauth-serving-cert\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.444255 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.444259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-oauth-config\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.444455 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.444284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn262\" (UniqueName: \"kubernetes.io/projected/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-kube-api-access-rn262\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.444455 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.444303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-serving-cert\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.444455 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.444396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-config\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.444455 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.444443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-service-ca\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.545635 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.545606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-oauth-serving-cert\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.545759 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.545647    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-oauth-config\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.545759 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.545672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn262\" (UniqueName: \"kubernetes.io/projected/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-kube-api-access-rn262\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.545759 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.545695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-serving-cert\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.545759 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.545743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-config\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.545950 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.545796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-service-ca\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.546410 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.546385    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-oauth-serving-cert\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.546496 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.546471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-config\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.546794 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.546772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-service-ca\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.548572 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.548531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-oauth-config\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.548666 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.548650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-serving-cert\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.559424 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.559398    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn262\" (UniqueName: \"kubernetes.io/projected/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-kube-api-access-rn262\") pod \"console-6b6d5fc677-vtjwb\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") " pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.697937 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.697851    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:46:54.835090 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:54.835069    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6d5fc677-vtjwb"]
Jul 09 18:46:54.837422 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:46:54.837397    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9eccd1_b9fc_47fb_a64b_e2ec83307f12.slice/crio-675351ccb145e05943319ab7b7d1d5a16a680774312ecf12c236dfa6c70c2ce9 WatchSource:0}: Error finding container 675351ccb145e05943319ab7b7d1d5a16a680774312ecf12c236dfa6c70c2ce9: Status 404 returned error can't find the container with id 675351ccb145e05943319ab7b7d1d5a16a680774312ecf12c236dfa6c70c2ce9
Jul 09 18:46:55.172067 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:55.172034    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d5fc677-vtjwb" event={"ID":"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12","Type":"ContainerStarted","Data":"675351ccb145e05943319ab7b7d1d5a16a680774312ecf12c236dfa6c70c2ce9"}
Jul 09 18:46:58.059677 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:46:58.059645    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-llcml"
Jul 09 18:47:00.190008 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:00.189974    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d5fc677-vtjwb" event={"ID":"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12","Type":"ContainerStarted","Data":"8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e"}
Jul 09 18:47:00.218628 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:00.218577    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b6d5fc677-vtjwb" podStartSLOduration=1.765831645 podStartE2EDuration="6.218561472s" totalImagesPullingTime="4.452729827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:47:00.217570365 +0000 UTC m=+106.011694408" watchObservedRunningTime="2026-07-09 18:47:00.218561472 +0000 UTC m=+106.012685498"
Jul 09 18:47:03.563099 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.561776    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86b5dc6ffb-4xtjm"]
Jul 09 18:47:03.628401 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.628359    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b5dc6ffb-4xtjm"]
Jul 09 18:47:03.628600 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.628398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.638936 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.638916    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 18:47:03.717700 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.717660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-service-ca\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.717864 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.717716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqwr\" (UniqueName: \"kubernetes.io/projected/e173303e-9945-44da-aa70-753f42ff923f-kube-api-access-6lqwr\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.717864 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.717793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-oauth-serving-cert\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.717864 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.717857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-oauth-config\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.717961 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.717883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-serving-cert\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.717961 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.717901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-console-config\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.717961 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.717925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-trusted-ca-bundle\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.819407 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.819311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-oauth-config\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.819407 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.819354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-serving-cert\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.819407 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.819380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-console-config\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.819407 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.819404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-trusted-ca-bundle\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.819767 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.819427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-service-ca\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.819767 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.819468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqwr\" (UniqueName: \"kubernetes.io/projected/e173303e-9945-44da-aa70-753f42ff923f-kube-api-access-6lqwr\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.819767 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.819496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-oauth-serving-cert\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.820210 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.820163    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-console-config\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.820356 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.820230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-oauth-serving-cert\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.820464 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.820441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-service-ca\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.820892 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.820869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-trusted-ca-bundle\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.822202 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.822176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-oauth-config\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.822368 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.822349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-serving-cert\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.831961 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.831931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqwr\" (UniqueName: \"kubernetes.io/projected/e173303e-9945-44da-aa70-753f42ff923f-kube-api-access-6lqwr\") pod \"console-86b5dc6ffb-4xtjm\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") " pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:03.938627 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:03.938588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:04.104312 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:04.104283    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b5dc6ffb-4xtjm"]
Jul 09 18:47:04.107076 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:47:04.107045    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode173303e_9945_44da_aa70_753f42ff923f.slice/crio-96c7703fb97400b3eb59ed638c4ebe034451976f0b7946c7fd4a0c73216de20f WatchSource:0}: Error finding container 96c7703fb97400b3eb59ed638c4ebe034451976f0b7946c7fd4a0c73216de20f: Status 404 returned error can't find the container with id 96c7703fb97400b3eb59ed638c4ebe034451976f0b7946c7fd4a0c73216de20f
Jul 09 18:47:04.205458 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:04.205427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b5dc6ffb-4xtjm" event={"ID":"e173303e-9945-44da-aa70-753f42ff923f","Type":"ContainerStarted","Data":"d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5"}
Jul 09 18:47:04.205646 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:04.205475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b5dc6ffb-4xtjm" event={"ID":"e173303e-9945-44da-aa70-753f42ff923f","Type":"ContainerStarted","Data":"96c7703fb97400b3eb59ed638c4ebe034451976f0b7946c7fd4a0c73216de20f"}
Jul 09 18:47:04.250792 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:04.250710    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86b5dc6ffb-4xtjm" podStartSLOduration=1.250685409 podStartE2EDuration="1.250685409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:47:04.249273865 +0000 UTC m=+110.043397913" watchObservedRunningTime="2026-07-09 18:47:04.250685409 +0000 UTC m=+110.044809440"
Jul 09 18:47:04.698875 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:04.698834    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:47:04.699324 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:04.698894    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:47:04.704204 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:04.704181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:47:05.212750 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:05.212723    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:47:12.039009 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.038952    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl" podUID="cdcac358-1e73-45c9-989b-762ea2c267bd" containerName="registry" containerID="cri-o://a3f39e4829301ead9540d5c02b1d425f1c1aff3a0cd36a1263166ba757d44acc" gracePeriod=30
Jul 09 18:47:12.234234 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.234202    2581 generic.go:356] "Generic (PLEG): container finished" podID="cdcac358-1e73-45c9-989b-762ea2c267bd" containerID="a3f39e4829301ead9540d5c02b1d425f1c1aff3a0cd36a1263166ba757d44acc" exitCode=0
Jul 09 18:47:12.234420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.234279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl" event={"ID":"cdcac358-1e73-45c9-989b-762ea2c267bd","Type":"ContainerDied","Data":"a3f39e4829301ead9540d5c02b1d425f1c1aff3a0cd36a1263166ba757d44acc"}
Jul 09 18:47:12.282592 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.282567    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:47:12.385081 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.385037    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") pod \"cdcac358-1e73-45c9-989b-762ea2c267bd\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") "
Jul 09 18:47:12.385081 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.385095    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-installation-pull-secrets\") pod \"cdcac358-1e73-45c9-989b-762ea2c267bd\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") "
Jul 09 18:47:12.385355 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.385141    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-certificates\") pod \"cdcac358-1e73-45c9-989b-762ea2c267bd\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") "
Jul 09 18:47:12.385355 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.385234    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-image-registry-private-configuration\") pod \"cdcac358-1e73-45c9-989b-762ea2c267bd\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") "
Jul 09 18:47:12.385355 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.385270    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-trusted-ca\") pod \"cdcac358-1e73-45c9-989b-762ea2c267bd\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") "
Jul 09 18:47:12.385355 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.385297    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdcac358-1e73-45c9-989b-762ea2c267bd-ca-trust-extracted\") pod \"cdcac358-1e73-45c9-989b-762ea2c267bd\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") "
Jul 09 18:47:12.385355 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.385327    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn27f\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-kube-api-access-zn27f\") pod \"cdcac358-1e73-45c9-989b-762ea2c267bd\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") "
Jul 09 18:47:12.385647 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.385370    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-bound-sa-token\") pod \"cdcac358-1e73-45c9-989b-762ea2c267bd\" (UID: \"cdcac358-1e73-45c9-989b-762ea2c267bd\") "
Jul 09 18:47:12.385647 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.385527    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cdcac358-1e73-45c9-989b-762ea2c267bd" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:47:12.385744 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.385664    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-certificates\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:12.386246 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.386213    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cdcac358-1e73-45c9-989b-762ea2c267bd" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:47:12.388242 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.388195    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cdcac358-1e73-45c9-989b-762ea2c267bd" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:47:12.388346 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.388321    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cdcac358-1e73-45c9-989b-762ea2c267bd" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:47:12.388346 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.388324    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-kube-api-access-zn27f" (OuterVolumeSpecName: "kube-api-access-zn27f") pod "cdcac358-1e73-45c9-989b-762ea2c267bd" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd"). InnerVolumeSpecName "kube-api-access-zn27f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:47:12.388446 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.388383    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cdcac358-1e73-45c9-989b-762ea2c267bd" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:47:12.388478 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.388451    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cdcac358-1e73-45c9-989b-762ea2c267bd" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:47:12.394353 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.394328    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdcac358-1e73-45c9-989b-762ea2c267bd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cdcac358-1e73-45c9-989b-762ea2c267bd" (UID: "cdcac358-1e73-45c9-989b-762ea2c267bd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:47:12.487157 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.487103    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-registry-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:12.487157 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.487150    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-installation-pull-secrets\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:12.487157 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.487163    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdcac358-1e73-45c9-989b-762ea2c267bd-image-registry-private-configuration\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:12.487157 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.487173    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdcac358-1e73-45c9-989b-762ea2c267bd-trusted-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:12.487157 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.487181    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdcac358-1e73-45c9-989b-762ea2c267bd-ca-trust-extracted\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:12.487457 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.487189    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn27f\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-kube-api-access-zn27f\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:12.487457 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:12.487197    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdcac358-1e73-45c9-989b-762ea2c267bd-bound-sa-token\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:13.243104 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:13.243069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl" event={"ID":"cdcac358-1e73-45c9-989b-762ea2c267bd","Type":"ContainerDied","Data":"a7cf37664ee538da417d4548dfd9f2afdd3b4fa5807e378e02caa51449d82009"}
Jul 09 18:47:13.243104 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:13.243095    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c8ffbb88d-964xl"
Jul 09 18:47:13.243623 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:13.243157    2581 scope.go:117] "RemoveContainer" containerID="a3f39e4829301ead9540d5c02b1d425f1c1aff3a0cd36a1263166ba757d44acc"
Jul 09 18:47:13.264755 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:13.264727    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c8ffbb88d-964xl"]
Jul 09 18:47:13.270479 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:13.270453    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c8ffbb88d-964xl"]
Jul 09 18:47:13.939232 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:13.939193    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:13.939429 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:13.939264    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:13.943850 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:13.943826    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:14.250939 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:14.250858    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:47:14.323348 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:14.323317    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6d5fc677-vtjwb"]
Jul 09 18:47:14.736836 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:14.736805    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdcac358-1e73-45c9-989b-762ea2c267bd" path="/var/lib/kubelet/pods/cdcac358-1e73-45c9-989b-762ea2c267bd/volumes"
Jul 09 18:47:39.344827 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.344778    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b6d5fc677-vtjwb" podUID="bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" containerName="console" containerID="cri-o://8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e" gracePeriod=15
Jul 09 18:47:39.583962 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.583936    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:47:39.692389 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.692305    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-serving-cert\") pod \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") "
Jul 09 18:47:39.692389 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.692357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-oauth-config\") pod \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") "
Jul 09 18:47:39.692389 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.692386    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn262\" (UniqueName: \"kubernetes.io/projected/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-kube-api-access-rn262\") pod \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") "
Jul 09 18:47:39.692700 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.692412    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-oauth-serving-cert\") pod \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") "
Jul 09 18:47:39.692700 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.692447    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-service-ca\") pod \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") "
Jul 09 18:47:39.692700 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.692470    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-config\") pod \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\" (UID: \"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12\") "
Jul 09 18:47:39.692940 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.692912    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-config" (OuterVolumeSpecName: "console-config") pod "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" (UID: "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:47:39.692940 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.692920    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" (UID: "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:47:39.693034 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.692910    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-service-ca" (OuterVolumeSpecName: "service-ca") pod "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" (UID: "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:47:39.694803 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.694772    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" (UID: "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:47:39.695267 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.695250    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" (UID: "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:47:39.695311 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.695287    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-kube-api-access-rn262" (OuterVolumeSpecName: "kube-api-access-rn262") pod "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" (UID: "bb9eccd1-b9fc-47fb-a64b-e2ec83307f12"). InnerVolumeSpecName "kube-api-access-rn262". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:47:39.793690 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.793649    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-oauth-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:39.793690 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.793683    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn262\" (UniqueName: \"kubernetes.io/projected/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-kube-api-access-rn262\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:39.793690 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.793696    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-oauth-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:39.793928 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.793708    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:39.793928 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.793719    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:39.793928 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:39.793730    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12-console-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:47:40.340043 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:40.340011    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" containerID="8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e" exitCode=0
Jul 09 18:47:40.340219 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:40.340056    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d5fc677-vtjwb"
Jul 09 18:47:40.340219 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:40.340093    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d5fc677-vtjwb" event={"ID":"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12","Type":"ContainerDied","Data":"8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e"}
Jul 09 18:47:40.340219 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:40.340142    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d5fc677-vtjwb" event={"ID":"bb9eccd1-b9fc-47fb-a64b-e2ec83307f12","Type":"ContainerDied","Data":"675351ccb145e05943319ab7b7d1d5a16a680774312ecf12c236dfa6c70c2ce9"}
Jul 09 18:47:40.340219 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:40.340161    2581 scope.go:117] "RemoveContainer" containerID="8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e"
Jul 09 18:47:40.348743 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:40.348572    2581 scope.go:117] "RemoveContainer" containerID="8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e"
Jul 09 18:47:40.348944 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:47:40.348855    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e\": container with ID starting with 8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e not found: ID does not exist" containerID="8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e"
Jul 09 18:47:40.348944 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:40.348882    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e"} err="failed to get container status \"8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e\": rpc error: code = NotFound desc = could not find container \"8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e\": container with ID starting with 8c68ecd47549231573287acc224fdea579c03baaacdc39869d913719cb8e903e not found: ID does not exist"
Jul 09 18:47:40.369660 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:40.369637    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6d5fc677-vtjwb"]
Jul 09 18:47:40.375099 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:40.375081    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b6d5fc677-vtjwb"]
Jul 09 18:47:40.737109 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:47:40.737032    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" path="/var/lib/kubelet/pods/bb9eccd1-b9fc-47fb-a64b-e2ec83307f12/volumes"
Jul 09 18:48:12.708548 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.708457    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b94875b6d-wpnqt"]
Jul 09 18:48:12.708982 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.708809    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdcac358-1e73-45c9-989b-762ea2c267bd" containerName="registry"
Jul 09 18:48:12.708982 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.708829    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdcac358-1e73-45c9-989b-762ea2c267bd" containerName="registry"
Jul 09 18:48:12.708982 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.708859    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" containerName="console"
Jul 09 18:48:12.708982 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.708868    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" containerName="console"
Jul 09 18:48:12.708982 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.708923    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdcac358-1e73-45c9-989b-762ea2c267bd" containerName="registry"
Jul 09 18:48:12.708982 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.708938    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb9eccd1-b9fc-47fb-a64b-e2ec83307f12" containerName="console"
Jul 09 18:48:12.711606 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.711587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.722281 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.722261    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b94875b6d-wpnqt"]
Jul 09 18:48:12.723342 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.723322    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-serving-cert\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.723454 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.723348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-oauth-config\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.723454 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.723376    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-console-config\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.723454 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.723430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-service-ca\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.723645 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.723476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm4kj\" (UniqueName: \"kubernetes.io/projected/cf48b704-8720-4e32-9479-362d77240b85-kube-api-access-zm4kj\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.723645 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.723504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-trusted-ca-bundle\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.723645 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.723522    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-oauth-serving-cert\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.824700 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.824664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-console-config\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.824884 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.824719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-service-ca\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.824884 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.824805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm4kj\" (UniqueName: \"kubernetes.io/projected/cf48b704-8720-4e32-9479-362d77240b85-kube-api-access-zm4kj\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.824884 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.824845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-trusted-ca-bundle\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.824884 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.824862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-oauth-serving-cert\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.825074 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.824907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-serving-cert\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.825074 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.824926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-oauth-config\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.825501 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.825468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-service-ca\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.825630 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.825471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-console-config\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.825854 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.825666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-oauth-serving-cert\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.825854 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.825711    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-trusted-ca-bundle\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.827589 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.827566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-oauth-config\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.827589 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.827585    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-serving-cert\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:12.835032 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:12.835009    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm4kj\" (UniqueName: \"kubernetes.io/projected/cf48b704-8720-4e32-9479-362d77240b85-kube-api-access-zm4kj\") pod \"console-6b94875b6d-wpnqt\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") " pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:13.020219 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:13.020131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:13.175165 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:13.175133    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b94875b6d-wpnqt"]
Jul 09 18:48:13.177802 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:48:13.177775    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf48b704_8720_4e32_9479_362d77240b85.slice/crio-19a99329e5fa9d8b72cfaa27a8db1f228136538d7cd3ef77ddda512438d6fb50 WatchSource:0}: Error finding container 19a99329e5fa9d8b72cfaa27a8db1f228136538d7cd3ef77ddda512438d6fb50: Status 404 returned error can't find the container with id 19a99329e5fa9d8b72cfaa27a8db1f228136538d7cd3ef77ddda512438d6fb50
Jul 09 18:48:13.450381 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:13.450345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b94875b6d-wpnqt" event={"ID":"cf48b704-8720-4e32-9479-362d77240b85","Type":"ContainerStarted","Data":"84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32"}
Jul 09 18:48:13.450587 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:13.450401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b94875b6d-wpnqt" event={"ID":"cf48b704-8720-4e32-9479-362d77240b85","Type":"ContainerStarted","Data":"19a99329e5fa9d8b72cfaa27a8db1f228136538d7cd3ef77ddda512438d6fb50"}
Jul 09 18:48:13.471686 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:13.471639    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b94875b6d-wpnqt" podStartSLOduration=1.471621517 podStartE2EDuration="1.471621517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:13.470475348 +0000 UTC m=+179.264599380" watchObservedRunningTime="2026-07-09 18:48:13.471621517 +0000 UTC m=+179.265745539"
Jul 09 18:48:23.020478 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:23.020426    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:23.020956 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:23.020505    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:23.025433 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:23.025409    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:23.492117 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:23.492091    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:48:23.548383 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:23.548353    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b5dc6ffb-4xtjm"]
Jul 09 18:48:48.574814 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.574756    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86b5dc6ffb-4xtjm" podUID="e173303e-9945-44da-aa70-753f42ff923f" containerName="console" containerID="cri-o://d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5" gracePeriod=15
Jul 09 18:48:48.823366 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.823342    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:48:48.887227 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-oauth-config\") pod \"e173303e-9945-44da-aa70-753f42ff923f\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") "
Jul 09 18:48:48.887227 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887232    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-trusted-ca-bundle\") pod \"e173303e-9945-44da-aa70-753f42ff923f\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") "
Jul 09 18:48:48.887467 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887256    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-serving-cert\") pod \"e173303e-9945-44da-aa70-753f42ff923f\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") "
Jul 09 18:48:48.887467 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887275    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-oauth-serving-cert\") pod \"e173303e-9945-44da-aa70-753f42ff923f\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") "
Jul 09 18:48:48.887578 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887493    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lqwr\" (UniqueName: \"kubernetes.io/projected/e173303e-9945-44da-aa70-753f42ff923f-kube-api-access-6lqwr\") pod \"e173303e-9945-44da-aa70-753f42ff923f\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") "
Jul 09 18:48:48.887626 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887574    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-service-ca\") pod \"e173303e-9945-44da-aa70-753f42ff923f\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") "
Jul 09 18:48:48.887626 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887622    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-console-config\") pod \"e173303e-9945-44da-aa70-753f42ff923f\" (UID: \"e173303e-9945-44da-aa70-753f42ff923f\") "
Jul 09 18:48:48.887728 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887695    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e173303e-9945-44da-aa70-753f42ff923f" (UID: "e173303e-9945-44da-aa70-753f42ff923f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:48.887782 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887751    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e173303e-9945-44da-aa70-753f42ff923f" (UID: "e173303e-9945-44da-aa70-753f42ff923f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:48.887898 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887875    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-trusted-ca-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:48:48.887898 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.887898    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-oauth-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:48:48.888242 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.888031    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-service-ca" (OuterVolumeSpecName: "service-ca") pod "e173303e-9945-44da-aa70-753f42ff923f" (UID: "e173303e-9945-44da-aa70-753f42ff923f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:48.888242 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.888123    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-console-config" (OuterVolumeSpecName: "console-config") pod "e173303e-9945-44da-aa70-753f42ff923f" (UID: "e173303e-9945-44da-aa70-753f42ff923f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:48.889627 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.889594    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e173303e-9945-44da-aa70-753f42ff923f-kube-api-access-6lqwr" (OuterVolumeSpecName: "kube-api-access-6lqwr") pod "e173303e-9945-44da-aa70-753f42ff923f" (UID: "e173303e-9945-44da-aa70-753f42ff923f"). InnerVolumeSpecName "kube-api-access-6lqwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:48.889714 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.889634    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e173303e-9945-44da-aa70-753f42ff923f" (UID: "e173303e-9945-44da-aa70-753f42ff923f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:48.889714 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.889679    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e173303e-9945-44da-aa70-753f42ff923f" (UID: "e173303e-9945-44da-aa70-753f42ff923f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:48.989253 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.989214    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lqwr\" (UniqueName: \"kubernetes.io/projected/e173303e-9945-44da-aa70-753f42ff923f-kube-api-access-6lqwr\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:48:48.989253 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.989246    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:48:48.989253 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.989256    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e173303e-9945-44da-aa70-753f42ff923f-console-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:48:48.989253 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.989264    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-oauth-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:48:48.989490 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:48.989274    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e173303e-9945-44da-aa70-753f42ff923f-console-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:48:49.573416 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:49.573380    2581 generic.go:356] "Generic (PLEG): container finished" podID="e173303e-9945-44da-aa70-753f42ff923f" containerID="d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5" exitCode=0
Jul 09 18:48:49.573580 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:49.573445    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b5dc6ffb-4xtjm"
Jul 09 18:48:49.573580 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:49.573467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b5dc6ffb-4xtjm" event={"ID":"e173303e-9945-44da-aa70-753f42ff923f","Type":"ContainerDied","Data":"d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5"}
Jul 09 18:48:49.573580 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:49.573568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b5dc6ffb-4xtjm" event={"ID":"e173303e-9945-44da-aa70-753f42ff923f","Type":"ContainerDied","Data":"96c7703fb97400b3eb59ed638c4ebe034451976f0b7946c7fd4a0c73216de20f"}
Jul 09 18:48:49.573699 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:49.573596    2581 scope.go:117] "RemoveContainer" containerID="d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5"
Jul 09 18:48:49.582315 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:49.582159    2581 scope.go:117] "RemoveContainer" containerID="d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5"
Jul 09 18:48:49.582519 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:48:49.582390    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5\": container with ID starting with d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5 not found: ID does not exist" containerID="d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5"
Jul 09 18:48:49.582519 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:49.582413    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5"} err="failed to get container status \"d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5\": rpc error: code = NotFound desc = could not find container \"d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5\": container with ID starting with d60df7faa8381e30529bcee048e5ad6dec6afa969418328d2d6f57438953dbc5 not found: ID does not exist"
Jul 09 18:48:49.599214 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:49.599192    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b5dc6ffb-4xtjm"]
Jul 09 18:48:49.607604 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:49.607502    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86b5dc6ffb-4xtjm"]
Jul 09 18:48:50.737480 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:48:50.737450    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e173303e-9945-44da-aa70-753f42ff923f" path="/var/lib/kubelet/pods/e173303e-9945-44da-aa70-753f42ff923f/volumes"
Jul 09 18:49:20.252992 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.252956    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bcd7dff58-w24hq"]
Jul 09 18:49:20.253665 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.253226    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e173303e-9945-44da-aa70-753f42ff923f" containerName="console"
Jul 09 18:49:20.253665 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.253238    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e173303e-9945-44da-aa70-753f42ff923f" containerName="console"
Jul 09 18:49:20.253665 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.253284    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e173303e-9945-44da-aa70-753f42ff923f" containerName="console"
Jul 09 18:49:20.257239 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.257221    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.269385 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.269360    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bcd7dff58-w24hq"]
Jul 09 18:49:20.418967 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.418929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-service-ca\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.418967 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.418972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-oauth-config\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.419198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.418991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-serving-cert\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.419198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.419033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-trusted-ca-bundle\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.419198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.419073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-oauth-serving-cert\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.419198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.419100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-config\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.419198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.419127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plcnd\" (UniqueName: \"kubernetes.io/projected/af8e2c89-803c-4f31-95f5-85e9d75527ed-kube-api-access-plcnd\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.520210 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.520117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-oauth-config\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.520210 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.520162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-serving-cert\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.520396 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.520276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-trusted-ca-bundle\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.520396 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.520321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-oauth-serving-cert\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.520396 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.520342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-config\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.520396 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.520380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plcnd\" (UniqueName: \"kubernetes.io/projected/af8e2c89-803c-4f31-95f5-85e9d75527ed-kube-api-access-plcnd\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.520636 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.520412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-service-ca\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.521183 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.521160    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-trusted-ca-bundle\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.521291 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.521185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-service-ca\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.521291 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.521185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-config\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.521400 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.521296    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-oauth-serving-cert\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.522790 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.522769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-oauth-config\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.522878 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.522855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-serving-cert\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.533283 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.533261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plcnd\" (UniqueName: \"kubernetes.io/projected/af8e2c89-803c-4f31-95f5-85e9d75527ed-kube-api-access-plcnd\") pod \"console-5bcd7dff58-w24hq\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") " pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.565299 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.565274    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:20.703625 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:20.703602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bcd7dff58-w24hq"]
Jul 09 18:49:20.705631 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:49:20.705602    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf8e2c89_803c_4f31_95f5_85e9d75527ed.slice/crio-43bc9bd93aece5e8a4245e2ebd112fa1ff2bd900acb6b18f5cd81fdb1222bd0f WatchSource:0}: Error finding container 43bc9bd93aece5e8a4245e2ebd112fa1ff2bd900acb6b18f5cd81fdb1222bd0f: Status 404 returned error can't find the container with id 43bc9bd93aece5e8a4245e2ebd112fa1ff2bd900acb6b18f5cd81fdb1222bd0f
Jul 09 18:49:21.679142 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:21.679104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcd7dff58-w24hq" event={"ID":"af8e2c89-803c-4f31-95f5-85e9d75527ed","Type":"ContainerStarted","Data":"e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e"}
Jul 09 18:49:21.679586 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:21.679158    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcd7dff58-w24hq" event={"ID":"af8e2c89-803c-4f31-95f5-85e9d75527ed","Type":"ContainerStarted","Data":"43bc9bd93aece5e8a4245e2ebd112fa1ff2bd900acb6b18f5cd81fdb1222bd0f"}
Jul 09 18:49:21.702840 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:21.702793    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bcd7dff58-w24hq" podStartSLOduration=1.702777993 podStartE2EDuration="1.702777993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:49:21.701125985 +0000 UTC m=+247.495250027" watchObservedRunningTime="2026-07-09 18:49:21.702777993 +0000 UTC m=+247.496902019"
Jul 09 18:49:30.566960 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:30.566922    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:30.567770 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:30.567174    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:30.571604 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:30.571581    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:30.712753 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:30.712729    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:49:30.771760 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:30.771727    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b94875b6d-wpnqt"]
Jul 09 18:49:55.793586 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:55.793528    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b94875b6d-wpnqt" podUID="cf48b704-8720-4e32-9479-362d77240b85" containerName="console" containerID="cri-o://84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32" gracePeriod=15
Jul 09 18:49:56.037189 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.037164    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:49:56.078672 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.078610    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-oauth-serving-cert\") pod \"cf48b704-8720-4e32-9479-362d77240b85\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") "
Jul 09 18:49:56.078672 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.078647    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-serving-cert\") pod \"cf48b704-8720-4e32-9479-362d77240b85\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") "
Jul 09 18:49:56.078889 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.078699    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-oauth-config\") pod \"cf48b704-8720-4e32-9479-362d77240b85\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") "
Jul 09 18:49:56.078889 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.078724    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm4kj\" (UniqueName: \"kubernetes.io/projected/cf48b704-8720-4e32-9479-362d77240b85-kube-api-access-zm4kj\") pod \"cf48b704-8720-4e32-9479-362d77240b85\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") "
Jul 09 18:49:56.078889 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.078746    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-console-config\") pod \"cf48b704-8720-4e32-9479-362d77240b85\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") "
Jul 09 18:49:56.078889 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.078762    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-trusted-ca-bundle\") pod \"cf48b704-8720-4e32-9479-362d77240b85\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") "
Jul 09 18:49:56.079090 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.078952    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-service-ca\") pod \"cf48b704-8720-4e32-9479-362d77240b85\" (UID: \"cf48b704-8720-4e32-9479-362d77240b85\") "
Jul 09 18:49:56.079090 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.079014    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf48b704-8720-4e32-9479-362d77240b85" (UID: "cf48b704-8720-4e32-9479-362d77240b85"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:49:56.079220 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.079194    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-oauth-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:49:56.079220 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.079194    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-console-config" (OuterVolumeSpecName: "console-config") pod "cf48b704-8720-4e32-9479-362d77240b85" (UID: "cf48b704-8720-4e32-9479-362d77240b85"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:49:56.079359 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.079230    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf48b704-8720-4e32-9479-362d77240b85" (UID: "cf48b704-8720-4e32-9479-362d77240b85"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:49:56.079359 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.079289    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf48b704-8720-4e32-9479-362d77240b85" (UID: "cf48b704-8720-4e32-9479-362d77240b85"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:49:56.080963 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.080944    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf48b704-8720-4e32-9479-362d77240b85" (UID: "cf48b704-8720-4e32-9479-362d77240b85"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:49:56.081029 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.080989    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf48b704-8720-4e32-9479-362d77240b85-kube-api-access-zm4kj" (OuterVolumeSpecName: "kube-api-access-zm4kj") pod "cf48b704-8720-4e32-9479-362d77240b85" (UID: "cf48b704-8720-4e32-9479-362d77240b85"). InnerVolumeSpecName "kube-api-access-zm4kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:49:56.081087 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.081072    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf48b704-8720-4e32-9479-362d77240b85" (UID: "cf48b704-8720-4e32-9479-362d77240b85"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:49:56.180442 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.180404    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-console-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:49:56.180442 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.180440    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-trusted-ca-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:49:56.180442 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.180450    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf48b704-8720-4e32-9479-362d77240b85-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:49:56.180442 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.180458    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:49:56.180703 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.180467    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf48b704-8720-4e32-9479-362d77240b85-console-oauth-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:49:56.180703 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.180476    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm4kj\" (UniqueName: \"kubernetes.io/projected/cf48b704-8720-4e32-9479-362d77240b85-kube-api-access-zm4kj\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:49:56.795890 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.795852    2581 generic.go:356] "Generic (PLEG): container finished" podID="cf48b704-8720-4e32-9479-362d77240b85" containerID="84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32" exitCode=0
Jul 09 18:49:56.796260 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.795902    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b94875b6d-wpnqt"
Jul 09 18:49:56.796260 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.795935    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b94875b6d-wpnqt" event={"ID":"cf48b704-8720-4e32-9479-362d77240b85","Type":"ContainerDied","Data":"84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32"}
Jul 09 18:49:56.796260 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.795993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b94875b6d-wpnqt" event={"ID":"cf48b704-8720-4e32-9479-362d77240b85","Type":"ContainerDied","Data":"19a99329e5fa9d8b72cfaa27a8db1f228136538d7cd3ef77ddda512438d6fb50"}
Jul 09 18:49:56.796260 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.796016    2581 scope.go:117] "RemoveContainer" containerID="84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32"
Jul 09 18:49:56.804064 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.804045    2581 scope.go:117] "RemoveContainer" containerID="84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32"
Jul 09 18:49:56.804318 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:49:56.804300    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32\": container with ID starting with 84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32 not found: ID does not exist" containerID="84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32"
Jul 09 18:49:56.804362 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.804327    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32"} err="failed to get container status \"84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32\": rpc error: code = NotFound desc = could not find container \"84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32\": container with ID starting with 84f726c562394504f8cfae6a644a53fb1a0662a0cceafe22a5f69c60d52c5f32 not found: ID does not exist"
Jul 09 18:49:56.819100 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.819076    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b94875b6d-wpnqt"]
Jul 09 18:49:56.822671 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:56.822650    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b94875b6d-wpnqt"]
Jul 09 18:49:58.736874 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:49:58.736841    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf48b704-8720-4e32-9479-362d77240b85" path="/var/lib/kubelet/pods/cf48b704-8720-4e32-9479-362d77240b85/volumes"
Jul 09 18:50:14.624613 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:14.624583    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 18:50:14.627718 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:14.627694    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 18:50:14.629920 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:14.629898    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 18:50:25.717006 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.716972    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"]
Jul 09 18:50:25.718643 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.717209    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf48b704-8720-4e32-9479-362d77240b85" containerName="console"
Jul 09 18:50:25.718643 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.717219    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf48b704-8720-4e32-9479-362d77240b85" containerName="console"
Jul 09 18:50:25.718643 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.717267    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf48b704-8720-4e32-9479-362d77240b85" containerName="console"
Jul 09 18:50:25.719053 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.719037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:25.722198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.722176    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:50:25.722198 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.722191    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-glt5v\""
Jul 09 18:50:25.723277 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.723258    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:50:25.735442 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.735421    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"]
Jul 09 18:50:25.797190 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.797154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:25.797365 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.797223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz4rb\" (UniqueName: \"kubernetes.io/projected/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-kube-api-access-jz4rb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:25.797365 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.797252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:25.898557 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.898503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz4rb\" (UniqueName: \"kubernetes.io/projected/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-kube-api-access-jz4rb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:25.898557 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.898552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:25.898769 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.898599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:25.898999 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.898983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:25.899060 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.899042    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:25.909285 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:25.909252    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz4rb\" (UniqueName: \"kubernetes.io/projected/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-kube-api-access-jz4rb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:26.028590 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:26.028470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:26.162846 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:26.162815    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"]
Jul 09 18:50:26.166071 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:50:26.166043    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b87af8_2004_4d85_ab0d_5a4850a82ca2.slice/crio-2c3e8ff00521559740038f8082b040fd36d9d080697daa76c94639cb10b4f8bc WatchSource:0}: Error finding container 2c3e8ff00521559740038f8082b040fd36d9d080697daa76c94639cb10b4f8bc: Status 404 returned error can't find the container with id 2c3e8ff00521559740038f8082b040fd36d9d080697daa76c94639cb10b4f8bc
Jul 09 18:50:26.168595 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:26.168579    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:50:26.893848 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:26.893808    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4" event={"ID":"e1b87af8-2004-4d85-ab0d-5a4850a82ca2","Type":"ContainerStarted","Data":"2c3e8ff00521559740038f8082b040fd36d9d080697daa76c94639cb10b4f8bc"}
Jul 09 18:50:35.926652 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:35.926610    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1b87af8-2004-4d85-ab0d-5a4850a82ca2" containerID="aecf8c8d8cc442f4af677e2c621d6a77122e3e539bcb4689d54749557c403d5d" exitCode=0
Jul 09 18:50:35.927072 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:35.926676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4" event={"ID":"e1b87af8-2004-4d85-ab0d-5a4850a82ca2","Type":"ContainerDied","Data":"aecf8c8d8cc442f4af677e2c621d6a77122e3e539bcb4689d54749557c403d5d"}
Jul 09 18:50:38.940450 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:38.940415    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1b87af8-2004-4d85-ab0d-5a4850a82ca2" containerID="e251c9a1f887d3e6f7c36fab318f5404e3d480e9cd7786700b46da5443d55702" exitCode=0
Jul 09 18:50:38.940832 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:38.940497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4" event={"ID":"e1b87af8-2004-4d85-ab0d-5a4850a82ca2","Type":"ContainerDied","Data":"e251c9a1f887d3e6f7c36fab318f5404e3d480e9cd7786700b46da5443d55702"}
Jul 09 18:50:47.975242 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:47.975204    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1b87af8-2004-4d85-ab0d-5a4850a82ca2" containerID="588f091ccf768426fa56ca7afd3dccb9dceaf3051658a4dee75dbde6b248fe86" exitCode=0
Jul 09 18:50:47.975628 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:47.975246    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4" event={"ID":"e1b87af8-2004-4d85-ab0d-5a4850a82ca2","Type":"ContainerDied","Data":"588f091ccf768426fa56ca7afd3dccb9dceaf3051658a4dee75dbde6b248fe86"}
Jul 09 18:50:49.145034 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.145005    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:49.276300 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.276215    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz4rb\" (UniqueName: \"kubernetes.io/projected/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-kube-api-access-jz4rb\") pod \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") "
Jul 09 18:50:49.276300 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.276270    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-bundle\") pod \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") "
Jul 09 18:50:49.276300 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.276300    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-util\") pod \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\" (UID: \"e1b87af8-2004-4d85-ab0d-5a4850a82ca2\") "
Jul 09 18:50:49.276968 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.276939    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-bundle" (OuterVolumeSpecName: "bundle") pod "e1b87af8-2004-4d85-ab0d-5a4850a82ca2" (UID: "e1b87af8-2004-4d85-ab0d-5a4850a82ca2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:50:49.278627 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.278595    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-kube-api-access-jz4rb" (OuterVolumeSpecName: "kube-api-access-jz4rb") pod "e1b87af8-2004-4d85-ab0d-5a4850a82ca2" (UID: "e1b87af8-2004-4d85-ab0d-5a4850a82ca2"). InnerVolumeSpecName "kube-api-access-jz4rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:50:49.281407 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.281382    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-util" (OuterVolumeSpecName: "util") pod "e1b87af8-2004-4d85-ab0d-5a4850a82ca2" (UID: "e1b87af8-2004-4d85-ab0d-5a4850a82ca2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:50:49.377062 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.377033    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz4rb\" (UniqueName: \"kubernetes.io/projected/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-kube-api-access-jz4rb\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:50:49.377062 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.377058    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:50:49.377062 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.377069    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1b87af8-2004-4d85-ab0d-5a4850a82ca2-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:50:49.983949 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.983911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4" event={"ID":"e1b87af8-2004-4d85-ab0d-5a4850a82ca2","Type":"ContainerDied","Data":"2c3e8ff00521559740038f8082b040fd36d9d080697daa76c94639cb10b4f8bc"}
Jul 09 18:50:49.984116 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.983960    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p52k4"
Jul 09 18:50:49.984116 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:49.983968    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c3e8ff00521559740038f8082b040fd36d9d080697daa76c94639cb10b4f8bc"
Jul 09 18:50:53.747054 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.747023    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"]
Jul 09 18:50:53.747420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.747245    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b87af8-2004-4d85-ab0d-5a4850a82ca2" containerName="pull"
Jul 09 18:50:53.747420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.747254    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b87af8-2004-4d85-ab0d-5a4850a82ca2" containerName="pull"
Jul 09 18:50:53.747420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.747270    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b87af8-2004-4d85-ab0d-5a4850a82ca2" containerName="util"
Jul 09 18:50:53.747420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.747275    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b87af8-2004-4d85-ab0d-5a4850a82ca2" containerName="util"
Jul 09 18:50:53.747420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.747282    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b87af8-2004-4d85-ab0d-5a4850a82ca2" containerName="extract"
Jul 09 18:50:53.747420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.747287    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b87af8-2004-4d85-ab0d-5a4850a82ca2" containerName="extract"
Jul 09 18:50:53.747420 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.747324    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b87af8-2004-4d85-ab0d-5a4850a82ca2" containerName="extract"
Jul 09 18:50:53.749108 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.749091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"
Jul 09 18:50:53.751933 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.751913    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:50:53.752097 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.751916    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hkhdn\""
Jul 09 18:50:53.752263 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.752248    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 18:50:53.766364 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.766339    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"]
Jul 09 18:50:53.810966 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.810936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftqnk\" (UniqueName: \"kubernetes.io/projected/c8573f19-f75c-4778-bdda-30eff6d652a4-kube-api-access-ftqnk\") pod \"cert-manager-operator-controller-manager-55c444bf86-n525z\" (UID: \"c8573f19-f75c-4778-bdda-30eff6d652a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"
Jul 09 18:50:53.811139 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.811018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8573f19-f75c-4778-bdda-30eff6d652a4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-n525z\" (UID: \"c8573f19-f75c-4778-bdda-30eff6d652a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"
Jul 09 18:50:53.911788 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.911753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8573f19-f75c-4778-bdda-30eff6d652a4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-n525z\" (UID: \"c8573f19-f75c-4778-bdda-30eff6d652a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"
Jul 09 18:50:53.911788 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.911790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqnk\" (UniqueName: \"kubernetes.io/projected/c8573f19-f75c-4778-bdda-30eff6d652a4-kube-api-access-ftqnk\") pod \"cert-manager-operator-controller-manager-55c444bf86-n525z\" (UID: \"c8573f19-f75c-4778-bdda-30eff6d652a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"
Jul 09 18:50:53.912102 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.912079    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8573f19-f75c-4778-bdda-30eff6d652a4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-n525z\" (UID: \"c8573f19-f75c-4778-bdda-30eff6d652a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"
Jul 09 18:50:53.925095 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:53.925064    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftqnk\" (UniqueName: \"kubernetes.io/projected/c8573f19-f75c-4778-bdda-30eff6d652a4-kube-api-access-ftqnk\") pod \"cert-manager-operator-controller-manager-55c444bf86-n525z\" (UID: \"c8573f19-f75c-4778-bdda-30eff6d652a4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"
Jul 09 18:50:54.058478 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:54.058398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"
Jul 09 18:50:54.192879 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:54.192741    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z"]
Jul 09 18:50:54.195853 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:50:54.195826    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8573f19_f75c_4778_bdda_30eff6d652a4.slice/crio-cba6fc545cfcadf508f742aa5891eee74021156b6955a2387035a53bc9b7c6db WatchSource:0}: Error finding container cba6fc545cfcadf508f742aa5891eee74021156b6955a2387035a53bc9b7c6db: Status 404 returned error can't find the container with id cba6fc545cfcadf508f742aa5891eee74021156b6955a2387035a53bc9b7c6db
Jul 09 18:50:55.003349 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:55.003313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z" event={"ID":"c8573f19-f75c-4778-bdda-30eff6d652a4","Type":"ContainerStarted","Data":"cba6fc545cfcadf508f742aa5891eee74021156b6955a2387035a53bc9b7c6db"}
Jul 09 18:50:56.009217 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:56.009185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z" event={"ID":"c8573f19-f75c-4778-bdda-30eff6d652a4","Type":"ContainerStarted","Data":"2a9c128331db55611bd2a4587ed07a1329b7375baeeec75c83a6f94763b40b50"}
Jul 09 18:50:56.044893 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:56.044685    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-n525z" podStartSLOduration=1.4000819789999999 podStartE2EDuration="3.0446681s" totalImagesPullingTime="1.644586121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:50:56.043801633 +0000 UTC m=+341.837925681" watchObservedRunningTime="2026-07-09 18:50:56.0446681 +0000 UTC m=+341.838792129"
Jul 09 18:50:57.497297 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.497264    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"]
Jul 09 18:50:57.499398 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.499381    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.506073 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.506052    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:50:57.506220 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.506082    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-glt5v\""
Jul 09 18:50:57.507039 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.507021    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:50:57.515424 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.515400    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"]
Jul 09 18:50:57.535339 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.535317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.535430 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.535350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlpk7\" (UniqueName: \"kubernetes.io/projected/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-kube-api-access-nlpk7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.535430 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.535408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.636449 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.636419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlpk7\" (UniqueName: \"kubernetes.io/projected/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-kube-api-access-nlpk7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.636613 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.636480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.636613 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.636522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.636884 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.636862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.636919 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.636882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.648159 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.648137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlpk7\" (UniqueName: \"kubernetes.io/projected/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-kube-api-access-nlpk7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.808484 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.808407    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:50:57.964585 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:57.964425    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"]
Jul 09 18:50:57.965235 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:50:57.965213    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05eac5ef_c815_4d20_b1a9_9f833dc27ee9.slice/crio-05be8d2708aaedf0dfcdce8bd8f7f2811b5b19b19a0a291a2560e4c928bae016 WatchSource:0}: Error finding container 05be8d2708aaedf0dfcdce8bd8f7f2811b5b19b19a0a291a2560e4c928bae016: Status 404 returned error can't find the container with id 05be8d2708aaedf0dfcdce8bd8f7f2811b5b19b19a0a291a2560e4c928bae016
Jul 09 18:50:58.018462 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:58.018428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z" event={"ID":"05eac5ef-c815-4d20-b1a9-9f833dc27ee9","Type":"ContainerStarted","Data":"05be8d2708aaedf0dfcdce8bd8f7f2811b5b19b19a0a291a2560e4c928bae016"}
Jul 09 18:50:59.024131 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:59.024047    2581 generic.go:356] "Generic (PLEG): container finished" podID="05eac5ef-c815-4d20-b1a9-9f833dc27ee9" containerID="08551fe430c3a21245a9ea2d41bdddd4520cf14a4cc467112ad54f8c94143434" exitCode=0
Jul 09 18:50:59.024131 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:50:59.024098    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z" event={"ID":"05eac5ef-c815-4d20-b1a9-9f833dc27ee9","Type":"ContainerDied","Data":"08551fe430c3a21245a9ea2d41bdddd4520cf14a4cc467112ad54f8c94143434"}
Jul 09 18:51:02.038169 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:02.038134    2581 generic.go:356] "Generic (PLEG): container finished" podID="05eac5ef-c815-4d20-b1a9-9f833dc27ee9" containerID="2974686ecda02a20ef32544bf6a1af77d7c6d293e8201b9165f8494e82161b57" exitCode=0
Jul 09 18:51:02.038556 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:02.038187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z" event={"ID":"05eac5ef-c815-4d20-b1a9-9f833dc27ee9","Type":"ContainerDied","Data":"2974686ecda02a20ef32544bf6a1af77d7c6d293e8201b9165f8494e82161b57"}
Jul 09 18:51:03.043995 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:03.043963    2581 generic.go:356] "Generic (PLEG): container finished" podID="05eac5ef-c815-4d20-b1a9-9f833dc27ee9" containerID="84c9646e979475a7f4770408a55600031f9ff61ea533c744f2e803a6cdf3d063" exitCode=0
Jul 09 18:51:03.044384 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:03.044036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z" event={"ID":"05eac5ef-c815-4d20-b1a9-9f833dc27ee9","Type":"ContainerDied","Data":"84c9646e979475a7f4770408a55600031f9ff61ea533c744f2e803a6cdf3d063"}
Jul 09 18:51:04.172851 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.172828    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:51:04.183138 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.183115    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-util\") pod \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") "
Jul 09 18:51:04.183234 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.183157    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlpk7\" (UniqueName: \"kubernetes.io/projected/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-kube-api-access-nlpk7\") pod \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") "
Jul 09 18:51:04.183234 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.183216    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-bundle\") pod \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\" (UID: \"05eac5ef-c815-4d20-b1a9-9f833dc27ee9\") "
Jul 09 18:51:04.183652 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.183628    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-bundle" (OuterVolumeSpecName: "bundle") pod "05eac5ef-c815-4d20-b1a9-9f833dc27ee9" (UID: "05eac5ef-c815-4d20-b1a9-9f833dc27ee9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:04.185377 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.185357    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-kube-api-access-nlpk7" (OuterVolumeSpecName: "kube-api-access-nlpk7") pod "05eac5ef-c815-4d20-b1a9-9f833dc27ee9" (UID: "05eac5ef-c815-4d20-b1a9-9f833dc27ee9"). InnerVolumeSpecName "kube-api-access-nlpk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:51:04.189839 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.189812    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-util" (OuterVolumeSpecName: "util") pod "05eac5ef-c815-4d20-b1a9-9f833dc27ee9" (UID: "05eac5ef-c815-4d20-b1a9-9f833dc27ee9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:04.284754 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.284713    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:51:04.284754 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.284750    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlpk7\" (UniqueName: \"kubernetes.io/projected/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-kube-api-access-nlpk7\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:51:04.284754 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.284762    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05eac5ef-c815-4d20-b1a9-9f833dc27ee9-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:51:04.640644 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.640604    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bnshp"]
Jul 09 18:51:04.640855 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.640843    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05eac5ef-c815-4d20-b1a9-9f833dc27ee9" containerName="util"
Jul 09 18:51:04.640855 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.640856    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="05eac5ef-c815-4d20-b1a9-9f833dc27ee9" containerName="util"
Jul 09 18:51:04.640943 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.640872    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05eac5ef-c815-4d20-b1a9-9f833dc27ee9" containerName="pull"
Jul 09 18:51:04.640943 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.640877    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="05eac5ef-c815-4d20-b1a9-9f833dc27ee9" containerName="pull"
Jul 09 18:51:04.640943 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.640902    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05eac5ef-c815-4d20-b1a9-9f833dc27ee9" containerName="extract"
Jul 09 18:51:04.640943 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.640909    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="05eac5ef-c815-4d20-b1a9-9f833dc27ee9" containerName="extract"
Jul 09 18:51:04.641081 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.640951    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="05eac5ef-c815-4d20-b1a9-9f833dc27ee9" containerName="extract"
Jul 09 18:51:04.644168 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.644152    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp"
Jul 09 18:51:04.647151 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.647118    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 18:51:04.648344 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.648327    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vpq25\""
Jul 09 18:51:04.648428 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.648334    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 18:51:04.655181 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.655157    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bnshp"]
Jul 09 18:51:04.687921 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.687893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1df6000e-e577-4246-9521-3238bd4b5e4f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bnshp\" (UID: \"1df6000e-e577-4246-9521-3238bd4b5e4f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp"
Jul 09 18:51:04.688046 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.687936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dr6x\" (UniqueName: \"kubernetes.io/projected/1df6000e-e577-4246-9521-3238bd4b5e4f-kube-api-access-4dr6x\") pod \"cert-manager-webhook-6486ffd997-bnshp\" (UID: \"1df6000e-e577-4246-9521-3238bd4b5e4f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp"
Jul 09 18:51:04.788362 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.788337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dr6x\" (UniqueName: \"kubernetes.io/projected/1df6000e-e577-4246-9521-3238bd4b5e4f-kube-api-access-4dr6x\") pod \"cert-manager-webhook-6486ffd997-bnshp\" (UID: \"1df6000e-e577-4246-9521-3238bd4b5e4f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp"
Jul 09 18:51:04.788490 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.788403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1df6000e-e577-4246-9521-3238bd4b5e4f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bnshp\" (UID: \"1df6000e-e577-4246-9521-3238bd4b5e4f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp"
Jul 09 18:51:04.799000 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.798975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dr6x\" (UniqueName: \"kubernetes.io/projected/1df6000e-e577-4246-9521-3238bd4b5e4f-kube-api-access-4dr6x\") pod \"cert-manager-webhook-6486ffd997-bnshp\" (UID: \"1df6000e-e577-4246-9521-3238bd4b5e4f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp"
Jul 09 18:51:04.799000 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.798994    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1df6000e-e577-4246-9521-3238bd4b5e4f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bnshp\" (UID: \"1df6000e-e577-4246-9521-3238bd4b5e4f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp"
Jul 09 18:51:04.961068 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:04.960979    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp"
Jul 09 18:51:05.057148 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:05.056427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z" event={"ID":"05eac5ef-c815-4d20-b1a9-9f833dc27ee9","Type":"ContainerDied","Data":"05be8d2708aaedf0dfcdce8bd8f7f2811b5b19b19a0a291a2560e4c928bae016"}
Jul 09 18:51:05.057148 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:05.056484    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05be8d2708aaedf0dfcdce8bd8f7f2811b5b19b19a0a291a2560e4c928bae016"
Jul 09 18:51:05.057148 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:05.056593    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkqq7z"
Jul 09 18:51:05.092121 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:05.092100    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bnshp"]
Jul 09 18:51:05.094387 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:51:05.094356    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1df6000e_e577_4246_9521_3238bd4b5e4f.slice/crio-70505e5230688dc0dd9565d055d9996673e7deab117e504f1bf49ff34c9cb473 WatchSource:0}: Error finding container 70505e5230688dc0dd9565d055d9996673e7deab117e504f1bf49ff34c9cb473: Status 404 returned error can't find the container with id 70505e5230688dc0dd9565d055d9996673e7deab117e504f1bf49ff34c9cb473
Jul 09 18:51:06.061524 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:06.061451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp" event={"ID":"1df6000e-e577-4246-9521-3238bd4b5e4f","Type":"ContainerStarted","Data":"70505e5230688dc0dd9565d055d9996673e7deab117e504f1bf49ff34c9cb473"}
Jul 09 18:51:11.085229 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:11.085193    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp" event={"ID":"1df6000e-e577-4246-9521-3238bd4b5e4f","Type":"ContainerStarted","Data":"98828630a7221e39a965559137eb230bf412b9bfeb881e42f0f129e22659b225"}
Jul 09 18:51:11.085630 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:11.085247    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp"
Jul 09 18:51:11.120735 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:11.120687    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp" podStartSLOduration=1.957995674 podStartE2EDuration="7.120671228s" totalImagesPullingTime="5.162675554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:11.118425679 +0000 UTC m=+356.912549726" watchObservedRunningTime="2026-07-09 18:51:11.120671228 +0000 UTC m=+356.914795256"
Jul 09 18:51:13.303993 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.303956    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"]
Jul 09 18:51:13.358827 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.358792    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"]
Jul 09 18:51:13.358983 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.358879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"
Jul 09 18:51:13.365583 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.365560    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 18:51:13.365702 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.365665    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2smrv\""
Jul 09 18:51:13.366563 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.366548    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:51:13.453125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.453089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kwcx\" (UniqueName: \"kubernetes.io/projected/61cc0a7b-49b7-4878-8c8b-a2dd738cad26-kube-api-access-9kwcx\") pod \"openshift-lws-operator-fd8ccff4c-9whnn\" (UID: \"61cc0a7b-49b7-4878-8c8b-a2dd738cad26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"
Jul 09 18:51:13.453279 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.453137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61cc0a7b-49b7-4878-8c8b-a2dd738cad26-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9whnn\" (UID: \"61cc0a7b-49b7-4878-8c8b-a2dd738cad26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"
Jul 09 18:51:13.553549 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.553510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61cc0a7b-49b7-4878-8c8b-a2dd738cad26-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9whnn\" (UID: \"61cc0a7b-49b7-4878-8c8b-a2dd738cad26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"
Jul 09 18:51:13.553696 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.553604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kwcx\" (UniqueName: \"kubernetes.io/projected/61cc0a7b-49b7-4878-8c8b-a2dd738cad26-kube-api-access-9kwcx\") pod \"openshift-lws-operator-fd8ccff4c-9whnn\" (UID: \"61cc0a7b-49b7-4878-8c8b-a2dd738cad26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"
Jul 09 18:51:13.553917 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.553897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61cc0a7b-49b7-4878-8c8b-a2dd738cad26-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9whnn\" (UID: \"61cc0a7b-49b7-4878-8c8b-a2dd738cad26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"
Jul 09 18:51:13.564575 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.564507    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kwcx\" (UniqueName: \"kubernetes.io/projected/61cc0a7b-49b7-4878-8c8b-a2dd738cad26-kube-api-access-9kwcx\") pod \"openshift-lws-operator-fd8ccff4c-9whnn\" (UID: \"61cc0a7b-49b7-4878-8c8b-a2dd738cad26\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"
Jul 09 18:51:13.667908 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.667872    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"
Jul 09 18:51:13.823582 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:13.823479    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn"]
Jul 09 18:51:13.826648 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:51:13.826617    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61cc0a7b_49b7_4878_8c8b_a2dd738cad26.slice/crio-7e45b1fa6b3a0ae882a6af0562294072cf59254f83c3146352a174573f62252a WatchSource:0}: Error finding container 7e45b1fa6b3a0ae882a6af0562294072cf59254f83c3146352a174573f62252a: Status 404 returned error can't find the container with id 7e45b1fa6b3a0ae882a6af0562294072cf59254f83c3146352a174573f62252a
Jul 09 18:51:14.098342 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:14.098311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn" event={"ID":"61cc0a7b-49b7-4878-8c8b-a2dd738cad26","Type":"ContainerStarted","Data":"7e45b1fa6b3a0ae882a6af0562294072cf59254f83c3146352a174573f62252a"}
Jul 09 18:51:17.092706 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:17.092679    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bnshp"
Jul 09 18:51:17.112328 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:17.112300    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn" event={"ID":"61cc0a7b-49b7-4878-8c8b-a2dd738cad26","Type":"ContainerStarted","Data":"768fde34a45c4febb82bd3fb96054aaaa76b6be5e2ea2a5acbbc246cf2cfbffb"}
Jul 09 18:51:17.158227 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:17.158176    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9whnn" podStartSLOduration=1.419666675 podStartE2EDuration="4.158159393s" totalImagesPullingTime="2.738492718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:17.157793059 +0000 UTC m=+362.951917121" watchObservedRunningTime="2026-07-09 18:51:17.158159393 +0000 UTC m=+362.952283421"
Jul 09 18:51:19.671497 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.671464    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"]
Jul 09 18:51:19.674096 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.674079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:19.679054 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.679036    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:51:19.679427 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.679409    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:51:19.680344 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.680327    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-glt5v\""
Jul 09 18:51:19.686997 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.686980    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"]
Jul 09 18:51:19.703576 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.703554    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:19.703683 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.703590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:19.703683 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.703617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j6rb\" (UniqueName: \"kubernetes.io/projected/338d8bed-31b2-4a6a-8899-746578c413b6-kube-api-access-4j6rb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:19.804620 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.804590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j6rb\" (UniqueName: \"kubernetes.io/projected/338d8bed-31b2-4a6a-8899-746578c413b6-kube-api-access-4j6rb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:19.804777 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.804657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:19.804777 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.804683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:19.805064 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.805047    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:19.805099 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.805073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:19.823881 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.823858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j6rb\" (UniqueName: \"kubernetes.io/projected/338d8bed-31b2-4a6a-8899-746578c413b6-kube-api-access-4j6rb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:19.983105 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:19.983027    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:20.125366 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:20.125214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"]
Jul 09 18:51:20.128015 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:51:20.127988    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338d8bed_31b2_4a6a_8899_746578c413b6.slice/crio-83518ac561169292b24c828257ad83ee2f44e00a31d0ea7b558c4a22b0ed9482 WatchSource:0}: Error finding container 83518ac561169292b24c828257ad83ee2f44e00a31d0ea7b558c4a22b0ed9482: Status 404 returned error can't find the container with id 83518ac561169292b24c828257ad83ee2f44e00a31d0ea7b558c4a22b0ed9482
Jul 09 18:51:21.130111 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:21.130076    2581 generic.go:356] "Generic (PLEG): container finished" podID="338d8bed-31b2-4a6a-8899-746578c413b6" containerID="a712dfa0a0b0d7ec28c36ec2395d23e25c0ad72a908b99c272ced64afba99fc9" exitCode=0
Jul 09 18:51:21.130511 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:21.130173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984" event={"ID":"338d8bed-31b2-4a6a-8899-746578c413b6","Type":"ContainerDied","Data":"a712dfa0a0b0d7ec28c36ec2395d23e25c0ad72a908b99c272ced64afba99fc9"}
Jul 09 18:51:21.130511 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:21.130232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984" event={"ID":"338d8bed-31b2-4a6a-8899-746578c413b6","Type":"ContainerStarted","Data":"83518ac561169292b24c828257ad83ee2f44e00a31d0ea7b558c4a22b0ed9482"}
Jul 09 18:51:22.136696 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:22.136604    2581 generic.go:356] "Generic (PLEG): container finished" podID="338d8bed-31b2-4a6a-8899-746578c413b6" containerID="44bb963cc1a2ee5939e1ada7e0ca103bcdaba0a30b1b356074dc518e3409c3fe" exitCode=0
Jul 09 18:51:22.137064 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:22.136694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984" event={"ID":"338d8bed-31b2-4a6a-8899-746578c413b6","Type":"ContainerDied","Data":"44bb963cc1a2ee5939e1ada7e0ca103bcdaba0a30b1b356074dc518e3409c3fe"}
Jul 09 18:51:23.143240 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:23.143199    2581 generic.go:356] "Generic (PLEG): container finished" podID="338d8bed-31b2-4a6a-8899-746578c413b6" containerID="5c9eb98028da6f00c7b0ef33537894585f781421c8b58464b0b65315461d2f91" exitCode=0
Jul 09 18:51:23.143745 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:23.143258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984" event={"ID":"338d8bed-31b2-4a6a-8899-746578c413b6","Type":"ContainerDied","Data":"5c9eb98028da6f00c7b0ef33537894585f781421c8b58464b0b65315461d2f91"}
Jul 09 18:51:24.268815 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:24.268791    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:24.341411 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:24.341372    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-bundle\") pod \"338d8bed-31b2-4a6a-8899-746578c413b6\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") "
Jul 09 18:51:24.341598 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:24.341421    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j6rb\" (UniqueName: \"kubernetes.io/projected/338d8bed-31b2-4a6a-8899-746578c413b6-kube-api-access-4j6rb\") pod \"338d8bed-31b2-4a6a-8899-746578c413b6\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") "
Jul 09 18:51:24.341598 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:24.341470    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-util\") pod \"338d8bed-31b2-4a6a-8899-746578c413b6\" (UID: \"338d8bed-31b2-4a6a-8899-746578c413b6\") "
Jul 09 18:51:24.342155 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:24.342121    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-bundle" (OuterVolumeSpecName: "bundle") pod "338d8bed-31b2-4a6a-8899-746578c413b6" (UID: "338d8bed-31b2-4a6a-8899-746578c413b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:24.343659 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:24.343637    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/338d8bed-31b2-4a6a-8899-746578c413b6-kube-api-access-4j6rb" (OuterVolumeSpecName: "kube-api-access-4j6rb") pod "338d8bed-31b2-4a6a-8899-746578c413b6" (UID: "338d8bed-31b2-4a6a-8899-746578c413b6"). InnerVolumeSpecName "kube-api-access-4j6rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:51:24.346911 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:24.346877    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-util" (OuterVolumeSpecName: "util") pod "338d8bed-31b2-4a6a-8899-746578c413b6" (UID: "338d8bed-31b2-4a6a-8899-746578c413b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:24.442838 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:24.442759    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:51:24.442838 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:24.442784    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/338d8bed-31b2-4a6a-8899-746578c413b6-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:51:24.442838 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:24.442793    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j6rb\" (UniqueName: \"kubernetes.io/projected/338d8bed-31b2-4a6a-8899-746578c413b6-kube-api-access-4j6rb\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:51:25.153718 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:25.153687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984" event={"ID":"338d8bed-31b2-4a6a-8899-746578c413b6","Type":"ContainerDied","Data":"83518ac561169292b24c828257ad83ee2f44e00a31d0ea7b558c4a22b0ed9482"}
Jul 09 18:51:25.153718 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:25.153707    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7d984"
Jul 09 18:51:25.153910 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:25.153732    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83518ac561169292b24c828257ad83ee2f44e00a31d0ea7b558c4a22b0ed9482"
Jul 09 18:51:32.815722 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.815685    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"]
Jul 09 18:51:32.816106 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.815925    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="338d8bed-31b2-4a6a-8899-746578c413b6" containerName="util"
Jul 09 18:51:32.816106 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.815934    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="338d8bed-31b2-4a6a-8899-746578c413b6" containerName="util"
Jul 09 18:51:32.816106 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.815943    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="338d8bed-31b2-4a6a-8899-746578c413b6" containerName="pull"
Jul 09 18:51:32.816106 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.815948    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="338d8bed-31b2-4a6a-8899-746578c413b6" containerName="pull"
Jul 09 18:51:32.816106 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.815962    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="338d8bed-31b2-4a6a-8899-746578c413b6" containerName="extract"
Jul 09 18:51:32.816106 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.815968    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="338d8bed-31b2-4a6a-8899-746578c413b6" containerName="extract"
Jul 09 18:51:32.816106 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.816011    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="338d8bed-31b2-4a6a-8899-746578c413b6" containerName="extract"
Jul 09 18:51:32.818260 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.818244    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:32.821240 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.821219    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 18:51:32.821357 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.821251    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9cq6g\""
Jul 09 18:51:32.821488 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.821474    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 18:51:32.821527 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.821504    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 18:51:32.821954 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.821938    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 18:51:32.839790 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.839770    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"]
Jul 09 18:51:32.905896 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.905860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4120eb56-8eb8-4797-95cd-47d1244e2e3b-manifests\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:32.906054 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.905912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4120eb56-8eb8-4797-95cd-47d1244e2e3b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:32.906054 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.906003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxvbq\" (UniqueName: \"kubernetes.io/projected/4120eb56-8eb8-4797-95cd-47d1244e2e3b-kube-api-access-vxvbq\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:32.906054 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.906036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4120eb56-8eb8-4797-95cd-47d1244e2e3b-tmp\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:32.906207 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:32.906053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4120eb56-8eb8-4797-95cd-47d1244e2e3b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.006934 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.006901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxvbq\" (UniqueName: \"kubernetes.io/projected/4120eb56-8eb8-4797-95cd-47d1244e2e3b-kube-api-access-vxvbq\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.006934 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.006937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4120eb56-8eb8-4797-95cd-47d1244e2e3b-tmp\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.007173 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.006963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4120eb56-8eb8-4797-95cd-47d1244e2e3b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.007173 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.006999    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4120eb56-8eb8-4797-95cd-47d1244e2e3b-manifests\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.007173 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.007046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4120eb56-8eb8-4797-95cd-47d1244e2e3b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.007379 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.007359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4120eb56-8eb8-4797-95cd-47d1244e2e3b-manifests\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.009507 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.009472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4120eb56-8eb8-4797-95cd-47d1244e2e3b-tmp\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.009631 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.009511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4120eb56-8eb8-4797-95cd-47d1244e2e3b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.009674 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.009651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4120eb56-8eb8-4797-95cd-47d1244e2e3b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.018670 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.018650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxvbq\" (UniqueName: \"kubernetes.io/projected/4120eb56-8eb8-4797-95cd-47d1244e2e3b-kube-api-access-vxvbq\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5\" (UID: \"4120eb56-8eb8-4797-95cd-47d1244e2e3b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.128123 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.128092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:33.265127 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:33.265090    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"]
Jul 09 18:51:33.268111 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:51:33.268081    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4120eb56_8eb8_4797_95cd_47d1244e2e3b.slice/crio-4ba772c34cdac10a80d82b567ffdb79e5878125bb33433d8dce30f6912c5638d WatchSource:0}: Error finding container 4ba772c34cdac10a80d82b567ffdb79e5878125bb33433d8dce30f6912c5638d: Status 404 returned error can't find the container with id 4ba772c34cdac10a80d82b567ffdb79e5878125bb33433d8dce30f6912c5638d
Jul 09 18:51:34.192379 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:34.192298    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5" event={"ID":"4120eb56-8eb8-4797-95cd-47d1244e2e3b","Type":"ContainerStarted","Data":"4ba772c34cdac10a80d82b567ffdb79e5878125bb33433d8dce30f6912c5638d"}
Jul 09 18:51:37.210350 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:37.210310    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5" event={"ID":"4120eb56-8eb8-4797-95cd-47d1244e2e3b","Type":"ContainerStarted","Data":"365800be5bc97691609c43d3b59fea4e7ef133a0ee1d86570838fc96eed8cbba"}
Jul 09 18:51:38.216507 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:38.216468    2581 generic.go:356] "Generic (PLEG): container finished" podID="4120eb56-8eb8-4797-95cd-47d1244e2e3b" containerID="365800be5bc97691609c43d3b59fea4e7ef133a0ee1d86570838fc96eed8cbba" exitCode=0
Jul 09 18:51:38.216906 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:38.216575    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5" event={"ID":"4120eb56-8eb8-4797-95cd-47d1244e2e3b","Type":"ContainerDied","Data":"365800be5bc97691609c43d3b59fea4e7ef133a0ee1d86570838fc96eed8cbba"}
Jul 09 18:51:39.222373 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:39.222335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5" event={"ID":"4120eb56-8eb8-4797-95cd-47d1244e2e3b","Type":"ContainerStarted","Data":"f37b18c618c0324c5303519dc5463c3d473f7d92b326e484a6753aa507429e61"}
Jul 09 18:51:39.222746 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:39.222416    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:39.252802 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:39.252755    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5" podStartSLOduration=3.004845936 podStartE2EDuration="7.252739456s" totalImagesPullingTime="3.236905306s" totalInitContainerRuntime="1.010988214s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:39.25127501 +0000 UTC m=+385.045399068" watchObservedRunningTime="2026-07-09 18:51:39.252739456 +0000 UTC m=+385.046863485"
Jul 09 18:51:50.228341 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:50.228309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5"
Jul 09 18:51:52.765776 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.765746    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"]
Jul 09 18:51:52.775489 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.775466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.788038 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.788012    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 18:51:52.788160 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.788111    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 18:51:52.788323 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.788307    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 18:51:52.788376 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.788357    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p2hnx\""
Jul 09 18:51:52.795402 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.795384    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"]
Jul 09 18:51:52.871299 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.871261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e6c9bea-e69c-41b3-944d-85561765bfa1-cert\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.871474 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.871376    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cdnm\" (UniqueName: \"kubernetes.io/projected/6e6c9bea-e69c-41b3-944d-85561765bfa1-kube-api-access-5cdnm\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.871474 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.871438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6e6c9bea-e69c-41b3-944d-85561765bfa1-manager-config\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.871615 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.871478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e6c9bea-e69c-41b3-944d-85561765bfa1-metrics-cert\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.972930 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.972898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6e6c9bea-e69c-41b3-944d-85561765bfa1-manager-config\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.972930 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.972946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e6c9bea-e69c-41b3-944d-85561765bfa1-metrics-cert\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.973172 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.973010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e6c9bea-e69c-41b3-944d-85561765bfa1-cert\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.973172 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.973042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cdnm\" (UniqueName: \"kubernetes.io/projected/6e6c9bea-e69c-41b3-944d-85561765bfa1-kube-api-access-5cdnm\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.973766 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.973712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6e6c9bea-e69c-41b3-944d-85561765bfa1-manager-config\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.976002 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.975978    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e6c9bea-e69c-41b3-944d-85561765bfa1-cert\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.976262 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.976240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e6c9bea-e69c-41b3-944d-85561765bfa1-metrics-cert\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:52.984828 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:52.984803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cdnm\" (UniqueName: \"kubernetes.io/projected/6e6c9bea-e69c-41b3-944d-85561765bfa1-kube-api-access-5cdnm\") pod \"lws-controller-manager-5f9b9fdbf7-jdzxc\" (UID: \"6e6c9bea-e69c-41b3-944d-85561765bfa1\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:53.085062 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:53.084974    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:53.227682 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:53.227477    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"]
Jul 09 18:51:53.230525 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:51:53.230501    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6c9bea_e69c_41b3_944d_85561765bfa1.slice/crio-df75692c3c34d6638da10bd3cb3875293dd382d6f6f389697ed4c4f8020f75e7 WatchSource:0}: Error finding container df75692c3c34d6638da10bd3cb3875293dd382d6f6f389697ed4c4f8020f75e7: Status 404 returned error can't find the container with id df75692c3c34d6638da10bd3cb3875293dd382d6f6f389697ed4c4f8020f75e7
Jul 09 18:51:53.280656 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:53.280624    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc" event={"ID":"6e6c9bea-e69c-41b3-944d-85561765bfa1","Type":"ContainerStarted","Data":"df75692c3c34d6638da10bd3cb3875293dd382d6f6f389697ed4c4f8020f75e7"}
Jul 09 18:51:55.292619 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:55.292515    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc" event={"ID":"6e6c9bea-e69c-41b3-944d-85561765bfa1","Type":"ContainerStarted","Data":"a9bfb2becccc8b92adbd6e7e054945353c32e35b153d9510b1a526cdc56c1d07"}
Jul 09 18:51:55.292990 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:55.292673    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:51:55.314396 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:51:55.314350    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc" podStartSLOduration=1.512422 podStartE2EDuration="3.314337077s" totalImagesPullingTime="1.801915077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:55.314179767 +0000 UTC m=+401.108303796" watchObservedRunningTime="2026-07-09 18:51:55.314337077 +0000 UTC m=+401.108461106"
Jul 09 18:52:00.039378 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.039340    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"]
Jul 09 18:52:00.043064 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.043045    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.046101 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.046082    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n67d5\""
Jul 09 18:52:00.046441 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.046420    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 18:52:00.059459 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.059427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"]
Jul 09 18:52:00.130838 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.130806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b13886bf-a723-41e3-b19f-980aa456be4b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.131040 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.130866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.131040 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.130896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.131040 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.130922    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.131040 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.130946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.131040 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.130969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwgtc\" (UniqueName: \"kubernetes.io/projected/b13886bf-a723-41e3-b19f-980aa456be4b-kube-api-access-xwgtc\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.131040 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.130996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b13886bf-a723-41e3-b19f-980aa456be4b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.131272 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.131044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b13886bf-a723-41e3-b19f-980aa456be4b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.131272 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.131079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.231610 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.231580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.231610 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.231614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwgtc\" (UniqueName: \"kubernetes.io/projected/b13886bf-a723-41e3-b19f-980aa456be4b-kube-api-access-xwgtc\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.231914 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.231637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b13886bf-a723-41e3-b19f-980aa456be4b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.231914 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.231665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b13886bf-a723-41e3-b19f-980aa456be4b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.231914 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.231688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.231914 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.231715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b13886bf-a723-41e3-b19f-980aa456be4b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.231914 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.231748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.231914 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.231765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.231914 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.231789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.232230 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.232141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.232290 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.232233    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.232340 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.232301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.232397 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.232362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.232646 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.232624    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b13886bf-a723-41e3-b19f-980aa456be4b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.234033 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.234014    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b13886bf-a723-41e3-b19f-980aa456be4b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.234393 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.234376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b13886bf-a723-41e3-b19f-980aa456be4b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.245700 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.245675    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwgtc\" (UniqueName: \"kubernetes.io/projected/b13886bf-a723-41e3-b19f-980aa456be4b-kube-api-access-xwgtc\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.250741 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.250722    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b13886bf-a723-41e3-b19f-980aa456be4b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678pxr2p\" (UID: \"b13886bf-a723-41e3-b19f-980aa456be4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.353223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.353193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:00.491465 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:00.491440    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"]
Jul 09 18:52:00.494221 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:52:00.494191    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13886bf_a723_41e3_b19f_980aa456be4b.slice/crio-3707a105cd839a7bec2b34368e7cb039fc5e4503942587a228b0cdaf4a81838f WatchSource:0}: Error finding container 3707a105cd839a7bec2b34368e7cb039fc5e4503942587a228b0cdaf4a81838f: Status 404 returned error can't find the container with id 3707a105cd839a7bec2b34368e7cb039fc5e4503942587a228b0cdaf4a81838f
Jul 09 18:52:01.008880 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.008849    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"]
Jul 09 18:52:01.013125 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.013109    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.016437 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.016409    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 18:52:01.016437 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.016431    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 18:52:01.016641 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.016474    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gx42g\""
Jul 09 18:52:01.016641 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.016520    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 18:52:01.026886 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.026864    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"]
Jul 09 18:52:01.140747 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.140716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/787ee0f8-852f-4348-915c-893015003d53-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.140747 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.140750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/787ee0f8-852f-4348-915c-893015003d53-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.141188 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.140769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/787ee0f8-852f-4348-915c-893015003d53-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.141188 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.140834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/787ee0f8-852f-4348-915c-893015003d53-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.141188 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.140909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/787ee0f8-852f-4348-915c-893015003d53-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.141188 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.140937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/787ee0f8-852f-4348-915c-893015003d53-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.141188 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.140968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w688\" (UniqueName: \"kubernetes.io/projected/787ee0f8-852f-4348-915c-893015003d53-kube-api-access-5w688\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.242217 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.242185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/787ee0f8-852f-4348-915c-893015003d53-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.242217 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.242219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/787ee0f8-852f-4348-915c-893015003d53-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.242393 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.242244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w688\" (UniqueName: \"kubernetes.io/projected/787ee0f8-852f-4348-915c-893015003d53-kube-api-access-5w688\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.242393 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.242362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/787ee0f8-852f-4348-915c-893015003d53-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.242495 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.242392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/787ee0f8-852f-4348-915c-893015003d53-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.242495 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.242416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/787ee0f8-852f-4348-915c-893015003d53-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.242495 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.242443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/787ee0f8-852f-4348-915c-893015003d53-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.243418 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.243390    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/787ee0f8-852f-4348-915c-893015003d53-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.244794 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.244771    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/787ee0f8-852f-4348-915c-893015003d53-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.244893 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.244776    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/787ee0f8-852f-4348-915c-893015003d53-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.244934 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.244890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/787ee0f8-852f-4348-915c-893015003d53-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.245010 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.244991    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/787ee0f8-852f-4348-915c-893015003d53-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.255868 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.255845    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w688\" (UniqueName: \"kubernetes.io/projected/787ee0f8-852f-4348-915c-893015003d53-kube-api-access-5w688\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.256014 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.255993    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/787ee0f8-852f-4348-915c-893015003d53-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-99tz8\" (UID: \"787ee0f8-852f-4348-915c-893015003d53\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.322503 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.322436    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:01.323466 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.323442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p" event={"ID":"b13886bf-a723-41e3-b19f-980aa456be4b","Type":"ContainerStarted","Data":"3707a105cd839a7bec2b34368e7cb039fc5e4503942587a228b0cdaf4a81838f"}
Jul 09 18:52:01.511499 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:01.511461    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"]
Jul 09 18:52:01.512650 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:52:01.512614    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787ee0f8_852f_4348_915c_893015003d53.slice/crio-60fdcce2d8faa0adbc58122f2cc84afb112b18a9e9cd49f2aa8bcb3834815543 WatchSource:0}: Error finding container 60fdcce2d8faa0adbc58122f2cc84afb112b18a9e9cd49f2aa8bcb3834815543: Status 404 returned error can't find the container with id 60fdcce2d8faa0adbc58122f2cc84afb112b18a9e9cd49f2aa8bcb3834815543
Jul 09 18:52:02.330116 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:02.330080    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8" event={"ID":"787ee0f8-852f-4348-915c-893015003d53","Type":"ContainerStarted","Data":"60fdcce2d8faa0adbc58122f2cc84afb112b18a9e9cd49f2aa8bcb3834815543"}
Jul 09 18:52:04.881050 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:04.881017    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 18:52:04.881332 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:04.881094    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 18:52:04.881332 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:04.881121    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 18:52:04.882286 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:04.882262    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 18:52:04.882349 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:04.882314    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 18:52:05.349014 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:05.348972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p" event={"ID":"b13886bf-a723-41e3-b19f-980aa456be4b","Type":"ContainerStarted","Data":"7d9e1c79d74265f9441a5a184779a41af8bc0ed238971a22ac4dba8d742e3cc3"}
Jul 09 18:52:05.350847 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:05.350822    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8" event={"ID":"787ee0f8-852f-4348-915c-893015003d53","Type":"ContainerStarted","Data":"1e02af294bc1b5d47a1a4de4ba085388b1721e0245c67debb8c953f8d0e62409"}
Jul 09 18:52:05.351045 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:05.351027    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:05.352521 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:05.352499    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-99tz8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 18:52:05.352622 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:05.352566    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8" podUID="787ee0f8-852f-4348-915c-893015003d53" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 18:52:05.353592 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:05.353569    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:05.354602 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:05.354585    2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 09 18:52:05.354682 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:05.354624    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p" podUID="b13886bf-a723-41e3-b19f-980aa456be4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 09 18:52:05.417518 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:05.417444    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p" podStartSLOduration=1.032891092 podStartE2EDuration="5.41742703s" totalImagesPullingTime="4.384535938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:52:05.382988206 +0000 UTC m=+411.177112266" watchObservedRunningTime="2026-07-09 18:52:05.41742703 +0000 UTC m=+411.211551059"
Jul 09 18:52:05.417961 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:05.417924    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8" podStartSLOduration=2.051109299 podStartE2EDuration="5.417905144s" totalImagesPullingTime="3.366795845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:52:05.416850458 +0000 UTC m=+411.210974487" watchObservedRunningTime="2026-07-09 18:52:05.417905144 +0000 UTC m=+411.212029165"
Jul 09 18:52:06.299478 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:06.299447    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-jdzxc"
Jul 09 18:52:06.356297 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:06.356267    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-99tz8"
Jul 09 18:52:06.357143 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:06.357120    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:07.359319 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:07.359293    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:52:07.360341 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:52:07.360319    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678pxr2p"
Jul 09 18:53:08.566150 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.566114    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"]
Jul 09 18:53:08.568381 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.568365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:08.571442 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.571423    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 18:53:08.572729 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.572712    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 18:53:08.572858 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.572730    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4qkh2\""
Jul 09 18:53:08.578890 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.578861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"]
Jul 09 18:53:08.610394 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.610365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:08.610556 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.610431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:08.610556 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.610519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75gv\" (UniqueName: \"kubernetes.io/projected/f9869c79-0709-4589-a4b3-62b4baa3743d-kube-api-access-c75gv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:08.711562 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.711502    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c75gv\" (UniqueName: \"kubernetes.io/projected/f9869c79-0709-4589-a4b3-62b4baa3743d-kube-api-access-c75gv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:08.711736 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.711580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:08.711736 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.711651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:08.711968 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.711950    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:08.712009 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.711977    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:08.721925 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.721895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75gv\" (UniqueName: \"kubernetes.io/projected/f9869c79-0709-4589-a4b3-62b4baa3743d-kube-api-access-c75gv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:08.878404 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:08.878356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:09.008873 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.008843    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"]
Jul 09 18:53:09.011503 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:53:09.011477    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9869c79_0709_4589_a4b3_62b4baa3743d.slice/crio-097a9980863537685c1da3903681b0d7de095f1271ae42e9af24d6e5e8eebe81 WatchSource:0}: Error finding container 097a9980863537685c1da3903681b0d7de095f1271ae42e9af24d6e5e8eebe81: Status 404 returned error can't find the container with id 097a9980863537685c1da3903681b0d7de095f1271ae42e9af24d6e5e8eebe81
Jul 09 18:53:09.157505 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.157432    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"]
Jul 09 18:53:09.159938 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.159922    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.171522 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.171497    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"]
Jul 09 18:53:09.215336 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.215298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.215499 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.215351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8rh4\" (UniqueName: \"kubernetes.io/projected/ff0b2514-3df0-4109-9810-ebd9a0478e7a-kube-api-access-f8rh4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.215499 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.215436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.316663 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.316623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.316802 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.316679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8rh4\" (UniqueName: \"kubernetes.io/projected/ff0b2514-3df0-4109-9810-ebd9a0478e7a-kube-api-access-f8rh4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.316802 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.316720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.317110 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.317093    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.317146 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.317095    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.326945 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.326917    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8rh4\" (UniqueName: \"kubernetes.io/projected/ff0b2514-3df0-4109-9810-ebd9a0478e7a-kube-api-access-f8rh4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.470745 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.470643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:09.560501 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.560468    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"]
Jul 09 18:53:09.568319 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.568289    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.575298 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.575268    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"]
Jul 09 18:53:09.607708 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.607687    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"]
Jul 09 18:53:09.609362 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:53:09.609332    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0b2514_3df0_4109_9810_ebd9a0478e7a.slice/crio-8cfa45a59826ef0bc9c30dc8066d2fc699e9a5d161f082b0da20376648ef08ad WatchSource:0}: Error finding container 8cfa45a59826ef0bc9c30dc8066d2fc699e9a5d161f082b0da20376648ef08ad: Status 404 returned error can't find the container with id 8cfa45a59826ef0bc9c30dc8066d2fc699e9a5d161f082b0da20376648ef08ad
Jul 09 18:53:09.619695 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.619671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.619801 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.619734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2jsv\" (UniqueName: \"kubernetes.io/projected/fe4fa3e5-a453-4f97-a71b-57968f947297-kube-api-access-h2jsv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.619861 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.619803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.625418 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.625394    2581 generic.go:356] "Generic (PLEG): container finished" podID="f9869c79-0709-4589-a4b3-62b4baa3743d" containerID="ec820fe5b040eb0e9c4dbde26a3c8dfafab9758d420e047972a452df73b3356a" exitCode=0
Jul 09 18:53:09.625517 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.625478    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d" event={"ID":"f9869c79-0709-4589-a4b3-62b4baa3743d","Type":"ContainerDied","Data":"ec820fe5b040eb0e9c4dbde26a3c8dfafab9758d420e047972a452df73b3356a"}
Jul 09 18:53:09.625599 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.625548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d" event={"ID":"f9869c79-0709-4589-a4b3-62b4baa3743d","Type":"ContainerStarted","Data":"097a9980863537685c1da3903681b0d7de095f1271ae42e9af24d6e5e8eebe81"}
Jul 09 18:53:09.626980 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.626958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk" event={"ID":"ff0b2514-3df0-4109-9810-ebd9a0478e7a","Type":"ContainerStarted","Data":"8cfa45a59826ef0bc9c30dc8066d2fc699e9a5d161f082b0da20376648ef08ad"}
Jul 09 18:53:09.720335 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.720306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.720443 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.720361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.720443 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.720412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2jsv\" (UniqueName: \"kubernetes.io/projected/fe4fa3e5-a453-4f97-a71b-57968f947297-kube-api-access-h2jsv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.720773 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.720728    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.720773 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.720753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.730483 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.730464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2jsv\" (UniqueName: \"kubernetes.io/projected/fe4fa3e5-a453-4f97-a71b-57968f947297-kube-api-access-h2jsv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.880798 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.880763    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:09.957451 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.957411    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"]
Jul 09 18:53:09.960417 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.960399    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:09.972620 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:09.972558    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"]
Jul 09 18:53:10.017635 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.017611    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"]
Jul 09 18:53:10.019665 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:53:10.019626    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4fa3e5_a453_4f97_a71b_57968f947297.slice/crio-ae582c2296bb945617b5ba4cc356bbf16efcaa2dfe8922623e391d21975a59bf WatchSource:0}: Error finding container ae582c2296bb945617b5ba4cc356bbf16efcaa2dfe8922623e391d21975a59bf: Status 404 returned error can't find the container with id ae582c2296bb945617b5ba4cc356bbf16efcaa2dfe8922623e391d21975a59bf
Jul 09 18:53:10.024019 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.023997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:10.024120 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.024055    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:10.024179 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.024134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgv7j\" (UniqueName: \"kubernetes.io/projected/141bb1ac-1580-4ca6-8604-7b9c23f496ee-kube-api-access-tgv7j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:10.125445 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.125418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:10.125584 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.125503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:10.125584 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.125564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgv7j\" (UniqueName: \"kubernetes.io/projected/141bb1ac-1580-4ca6-8604-7b9c23f496ee-kube-api-access-tgv7j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:10.125926 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.125904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:10.125965 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.125914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:10.136355 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.136334    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgv7j\" (UniqueName: \"kubernetes.io/projected/141bb1ac-1580-4ca6-8604-7b9c23f496ee-kube-api-access-tgv7j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:10.273434 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.273350    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:10.407679 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.407656    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"]
Jul 09 18:53:10.456135 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:53:10.456105    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141bb1ac_1580_4ca6_8604_7b9c23f496ee.slice/crio-c7cc03486c23c2983ca64f84e21e28828854de81908c994af0052516dd806242 WatchSource:0}: Error finding container c7cc03486c23c2983ca64f84e21e28828854de81908c994af0052516dd806242: Status 404 returned error can't find the container with id c7cc03486c23c2983ca64f84e21e28828854de81908c994af0052516dd806242
Jul 09 18:53:10.632566 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.632516    2581 generic.go:356] "Generic (PLEG): container finished" podID="141bb1ac-1580-4ca6-8604-7b9c23f496ee" containerID="39448f37cf5fc4dfc47e5b435b7cdcbd53a6e292c36d0cdff1014cd6396f1252" exitCode=0
Jul 09 18:53:10.632952 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.632583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx" event={"ID":"141bb1ac-1580-4ca6-8604-7b9c23f496ee","Type":"ContainerDied","Data":"39448f37cf5fc4dfc47e5b435b7cdcbd53a6e292c36d0cdff1014cd6396f1252"}
Jul 09 18:53:10.632952 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.632636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx" event={"ID":"141bb1ac-1580-4ca6-8604-7b9c23f496ee","Type":"ContainerStarted","Data":"c7cc03486c23c2983ca64f84e21e28828854de81908c994af0052516dd806242"}
Jul 09 18:53:10.634165 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.634146    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff0b2514-3df0-4109-9810-ebd9a0478e7a" containerID="0e5748205a740a1a79f95736529d9c52aa849d9232d9daee0ce8eb512a006015" exitCode=0
Jul 09 18:53:10.634291 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.634214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk" event={"ID":"ff0b2514-3df0-4109-9810-ebd9a0478e7a","Type":"ContainerDied","Data":"0e5748205a740a1a79f95736529d9c52aa849d9232d9daee0ce8eb512a006015"}
Jul 09 18:53:10.635934 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.635912    2581 generic.go:356] "Generic (PLEG): container finished" podID="fe4fa3e5-a453-4f97-a71b-57968f947297" containerID="6a8b7fb742f780fbf147d186ac1673463ab995837d16be1e7daa20a901833da8" exitCode=0
Jul 09 18:53:10.636041 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.635957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk" event={"ID":"fe4fa3e5-a453-4f97-a71b-57968f947297","Type":"ContainerDied","Data":"6a8b7fb742f780fbf147d186ac1673463ab995837d16be1e7daa20a901833da8"}
Jul 09 18:53:10.636041 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.635994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk" event={"ID":"fe4fa3e5-a453-4f97-a71b-57968f947297","Type":"ContainerStarted","Data":"ae582c2296bb945617b5ba4cc356bbf16efcaa2dfe8922623e391d21975a59bf"}
Jul 09 18:53:10.638017 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.638001    2581 generic.go:356] "Generic (PLEG): container finished" podID="f9869c79-0709-4589-a4b3-62b4baa3743d" containerID="edfe736153dbc0a7c43f87ad6fe163c8bd3fb7f0018f2535aa4e02578a00f112" exitCode=0
Jul 09 18:53:10.638110 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:10.638096    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d" event={"ID":"f9869c79-0709-4589-a4b3-62b4baa3743d","Type":"ContainerDied","Data":"edfe736153dbc0a7c43f87ad6fe163c8bd3fb7f0018f2535aa4e02578a00f112"}
Jul 09 18:53:11.646913 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:11.646878    2581 generic.go:356] "Generic (PLEG): container finished" podID="141bb1ac-1580-4ca6-8604-7b9c23f496ee" containerID="267a38d4f3bdd48149528526ad626cf413f01a2de2044137eb7248fbc9835246" exitCode=0
Jul 09 18:53:11.647286 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:11.646958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx" event={"ID":"141bb1ac-1580-4ca6-8604-7b9c23f496ee","Type":"ContainerDied","Data":"267a38d4f3bdd48149528526ad626cf413f01a2de2044137eb7248fbc9835246"}
Jul 09 18:53:11.648792 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:11.648761    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff0b2514-3df0-4109-9810-ebd9a0478e7a" containerID="074b9f50b967f38ba5f2c1d6e6754332ce0cd0dd3f370c5a8f7ec17d4a889688" exitCode=0
Jul 09 18:53:11.648881 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:11.648829    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk" event={"ID":"ff0b2514-3df0-4109-9810-ebd9a0478e7a","Type":"ContainerDied","Data":"074b9f50b967f38ba5f2c1d6e6754332ce0cd0dd3f370c5a8f7ec17d4a889688"}
Jul 09 18:53:11.650589 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:11.650572    2581 generic.go:356] "Generic (PLEG): container finished" podID="fe4fa3e5-a453-4f97-a71b-57968f947297" containerID="74fd049f556738e2fb23a0fc496a2ebedd5a54a1236a62e3a38d52963ee7446c" exitCode=0
Jul 09 18:53:11.650660 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:11.650647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk" event={"ID":"fe4fa3e5-a453-4f97-a71b-57968f947297","Type":"ContainerDied","Data":"74fd049f556738e2fb23a0fc496a2ebedd5a54a1236a62e3a38d52963ee7446c"}
Jul 09 18:53:11.652854 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:11.652835    2581 generic.go:356] "Generic (PLEG): container finished" podID="f9869c79-0709-4589-a4b3-62b4baa3743d" containerID="62813b592599edfa87f8cd0be565d7e1fbce9d38874b87a9cb6ac7b2a2d9b565" exitCode=0
Jul 09 18:53:11.652938 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:11.652883    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d" event={"ID":"f9869c79-0709-4589-a4b3-62b4baa3743d","Type":"ContainerDied","Data":"62813b592599edfa87f8cd0be565d7e1fbce9d38874b87a9cb6ac7b2a2d9b565"}
Jul 09 18:53:12.660115 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.660078    2581 generic.go:356] "Generic (PLEG): container finished" podID="141bb1ac-1580-4ca6-8604-7b9c23f496ee" containerID="ca8f21f89173de75c77de5260c064656b221b42202e33fe1c88482fdca10fc51" exitCode=0
Jul 09 18:53:12.660550 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.660172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx" event={"ID":"141bb1ac-1580-4ca6-8604-7b9c23f496ee","Type":"ContainerDied","Data":"ca8f21f89173de75c77de5260c064656b221b42202e33fe1c88482fdca10fc51"}
Jul 09 18:53:12.662126 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.662106    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff0b2514-3df0-4109-9810-ebd9a0478e7a" containerID="39066d18a8765743e87c9bf7732710693e128a74054d949230746608f18f876b" exitCode=0
Jul 09 18:53:12.662211 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.662176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk" event={"ID":"ff0b2514-3df0-4109-9810-ebd9a0478e7a","Type":"ContainerDied","Data":"39066d18a8765743e87c9bf7732710693e128a74054d949230746608f18f876b"}
Jul 09 18:53:12.664100 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.664081    2581 generic.go:356] "Generic (PLEG): container finished" podID="fe4fa3e5-a453-4f97-a71b-57968f947297" containerID="f69043c9d034769db54c929564861f05c3221678150a39ba8ba0361405a953ee" exitCode=0
Jul 09 18:53:12.664163 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.664145    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk" event={"ID":"fe4fa3e5-a453-4f97-a71b-57968f947297","Type":"ContainerDied","Data":"f69043c9d034769db54c929564861f05c3221678150a39ba8ba0361405a953ee"}
Jul 09 18:53:12.791485 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.791461    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:12.849439 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.849411    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-util\") pod \"f9869c79-0709-4589-a4b3-62b4baa3743d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") "
Jul 09 18:53:12.849644 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.849454    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-bundle\") pod \"f9869c79-0709-4589-a4b3-62b4baa3743d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") "
Jul 09 18:53:12.849644 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.849597    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c75gv\" (UniqueName: \"kubernetes.io/projected/f9869c79-0709-4589-a4b3-62b4baa3743d-kube-api-access-c75gv\") pod \"f9869c79-0709-4589-a4b3-62b4baa3743d\" (UID: \"f9869c79-0709-4589-a4b3-62b4baa3743d\") "
Jul 09 18:53:12.849965 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.849941    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-bundle" (OuterVolumeSpecName: "bundle") pod "f9869c79-0709-4589-a4b3-62b4baa3743d" (UID: "f9869c79-0709-4589-a4b3-62b4baa3743d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:53:12.851966 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.851943    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9869c79-0709-4589-a4b3-62b4baa3743d-kube-api-access-c75gv" (OuterVolumeSpecName: "kube-api-access-c75gv") pod "f9869c79-0709-4589-a4b3-62b4baa3743d" (UID: "f9869c79-0709-4589-a4b3-62b4baa3743d"). InnerVolumeSpecName "kube-api-access-c75gv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:53:12.857636 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.857595    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-util" (OuterVolumeSpecName: "util") pod "f9869c79-0709-4589-a4b3-62b4baa3743d" (UID: "f9869c79-0709-4589-a4b3-62b4baa3743d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:53:12.951110 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.951024    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c75gv\" (UniqueName: \"kubernetes.io/projected/f9869c79-0709-4589-a4b3-62b4baa3743d-kube-api-access-c75gv\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:12.951110 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.951053    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:12.951110 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:12.951063    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9869c79-0709-4589-a4b3-62b4baa3743d-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:13.670932 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.670902    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d"
Jul 09 18:53:13.670932 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.670908    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d" event={"ID":"f9869c79-0709-4589-a4b3-62b4baa3743d","Type":"ContainerDied","Data":"097a9980863537685c1da3903681b0d7de095f1271ae42e9af24d6e5e8eebe81"}
Jul 09 18:53:13.671417 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.670962    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="097a9980863537685c1da3903681b0d7de095f1271ae42e9af24d6e5e8eebe81"
Jul 09 18:53:13.817368 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.817342    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:13.860102 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.860077    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-util\") pod \"fe4fa3e5-a453-4f97-a71b-57968f947297\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") "
Jul 09 18:53:13.860238 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.860141    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2jsv\" (UniqueName: \"kubernetes.io/projected/fe4fa3e5-a453-4f97-a71b-57968f947297-kube-api-access-h2jsv\") pod \"fe4fa3e5-a453-4f97-a71b-57968f947297\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") "
Jul 09 18:53:13.860238 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.860181    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-bundle\") pod \"fe4fa3e5-a453-4f97-a71b-57968f947297\" (UID: \"fe4fa3e5-a453-4f97-a71b-57968f947297\") "
Jul 09 18:53:13.861151 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.861121    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-bundle" (OuterVolumeSpecName: "bundle") pod "fe4fa3e5-a453-4f97-a71b-57968f947297" (UID: "fe4fa3e5-a453-4f97-a71b-57968f947297"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:53:13.862765 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.862745    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4fa3e5-a453-4f97-a71b-57968f947297-kube-api-access-h2jsv" (OuterVolumeSpecName: "kube-api-access-h2jsv") pod "fe4fa3e5-a453-4f97-a71b-57968f947297" (UID: "fe4fa3e5-a453-4f97-a71b-57968f947297"). InnerVolumeSpecName "kube-api-access-h2jsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:53:13.864991 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.864971    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:13.866674 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.866651    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-util" (OuterVolumeSpecName: "util") pod "fe4fa3e5-a453-4f97-a71b-57968f947297" (UID: "fe4fa3e5-a453-4f97-a71b-57968f947297"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:53:13.867503 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.867485    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:13.960663 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.960572    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgv7j\" (UniqueName: \"kubernetes.io/projected/141bb1ac-1580-4ca6-8604-7b9c23f496ee-kube-api-access-tgv7j\") pod \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") "
Jul 09 18:53:13.960663 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.960618    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-bundle\") pod \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") "
Jul 09 18:53:13.960663 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.960650    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-util\") pod \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") "
Jul 09 18:53:13.960880 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.960677    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8rh4\" (UniqueName: \"kubernetes.io/projected/ff0b2514-3df0-4109-9810-ebd9a0478e7a-kube-api-access-f8rh4\") pod \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") "
Jul 09 18:53:13.960880 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.960700    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-bundle\") pod \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\" (UID: \"141bb1ac-1580-4ca6-8604-7b9c23f496ee\") "
Jul 09 18:53:13.960880 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.960784    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-util\") pod \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\" (UID: \"ff0b2514-3df0-4109-9810-ebd9a0478e7a\") "
Jul 09 18:53:13.961021 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.961004    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:13.961075 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.961023    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2jsv\" (UniqueName: \"kubernetes.io/projected/fe4fa3e5-a453-4f97-a71b-57968f947297-kube-api-access-h2jsv\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:13.961075 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.961037    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe4fa3e5-a453-4f97-a71b-57968f947297-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:13.961277 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.961243    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-bundle" (OuterVolumeSpecName: "bundle") pod "ff0b2514-3df0-4109-9810-ebd9a0478e7a" (UID: "ff0b2514-3df0-4109-9810-ebd9a0478e7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:53:13.961345 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.961269    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-bundle" (OuterVolumeSpecName: "bundle") pod "141bb1ac-1580-4ca6-8604-7b9c23f496ee" (UID: "141bb1ac-1580-4ca6-8604-7b9c23f496ee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:53:13.962856 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.962834    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/141bb1ac-1580-4ca6-8604-7b9c23f496ee-kube-api-access-tgv7j" (OuterVolumeSpecName: "kube-api-access-tgv7j") pod "141bb1ac-1580-4ca6-8604-7b9c23f496ee" (UID: "141bb1ac-1580-4ca6-8604-7b9c23f496ee"). InnerVolumeSpecName "kube-api-access-tgv7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:53:13.962952 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.962907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff0b2514-3df0-4109-9810-ebd9a0478e7a-kube-api-access-f8rh4" (OuterVolumeSpecName: "kube-api-access-f8rh4") pod "ff0b2514-3df0-4109-9810-ebd9a0478e7a" (UID: "ff0b2514-3df0-4109-9810-ebd9a0478e7a"). InnerVolumeSpecName "kube-api-access-f8rh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:53:13.966576 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.966523    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-util" (OuterVolumeSpecName: "util") pod "141bb1ac-1580-4ca6-8604-7b9c23f496ee" (UID: "141bb1ac-1580-4ca6-8604-7b9c23f496ee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:53:13.966655 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:13.966600    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-util" (OuterVolumeSpecName: "util") pod "ff0b2514-3df0-4109-9810-ebd9a0478e7a" (UID: "ff0b2514-3df0-4109-9810-ebd9a0478e7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:53:14.062060 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.062026    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgv7j\" (UniqueName: \"kubernetes.io/projected/141bb1ac-1580-4ca6-8604-7b9c23f496ee-kube-api-access-tgv7j\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:14.062060 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.062053    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:14.062060 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.062064    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:14.062270 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.062072    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8rh4\" (UniqueName: \"kubernetes.io/projected/ff0b2514-3df0-4109-9810-ebd9a0478e7a-kube-api-access-f8rh4\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:14.062270 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.062082    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/141bb1ac-1580-4ca6-8604-7b9c23f496ee-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:14.062270 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.062090    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff0b2514-3df0-4109-9810-ebd9a0478e7a-util\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:14.677426 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.677400    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx"
Jul 09 18:53:14.677880 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.677399    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx" event={"ID":"141bb1ac-1580-4ca6-8604-7b9c23f496ee","Type":"ContainerDied","Data":"c7cc03486c23c2983ca64f84e21e28828854de81908c994af0052516dd806242"}
Jul 09 18:53:14.677880 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.677519    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7cc03486c23c2983ca64f84e21e28828854de81908c994af0052516dd806242"
Jul 09 18:53:14.679250 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.679229    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk" event={"ID":"ff0b2514-3df0-4109-9810-ebd9a0478e7a","Type":"ContainerDied","Data":"8cfa45a59826ef0bc9c30dc8066d2fc699e9a5d161f082b0da20376648ef08ad"}
Jul 09 18:53:14.679395 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.679267    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cfa45a59826ef0bc9c30dc8066d2fc699e9a5d161f082b0da20376648ef08ad"
Jul 09 18:53:14.679395 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.679237    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk"
Jul 09 18:53:14.681033 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.681012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk" event={"ID":"fe4fa3e5-a453-4f97-a71b-57968f947297","Type":"ContainerDied","Data":"ae582c2296bb945617b5ba4cc356bbf16efcaa2dfe8922623e391d21975a59bf"}
Jul 09 18:53:14.681163 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.681036    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk"
Jul 09 18:53:14.681163 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:14.681048    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae582c2296bb945617b5ba4cc356bbf16efcaa2dfe8922623e391d21975a59bf"
Jul 09 18:53:16.218856 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.218822    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79f7ffff56-4kvmd"]
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219118    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff0b2514-3df0-4109-9810-ebd9a0478e7a" containerName="util"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219133    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff0b2514-3df0-4109-9810-ebd9a0478e7a" containerName="util"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219148    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9869c79-0709-4589-a4b3-62b4baa3743d" containerName="extract"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219155    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9869c79-0709-4589-a4b3-62b4baa3743d" containerName="extract"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219161    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4fa3e5-a453-4f97-a71b-57968f947297" containerName="pull"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219166    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4fa3e5-a453-4f97-a71b-57968f947297" containerName="pull"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219172    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4fa3e5-a453-4f97-a71b-57968f947297" containerName="extract"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219177    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4fa3e5-a453-4f97-a71b-57968f947297" containerName="extract"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219183    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141bb1ac-1580-4ca6-8604-7b9c23f496ee" containerName="util"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219189    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="141bb1ac-1580-4ca6-8604-7b9c23f496ee" containerName="util"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219196    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9869c79-0709-4589-a4b3-62b4baa3743d" containerName="pull"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219200    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9869c79-0709-4589-a4b3-62b4baa3743d" containerName="pull"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219208    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141bb1ac-1580-4ca6-8604-7b9c23f496ee" containerName="pull"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219216    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="141bb1ac-1580-4ca6-8604-7b9c23f496ee" containerName="pull"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219225    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4fa3e5-a453-4f97-a71b-57968f947297" containerName="util"
Jul 09 18:53:16.219223 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219230    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4fa3e5-a453-4f97-a71b-57968f947297" containerName="util"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219237    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff0b2514-3df0-4109-9810-ebd9a0478e7a" containerName="pull"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219242    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff0b2514-3df0-4109-9810-ebd9a0478e7a" containerName="pull"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219248    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141bb1ac-1580-4ca6-8604-7b9c23f496ee" containerName="extract"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219253    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="141bb1ac-1580-4ca6-8604-7b9c23f496ee" containerName="extract"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219259    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9869c79-0709-4589-a4b3-62b4baa3743d" containerName="util"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219264    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9869c79-0709-4589-a4b3-62b4baa3743d" containerName="util"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219271    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff0b2514-3df0-4109-9810-ebd9a0478e7a" containerName="extract"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219277    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff0b2514-3df0-4109-9810-ebd9a0478e7a" containerName="extract"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219356    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff0b2514-3df0-4109-9810-ebd9a0478e7a" containerName="extract"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219366    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="141bb1ac-1580-4ca6-8604-7b9c23f496ee" containerName="extract"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219373    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9869c79-0709-4589-a4b3-62b4baa3743d" containerName="extract"
Jul 09 18:53:16.219675 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.219380    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4fa3e5-a453-4f97-a71b-57968f947297" containerName="extract"
Jul 09 18:53:16.223564 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.223528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.236382 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.236357    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f7ffff56-4kvmd"]
Jul 09 18:53:16.279893 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.279864    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2b5848a-6916-4374-b817-0d233e2cca9d-console-oauth-config\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.280072 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.279917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-trusted-ca-bundle\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.280072 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.280012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-service-ca\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.280072 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.280052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-console-config\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.280187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.280087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8tjh\" (UniqueName: \"kubernetes.io/projected/e2b5848a-6916-4374-b817-0d233e2cca9d-kube-api-access-t8tjh\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.280187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.280118    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b5848a-6916-4374-b817-0d233e2cca9d-console-serving-cert\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.280187 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.280144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-oauth-serving-cert\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.381167 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.381134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-trusted-ca-bundle\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.381357 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.381178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-service-ca\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.381357 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.381200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-console-config\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.381357 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.381323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8tjh\" (UniqueName: \"kubernetes.io/projected/e2b5848a-6916-4374-b817-0d233e2cca9d-kube-api-access-t8tjh\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.381523 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.381371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b5848a-6916-4374-b817-0d233e2cca9d-console-serving-cert\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.381523 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.381409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-oauth-serving-cert\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.381523 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.381437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2b5848a-6916-4374-b817-0d233e2cca9d-console-oauth-config\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.382057 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.382024    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-service-ca\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.382342 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.382277    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-trusted-ca-bundle\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.382342 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.382351    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-console-config\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.382634 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.382392    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2b5848a-6916-4374-b817-0d233e2cca9d-oauth-serving-cert\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.384086 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.384066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2b5848a-6916-4374-b817-0d233e2cca9d-console-oauth-config\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.384384 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.384363    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b5848a-6916-4374-b817-0d233e2cca9d-console-serving-cert\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.396638 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.396613    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8tjh\" (UniqueName: \"kubernetes.io/projected/e2b5848a-6916-4374-b817-0d233e2cca9d-kube-api-access-t8tjh\") pod \"console-79f7ffff56-4kvmd\" (UID: \"e2b5848a-6916-4374-b817-0d233e2cca9d\") " pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.532774 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.532689    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:16.673835 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.673808    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f7ffff56-4kvmd"]
Jul 09 18:53:16.676163 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:53:16.676132    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b5848a_6916_4374_b817_0d233e2cca9d.slice/crio-aed5af6c3b7f77d94e3c5e56b22bbcea767e4150ba3e9c198987731794755004 WatchSource:0}: Error finding container aed5af6c3b7f77d94e3c5e56b22bbcea767e4150ba3e9c198987731794755004: Status 404 returned error can't find the container with id aed5af6c3b7f77d94e3c5e56b22bbcea767e4150ba3e9c198987731794755004
Jul 09 18:53:16.695096 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:16.694984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f7ffff56-4kvmd" event={"ID":"e2b5848a-6916-4374-b817-0d233e2cca9d","Type":"ContainerStarted","Data":"aed5af6c3b7f77d94e3c5e56b22bbcea767e4150ba3e9c198987731794755004"}
Jul 09 18:53:17.700587 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:17.700548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f7ffff56-4kvmd" event={"ID":"e2b5848a-6916-4374-b817-0d233e2cca9d","Type":"ContainerStarted","Data":"00635c789ca84c664ee28f68e04e0811e4c821011f8182360018b9f0bfdda153"}
Jul 09 18:53:17.727712 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:17.727665    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79f7ffff56-4kvmd" podStartSLOduration=1.727646008 podStartE2EDuration="1.727646008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:53:17.724484383 +0000 UTC m=+483.518608426" watchObservedRunningTime="2026-07-09 18:53:17.727646008 +0000 UTC m=+483.521770038"
Jul 09 18:53:26.533098 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:26.533056    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:26.533503 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:26.533134    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:26.538070 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:26.538047    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:26.744745 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:26.744719    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79f7ffff56-4kvmd"
Jul 09 18:53:26.841188 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:26.841159    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bcd7dff58-w24hq"]
Jul 09 18:53:51.868555 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:51.868507    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bcd7dff58-w24hq" podUID="af8e2c89-803c-4f31-95f5-85e9d75527ed" containerName="console" containerID="cri-o://e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e" gracePeriod=15
Jul 09 18:53:52.118260 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.118233    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:53:52.187412 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187333    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-service-ca\") pod \"af8e2c89-803c-4f31-95f5-85e9d75527ed\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") "
Jul 09 18:53:52.187412 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187384    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-oauth-serving-cert\") pod \"af8e2c89-803c-4f31-95f5-85e9d75527ed\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") "
Jul 09 18:53:52.187412 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187413    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plcnd\" (UniqueName: \"kubernetes.io/projected/af8e2c89-803c-4f31-95f5-85e9d75527ed-kube-api-access-plcnd\") pod \"af8e2c89-803c-4f31-95f5-85e9d75527ed\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") "
Jul 09 18:53:52.187676 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187432    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-trusted-ca-bundle\") pod \"af8e2c89-803c-4f31-95f5-85e9d75527ed\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") "
Jul 09 18:53:52.187676 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187446    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-config\") pod \"af8e2c89-803c-4f31-95f5-85e9d75527ed\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") "
Jul 09 18:53:52.187676 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187474    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-oauth-config\") pod \"af8e2c89-803c-4f31-95f5-85e9d75527ed\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") "
Jul 09 18:53:52.187676 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187565    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-serving-cert\") pod \"af8e2c89-803c-4f31-95f5-85e9d75527ed\" (UID: \"af8e2c89-803c-4f31-95f5-85e9d75527ed\") "
Jul 09 18:53:52.187857 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187825    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-service-ca" (OuterVolumeSpecName: "service-ca") pod "af8e2c89-803c-4f31-95f5-85e9d75527ed" (UID: "af8e2c89-803c-4f31-95f5-85e9d75527ed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:53:52.187914 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187897    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-config" (OuterVolumeSpecName: "console-config") pod "af8e2c89-803c-4f31-95f5-85e9d75527ed" (UID: "af8e2c89-803c-4f31-95f5-85e9d75527ed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:53:52.187914 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187892    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "af8e2c89-803c-4f31-95f5-85e9d75527ed" (UID: "af8e2c89-803c-4f31-95f5-85e9d75527ed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:53:52.188011 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.187929    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "af8e2c89-803c-4f31-95f5-85e9d75527ed" (UID: "af8e2c89-803c-4f31-95f5-85e9d75527ed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:53:52.190004 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.189982    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "af8e2c89-803c-4f31-95f5-85e9d75527ed" (UID: "af8e2c89-803c-4f31-95f5-85e9d75527ed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:53:52.190111 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.190022    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "af8e2c89-803c-4f31-95f5-85e9d75527ed" (UID: "af8e2c89-803c-4f31-95f5-85e9d75527ed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:53:52.190111 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.190034    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af8e2c89-803c-4f31-95f5-85e9d75527ed-kube-api-access-plcnd" (OuterVolumeSpecName: "kube-api-access-plcnd") pod "af8e2c89-803c-4f31-95f5-85e9d75527ed" (UID: "af8e2c89-803c-4f31-95f5-85e9d75527ed"). InnerVolumeSpecName "kube-api-access-plcnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:53:52.288516 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.288487    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plcnd\" (UniqueName: \"kubernetes.io/projected/af8e2c89-803c-4f31-95f5-85e9d75527ed-kube-api-access-plcnd\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:52.288516 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.288510    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-trusted-ca-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:52.288516 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.288519    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:52.288741 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.288528    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-oauth-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:52.288741 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.288561    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af8e2c89-803c-4f31-95f5-85e9d75527ed-console-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:52.288741 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.288574    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-service-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:52.288741 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.288582    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af8e2c89-803c-4f31-95f5-85e9d75527ed-oauth-serving-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 18:53:52.865756 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.865721    2581 generic.go:356] "Generic (PLEG): container finished" podID="af8e2c89-803c-4f31-95f5-85e9d75527ed" containerID="e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e" exitCode=0
Jul 09 18:53:52.865934 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.865771    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcd7dff58-w24hq"
Jul 09 18:53:52.865934 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.865811    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcd7dff58-w24hq" event={"ID":"af8e2c89-803c-4f31-95f5-85e9d75527ed","Type":"ContainerDied","Data":"e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e"}
Jul 09 18:53:52.865934 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.865860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcd7dff58-w24hq" event={"ID":"af8e2c89-803c-4f31-95f5-85e9d75527ed","Type":"ContainerDied","Data":"43bc9bd93aece5e8a4245e2ebd112fa1ff2bd900acb6b18f5cd81fdb1222bd0f"}
Jul 09 18:53:52.865934 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.865879    2581 scope.go:117] "RemoveContainer" containerID="e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e"
Jul 09 18:53:52.874511 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.874297    2581 scope.go:117] "RemoveContainer" containerID="e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e"
Jul 09 18:53:52.874795 ip-10-0-139-1 kubenswrapper[2581]: E0709 18:53:52.874575    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e\": container with ID starting with e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e not found: ID does not exist" containerID="e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e"
Jul 09 18:53:52.874795 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.874600    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e"} err="failed to get container status \"e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e\": rpc error: code = NotFound desc = could not find container \"e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e\": container with ID starting with e153a18b2e94edc7eea43e8bcd37ee1ff8d480105b352bc48c5b06c47bcae71e not found: ID does not exist"
Jul 09 18:53:52.892243 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.892222    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bcd7dff58-w24hq"]
Jul 09 18:53:52.895468 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:52.895444    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bcd7dff58-w24hq"]
Jul 09 18:53:54.737676 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:53:54.737647    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af8e2c89-803c-4f31-95f5-85e9d75527ed" path="/var/lib/kubelet/pods/af8e2c89-803c-4f31-95f5-85e9d75527ed/volumes"
Jul 09 18:54:34.515654 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.515620    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:54:34.516110 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.515900    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8e2c89-803c-4f31-95f5-85e9d75527ed" containerName="console"
Jul 09 18:54:34.516110 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.515910    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8e2c89-803c-4f31-95f5-85e9d75527ed" containerName="console"
Jul 09 18:54:34.516110 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.515970    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="af8e2c89-803c-4f31-95f5-85e9d75527ed" containerName="console"
Jul 09 18:54:34.518798 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.518780    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"
Jul 09 18:54:34.523409 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.523392    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 18:54:34.523409 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.523391    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4qkh2\""
Jul 09 18:54:34.524480 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.524461    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 18:54:34.524831 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.524817    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 18:54:34.531658 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.531635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:54:34.573647 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.573613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:54:34.640507 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.640473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8030d374-40ff-459b-a5e8-6135032302c0-config-file\") pod \"limitador-limitador-54d6d988d5-wjxgm\" (UID: \"8030d374-40ff-459b-a5e8-6135032302c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"
Jul 09 18:54:34.640507 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.640509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r5fh\" (UniqueName: \"kubernetes.io/projected/8030d374-40ff-459b-a5e8-6135032302c0-kube-api-access-6r5fh\") pod \"limitador-limitador-54d6d988d5-wjxgm\" (UID: \"8030d374-40ff-459b-a5e8-6135032302c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"
Jul 09 18:54:34.741085 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.741053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8030d374-40ff-459b-a5e8-6135032302c0-config-file\") pod \"limitador-limitador-54d6d988d5-wjxgm\" (UID: \"8030d374-40ff-459b-a5e8-6135032302c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"
Jul 09 18:54:34.741270 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.741095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r5fh\" (UniqueName: \"kubernetes.io/projected/8030d374-40ff-459b-a5e8-6135032302c0-kube-api-access-6r5fh\") pod \"limitador-limitador-54d6d988d5-wjxgm\" (UID: \"8030d374-40ff-459b-a5e8-6135032302c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"
Jul 09 18:54:34.741739 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.741713    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8030d374-40ff-459b-a5e8-6135032302c0-config-file\") pod \"limitador-limitador-54d6d988d5-wjxgm\" (UID: \"8030d374-40ff-459b-a5e8-6135032302c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"
Jul 09 18:54:34.751810 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.751782    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r5fh\" (UniqueName: \"kubernetes.io/projected/8030d374-40ff-459b-a5e8-6135032302c0-kube-api-access-6r5fh\") pod \"limitador-limitador-54d6d988d5-wjxgm\" (UID: \"8030d374-40ff-459b-a5e8-6135032302c0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"
Jul 09 18:54:34.828879 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.828806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"
Jul 09 18:54:34.961668 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:34.961642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:54:34.963852 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:54:34.963826    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8030d374_40ff_459b_a5e8_6135032302c0.slice/crio-fc65d214ec7605a8703223d18955b6f886d908fa86e0d871fc4265b8f7216f10 WatchSource:0}: Error finding container fc65d214ec7605a8703223d18955b6f886d908fa86e0d871fc4265b8f7216f10: Status 404 returned error can't find the container with id fc65d214ec7605a8703223d18955b6f886d908fa86e0d871fc4265b8f7216f10
Jul 09 18:54:35.067525 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:35.067490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm" event={"ID":"8030d374-40ff-459b-a5e8-6135032302c0","Type":"ContainerStarted","Data":"fc65d214ec7605a8703223d18955b6f886d908fa86e0d871fc4265b8f7216f10"}
Jul 09 18:54:38.084606 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:38.084568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm" event={"ID":"8030d374-40ff-459b-a5e8-6135032302c0","Type":"ContainerStarted","Data":"8c5a2172633c8af866f45fd384e0dcbde7f850fa6cac488fdf41ddca9260373e"}
Jul 09 18:54:38.084982 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:38.084676    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"
Jul 09 18:54:38.108964 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:38.108917    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm" podStartSLOduration=1.715054346 podStartE2EDuration="4.108901924s" totalImagesPullingTime="2.393847578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:54:38.105641076 +0000 UTC m=+563.899765133" watchObservedRunningTime="2026-07-09 18:54:38.108901924 +0000 UTC m=+563.903025953"
Jul 09 18:54:49.089982 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:54:49.089951    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"
Jul 09 18:55:14.656498 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:55:14.656473    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 18:55:14.658368 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:55:14.658350    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 18:55:48.362192 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:55:48.362159    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:56:10.104356 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:10.104318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:56:29.505130 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:29.505092    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:56:36.102360 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:36.102320    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:56:41.320624 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.320594    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"]
Jul 09 18:56:41.323593 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.323576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.326690 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.326662    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z4n5g\""
Jul 09 18:56:41.326811 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.326667    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 18:56:41.327789 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.327774    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 18:56:41.327963 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.327937    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 09 18:56:41.335324 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.335301    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"]
Jul 09 18:56:41.380473 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.380439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tt87\" (UniqueName: \"kubernetes.io/projected/f166b419-bc01-44a1-8624-7b140272342c-kube-api-access-5tt87\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.380473 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.380473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.380690 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.380497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.380690 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.380523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.380690 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.380645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.380784 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.380689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f166b419-bc01-44a1-8624-7b140272342c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.481686 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.481650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.481845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.481692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f166b419-bc01-44a1-8624-7b140272342c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.481845 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.481823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tt87\" (UniqueName: \"kubernetes.io/projected/f166b419-bc01-44a1-8624-7b140272342c-kube-api-access-5tt87\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.481916 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.481853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.481916 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.481880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.482047 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.481909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.482272 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.482248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.482510 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.482270    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.482510 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.482337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.484093 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.484072    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f166b419-bc01-44a1-8624-7b140272342c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.484232 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.484216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f166b419-bc01-44a1-8624-7b140272342c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.493379 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.493359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tt87\" (UniqueName: \"kubernetes.io/projected/f166b419-bc01-44a1-8624-7b140272342c-kube-api-access-5tt87\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr\" (UID: \"f166b419-bc01-44a1-8624-7b140272342c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.633762 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.633725    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:41.772147 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.772117    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"]
Jul 09 18:56:41.773672 ip-10-0-139-1 kubenswrapper[2581]: W0709 18:56:41.773650    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf166b419_bc01_44a1_8624_7b140272342c.slice/crio-b0ed5d6c0340c2c3a109ff903c370784167a52912af9cd5f8ab373cabb210f15 WatchSource:0}: Error finding container b0ed5d6c0340c2c3a109ff903c370784167a52912af9cd5f8ab373cabb210f15: Status 404 returned error can't find the container with id b0ed5d6c0340c2c3a109ff903c370784167a52912af9cd5f8ab373cabb210f15
Jul 09 18:56:41.774948 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:41.774931    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:56:42.669310 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:42.669266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr" event={"ID":"f166b419-bc01-44a1-8624-7b140272342c","Type":"ContainerStarted","Data":"b0ed5d6c0340c2c3a109ff903c370784167a52912af9cd5f8ab373cabb210f15"}
Jul 09 18:56:42.998002 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:42.997903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:56:43.675155 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:43.675114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr" event={"ID":"f166b419-bc01-44a1-8624-7b140272342c","Type":"ContainerStarted","Data":"55679d0089589c80ec9c559344ebc6c6c48306267874cc345be38ceb3762eaad"}
Jul 09 18:56:43.702231 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:43.702181    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr" podStartSLOduration=1.673724365 podStartE2EDuration="2.702164707s" totalImagesPullingTime="1.028440342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:56:43.700705306 +0000 UTC m=+689.494829358" watchObservedRunningTime="2026-07-09 18:56:43.702164707 +0000 UTC m=+689.496288736"
Jul 09 18:56:50.108384 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:50.108343    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:56:51.634351 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:51.634315    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:51.634758 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:51.634385    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:51.646858 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:51.646833    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:51.724667 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:51.724645    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr"
Jul 09 18:56:59.620855 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:56:59.620822    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:58:31.908083 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:58:31.908050    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:58:41.206132 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:58:41.206052    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:58:53.005595 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:58:53.005554    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:59:01.900124 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:59:01.900089    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:59:12.497046 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:59:12.497010    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:59:37.999745 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:59:37.999708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 18:59:49.303381 ip-10-0-139-1 kubenswrapper[2581]: I0709 18:59:49.303346    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:00:00.159610 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.159578    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"]
Jul 09 19:00:00.163074 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.163051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"
Jul 09 19:00:00.166546 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.166507    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\""
Jul 09 19:00:00.166654 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.166517    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:00:00.166654 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.166612    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:00:00.173225 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.173203    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"]
Jul 09 19:00:00.249065 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.249035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sxsp\" (UniqueName: \"kubernetes.io/projected/19816bf6-bc22-4629-ac2e-c8916077bc16-kube-api-access-8sxsp\") pod \"maas-api-key-cleanup-29727060-kddp5\" (UID: \"19816bf6-bc22-4629-ac2e-c8916077bc16\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"
Jul 09 19:00:00.349780 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.349745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sxsp\" (UniqueName: \"kubernetes.io/projected/19816bf6-bc22-4629-ac2e-c8916077bc16-kube-api-access-8sxsp\") pod \"maas-api-key-cleanup-29727060-kddp5\" (UID: \"19816bf6-bc22-4629-ac2e-c8916077bc16\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"
Jul 09 19:00:00.362528 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.362503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sxsp\" (UniqueName: \"kubernetes.io/projected/19816bf6-bc22-4629-ac2e-c8916077bc16-kube-api-access-8sxsp\") pod \"maas-api-key-cleanup-29727060-kddp5\" (UID: \"19816bf6-bc22-4629-ac2e-c8916077bc16\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"
Jul 09 19:00:00.496603 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.496517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"
Jul 09 19:00:00.629988 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:00.629926    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"]
Jul 09 19:00:00.632409 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:00:00.632384    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19816bf6_bc22_4629_ac2e_c8916077bc16.slice/crio-0ee8715be9691da6199b8b597f0f0dbaca292d240052f9a4c034b111b13cc49f WatchSource:0}: Error finding container 0ee8715be9691da6199b8b597f0f0dbaca292d240052f9a4c034b111b13cc49f: Status 404 returned error can't find the container with id 0ee8715be9691da6199b8b597f0f0dbaca292d240052f9a4c034b111b13cc49f
Jul 09 19:00:01.608823 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:01.608784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5" event={"ID":"19816bf6-bc22-4629-ac2e-c8916077bc16","Type":"ContainerStarted","Data":"0ee8715be9691da6199b8b597f0f0dbaca292d240052f9a4c034b111b13cc49f"}
Jul 09 19:00:07.647434 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:07.647397    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5" event={"ID":"19816bf6-bc22-4629-ac2e-c8916077bc16","Type":"ContainerStarted","Data":"ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d"}
Jul 09 19:00:07.670319 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:07.670266    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5" podStartSLOduration=1.317473958 podStartE2EDuration="7.670250433s" totalImagesPullingTime="6.352776475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:07.668473552 +0000 UTC m=+893.462597589" watchObservedRunningTime="2026-07-09 19:00:07.670250433 +0000 UTC m=+893.464374461"
Jul 09 19:00:14.692976 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:14.692940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:00:14.693408 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:14.693160    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:00:27.034742 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:27.034692    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:00:36.406872 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:36.406835    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:00:44.837202 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:44.837171    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:00:54.010995 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:00:54.010912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:01:00.012684 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:00.012646    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"]
Jul 09 19:01:00.013105 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:00.012868    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5" podUID="19816bf6-bc22-4629-ac2e-c8916077bc16" containerName="cleanup" containerID="cri-o://ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d" gracePeriod=30
Jul 09 19:01:05.800360 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:05.800320    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:01:17.213468 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:17.213427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:01:28.333785 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:28.333752    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:01:30.198036 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:30.198009    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"
Jul 09 19:01:30.301272 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:30.301186    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sxsp\" (UniqueName: \"kubernetes.io/projected/19816bf6-bc22-4629-ac2e-c8916077bc16-kube-api-access-8sxsp\") pod \"19816bf6-bc22-4629-ac2e-c8916077bc16\" (UID: \"19816bf6-bc22-4629-ac2e-c8916077bc16\") "
Jul 09 19:01:30.303455 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:30.303430    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19816bf6-bc22-4629-ac2e-c8916077bc16-kube-api-access-8sxsp" (OuterVolumeSpecName: "kube-api-access-8sxsp") pod "19816bf6-bc22-4629-ac2e-c8916077bc16" (UID: "19816bf6-bc22-4629-ac2e-c8916077bc16"). InnerVolumeSpecName "kube-api-access-8sxsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:01:30.402334 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:30.402300    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sxsp\" (UniqueName: \"kubernetes.io/projected/19816bf6-bc22-4629-ac2e-c8916077bc16-kube-api-access-8sxsp\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:01:31.037209 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:31.037117    2581 generic.go:356] "Generic (PLEG): container finished" podID="19816bf6-bc22-4629-ac2e-c8916077bc16" containerID="ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d" exitCode=137
Jul 09 19:01:31.037209 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:31.037169    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"
Jul 09 19:01:31.037422 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:31.037210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5" event={"ID":"19816bf6-bc22-4629-ac2e-c8916077bc16","Type":"ContainerDied","Data":"ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d"}
Jul 09 19:01:31.037422 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:31.037264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5" event={"ID":"19816bf6-bc22-4629-ac2e-c8916077bc16","Type":"ContainerDied","Data":"0ee8715be9691da6199b8b597f0f0dbaca292d240052f9a4c034b111b13cc49f"}
Jul 09 19:01:31.037422 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:31.037294    2581 scope.go:117] "RemoveContainer" containerID="ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d"
Jul 09 19:01:31.045652 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:31.045632    2581 scope.go:117] "RemoveContainer" containerID="ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d"
Jul 09 19:01:31.045939 ip-10-0-139-1 kubenswrapper[2581]: E0709 19:01:31.045921    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d\": container with ID starting with ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d not found: ID does not exist" containerID="ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d"
Jul 09 19:01:31.045996 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:31.045948    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d"} err="failed to get container status \"ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d\": rpc error: code = NotFound desc = could not find container \"ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d\": container with ID starting with ab05d693821a23a3d4448c7aabfdc203d18c7a900de9208d49f7226d6966f69d not found: ID does not exist"
Jul 09 19:01:31.057302 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:31.057278    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"]
Jul 09 19:01:31.061501 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:31.061475    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-kddp5"]
Jul 09 19:01:32.737651 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:32.737618    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19816bf6-bc22-4629-ac2e-c8916077bc16" path="/var/lib/kubelet/pods/19816bf6-bc22-4629-ac2e-c8916077bc16/volumes"
Jul 09 19:01:38.704506 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:01:38.704424    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:02:00.524039 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:02:00.524000    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:02:10.205632 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:02:10.205595    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:02:33.815245 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:02:33.815209    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:02:44.202261 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:02:44.202226    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:02:59.896750 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:02:59.896719    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:03:10.699888 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:03:10.699808    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:03:20.301735 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:03:20.301699    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:03:29.798842 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:03:29.798808    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:03:38.798048 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:03:38.798012    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:05:14.721380 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:05:14.721350    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:05:14.723089 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:05:14.723065    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:05:26.603305 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:05:26.603272    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:05:35.601795 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:05:35.601758    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:05:50.801637 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:05:50.801601    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:06:02.401767 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:06:02.401728    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:06:12.502145 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:06:12.502063    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:06:23.002420 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:06:23.002383    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:06:33.700044 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:06:33.700008    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:06:43.098668 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:06:43.098635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:06:53.603482 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:06:53.603446    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:07:04.298547 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:07:04.298511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:07:13.299381 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:07:13.299343    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:07:36.296287 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:07:36.296203    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:07:45.402818 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:07:45.402781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:07:55.199456 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:07:55.199423    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:08:06.596322 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:08:06.596286    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:08:23.299938 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:08:23.299892    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:08:34.514831 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:08:34.514788    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:08:43.806503 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:08:43.806466    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:08:53.406486 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:08:53.406447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:09:02.211165 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:09:02.211127    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:09:12.108104 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:09:12.108022    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:09:24.995586 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:09:24.995551    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:09:34.012836 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:09:34.012797    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:09:44.101587 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:09:44.101550    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:09:55.802106 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:09:55.802059    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:10:05.696160 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:10:05.696121    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:10:12.096172 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:10:12.096133    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:10:14.750862 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:10:14.750834    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:10:14.753802 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:10:14.753781    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:10:28.808994 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:10:28.808958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:10:40.403735 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:10:40.403651    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:10:49.704204 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:10:49.704167    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:11:02.404152 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:11:02.404043    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:11:14.096729 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:11:14.096696    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:11:23.502023 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:11:23.501987    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:11:41.293999 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:11:41.293963    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:11:53.193468 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:11:53.193432    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:12:00.892376 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:12:00.892342    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:12:11.403197 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:12:11.403123    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:13:34.003176 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:13:34.003137    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:13:41.303482 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:13:41.303408    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:13:48.797512 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:13:48.797480    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:13:56.804025 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:13:56.803987    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:14:11.604220 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:11.604182    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:14:43.603949 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:43.603906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:14:57.894182 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.894146    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"]
Jul 09 19:14:57.894580 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.894494    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19816bf6-bc22-4629-ac2e-c8916077bc16" containerName="cleanup"
Jul 09 19:14:57.894580 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.894513    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="19816bf6-bc22-4629-ac2e-c8916077bc16" containerName="cleanup"
Jul 09 19:14:57.894681 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.894620    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="19816bf6-bc22-4629-ac2e-c8916077bc16" containerName="cleanup"
Jul 09 19:14:57.897359 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.897342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:57.901375 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.901344    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4cb532e2\"/\"kube-root-ca.crt\""
Jul 09 19:14:57.901508 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.901406    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4cb532e2\"/\"openshift-service-ca.crt\""
Jul 09 19:14:57.901508 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.901344    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4cb532e2\"/\"default-dockercfg-jxctb\""
Jul 09 19:14:57.901508 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.901346    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4cb532e2\"/\"e2e-lifecycle-model-4cb532e2-kserve-self-signed-certs\""
Jul 09 19:14:57.907764 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.907741    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"]
Jul 09 19:14:57.990838 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.990805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-dshm\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:57.991024 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.990847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plswc\" (UniqueName: \"kubernetes.io/projected/fffbdd6c-84da-4932-8f44-03ab4a6553a1-kube-api-access-plswc\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:57.991024 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.990886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tmp-dir\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:57.991024 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.990953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tls-certs\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:57.991024 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.991008    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-home\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:57.991187 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:57.991036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-model-cache\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.092032 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.091990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tmp-dir\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.092032 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.092031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tls-certs\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.092262 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.092058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-home\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.092262 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.092081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-model-cache\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.092262 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.092181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-dshm\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.092262 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.092204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plswc\" (UniqueName: \"kubernetes.io/projected/fffbdd6c-84da-4932-8f44-03ab4a6553a1-kube-api-access-plswc\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.092478 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.092457    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tmp-dir\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.092568 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.092503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-home\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.092568 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.092519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-model-cache\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.094503 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.094482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-dshm\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.094801 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.094783    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tls-certs\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.102884 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.102861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plswc\" (UniqueName: \"kubernetes.io/projected/fffbdd6c-84da-4932-8f44-03ab4a6553a1-kube-api-access-plswc\") pod \"e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") " pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.206839 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.206754    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:14:58.340426 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.340403    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"]
Jul 09 19:14:58.342187 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:14:58.342159    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfffbdd6c_84da_4932_8f44_03ab4a6553a1.slice/crio-819c32c511ae9b740f4c4125eee4791f535473ab4c309c0f653b05608b853206 WatchSource:0}: Error finding container 819c32c511ae9b740f4c4125eee4791f535473ab4c309c0f653b05608b853206: Status 404 returned error can't find the container with id 819c32c511ae9b740f4c4125eee4791f535473ab4c309c0f653b05608b853206
Jul 09 19:14:58.801384 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.801351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6" event={"ID":"fffbdd6c-84da-4932-8f44-03ab4a6553a1","Type":"ContainerStarted","Data":"542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3"}
Jul 09 19:14:58.801384 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.801392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6" event={"ID":"fffbdd6c-84da-4932-8f44-03ab4a6553a1","Type":"ContainerStarted","Data":"819c32c511ae9b740f4c4125eee4791f535473ab4c309c0f653b05608b853206"}
Jul 09 19:14:58.822046 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:14:58.821996    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6" podStartSLOduration=1.821981101 podStartE2EDuration="1.821981101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:14:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:14:58.820770623 +0000 UTC m=+1784.614894645" watchObservedRunningTime="2026-07-09 19:14:58.821981101 +0000 UTC m=+1784.616105129"
Jul 09 19:15:00.138855 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.138797    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"]
Jul 09 19:15:00.141855 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.141836    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"]
Jul 09 19:15:00.141992 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.141967    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"
Jul 09 19:15:00.144737 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.144717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"
Jul 09 19:15:00.144913 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.144899    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:15:00.145819 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.145804    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\""
Jul 09 19:15:00.145875 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.145814    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:15:00.151094 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.151036    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"]
Jul 09 19:15:00.153509 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.153486    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"]
Jul 09 19:15:00.210597 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.210530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsz5f\" (UniqueName: \"kubernetes.io/projected/5450b9a2-7955-4646-9f2e-067c25cd7666-kube-api-access-nsz5f\") pod \"maas-api-key-cleanup-29727075-bx4bc\" (UID: \"5450b9a2-7955-4646-9f2e-067c25cd7666\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"
Jul 09 19:15:00.210765 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.210656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn2mf\" (UniqueName: \"kubernetes.io/projected/ca65d9ce-9ec7-4314-8310-c5cb65c75bf1-kube-api-access-jn2mf\") pod \"maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m\" (UID: \"ca65d9ce-9ec7-4314-8310-c5cb65c75bf1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"
Jul 09 19:15:00.311726 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.311688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn2mf\" (UniqueName: \"kubernetes.io/projected/ca65d9ce-9ec7-4314-8310-c5cb65c75bf1-kube-api-access-jn2mf\") pod \"maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m\" (UID: \"ca65d9ce-9ec7-4314-8310-c5cb65c75bf1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"
Jul 09 19:15:00.311912 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.311748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsz5f\" (UniqueName: \"kubernetes.io/projected/5450b9a2-7955-4646-9f2e-067c25cd7666-kube-api-access-nsz5f\") pod \"maas-api-key-cleanup-29727075-bx4bc\" (UID: \"5450b9a2-7955-4646-9f2e-067c25cd7666\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"
Jul 09 19:15:00.321861 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.321827    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsz5f\" (UniqueName: \"kubernetes.io/projected/5450b9a2-7955-4646-9f2e-067c25cd7666-kube-api-access-nsz5f\") pod \"maas-api-key-cleanup-29727075-bx4bc\" (UID: \"5450b9a2-7955-4646-9f2e-067c25cd7666\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"
Jul 09 19:15:00.321861 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.321845    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn2mf\" (UniqueName: \"kubernetes.io/projected/ca65d9ce-9ec7-4314-8310-c5cb65c75bf1-kube-api-access-jn2mf\") pod \"maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m\" (UID: \"ca65d9ce-9ec7-4314-8310-c5cb65c75bf1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"
Jul 09 19:15:00.455857 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.455765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"
Jul 09 19:15:00.462757 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.462736    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"
Jul 09 19:15:00.598493 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.598458    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"]
Jul 09 19:15:00.599988 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:15:00.599964    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca65d9ce_9ec7_4314_8310_c5cb65c75bf1.slice/crio-3a045e87a0a119fc48c1c957d4f0dfc7793af3147b4ea6e3b4503bf3d09f3d02 WatchSource:0}: Error finding container 3a045e87a0a119fc48c1c957d4f0dfc7793af3147b4ea6e3b4503bf3d09f3d02: Status 404 returned error can't find the container with id 3a045e87a0a119fc48c1c957d4f0dfc7793af3147b4ea6e3b4503bf3d09f3d02
Jul 09 19:15:00.618462 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.618436    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"]
Jul 09 19:15:00.620016 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:15:00.619993    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5450b9a2_7955_4646_9f2e_067c25cd7666.slice/crio-5b7b843b3f8ed835b728db7443c3f4b1a97ce8e2e135f0cdbd2f1d3f5a59d4b8 WatchSource:0}: Error finding container 5b7b843b3f8ed835b728db7443c3f4b1a97ce8e2e135f0cdbd2f1d3f5a59d4b8: Status 404 returned error can't find the container with id 5b7b843b3f8ed835b728db7443c3f4b1a97ce8e2e135f0cdbd2f1d3f5a59d4b8
Jul 09 19:15:00.812370 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.812270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc" event={"ID":"5450b9a2-7955-4646-9f2e-067c25cd7666","Type":"ContainerStarted","Data":"5b7b843b3f8ed835b728db7443c3f4b1a97ce8e2e135f0cdbd2f1d3f5a59d4b8"}
Jul 09 19:15:00.813419 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:00.813397    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m" event={"ID":"ca65d9ce-9ec7-4314-8310-c5cb65c75bf1","Type":"ContainerStarted","Data":"3a045e87a0a119fc48c1c957d4f0dfc7793af3147b4ea6e3b4503bf3d09f3d02"}
Jul 09 19:15:01.299916 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:01.299881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:15:01.819556 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:01.819516    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc" event={"ID":"5450b9a2-7955-4646-9f2e-067c25cd7666","Type":"ContainerStarted","Data":"9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c"}
Jul 09 19:15:01.820894 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:01.820873    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m" event={"ID":"ca65d9ce-9ec7-4314-8310-c5cb65c75bf1","Type":"ContainerStarted","Data":"f2dfa2da7398f14ee237469f442a140acb5fd55c0d7a61d6748f63505d8d3cf4"}
Jul 09 19:15:01.838164 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:01.838117    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc" podStartSLOduration=1.83810429 podStartE2EDuration="1.83810429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:15:01.837638298 +0000 UTC m=+1787.631762327" watchObservedRunningTime="2026-07-09 19:15:01.83810429 +0000 UTC m=+1787.632228297"
Jul 09 19:15:01.854892 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:01.854816    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m" podStartSLOduration=1.854797487 podStartE2EDuration="1.854797487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:15:01.854669806 +0000 UTC m=+1787.648793833" watchObservedRunningTime="2026-07-09 19:15:01.854797487 +0000 UTC m=+1787.648921518"
Jul 09 19:15:08.207349 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:08.207260    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:15:08.207349 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:08.207305    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:15:08.219722 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:08.219691    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:15:08.867186 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:08.867152    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:15:14.783413 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:14.783381    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:15:14.786460 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:14.786438    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:15:19.100497 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:19.100464    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:15:22.008720 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:22.008687    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"]
Jul 09 19:15:22.009107 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:22.008887    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m" podUID="ca65d9ce-9ec7-4314-8310-c5cb65c75bf1" containerName="cleanup" containerID="cri-o://f2dfa2da7398f14ee237469f442a140acb5fd55c0d7a61d6748f63505d8d3cf4" gracePeriod=30
Jul 09 19:15:32.689334 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:32.689296    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"]
Jul 09 19:15:33.107153 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:33.107124    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:15:47.710304 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:47.710262    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6" podUID="fffbdd6c-84da-4932-8f44-03ab4a6553a1" containerName="main" containerID="cri-o://542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3" gracePeriod=45
Jul 09 19:15:47.958293 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:47.958269    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:15:48.018008 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.017918    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-model-cache\") pod \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") "
Jul 09 19:15:48.018008 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.017955    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-home\") pod \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") "
Jul 09 19:15:48.018008 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.017986    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-dshm\") pod \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") "
Jul 09 19:15:48.018278 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.018029    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tmp-dir\") pod \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") "
Jul 09 19:15:48.018278 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.018112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tls-certs\") pod \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") "
Jul 09 19:15:48.018278 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.018145    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plswc\" (UniqueName: \"kubernetes.io/projected/fffbdd6c-84da-4932-8f44-03ab4a6553a1-kube-api-access-plswc\") pod \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\" (UID: \"fffbdd6c-84da-4932-8f44-03ab4a6553a1\") "
Jul 09 19:15:48.018278 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.018244    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-model-cache" (OuterVolumeSpecName: "model-cache") pod "fffbdd6c-84da-4932-8f44-03ab4a6553a1" (UID: "fffbdd6c-84da-4932-8f44-03ab4a6553a1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:15:48.018278 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.018257    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-home" (OuterVolumeSpecName: "home") pod "fffbdd6c-84da-4932-8f44-03ab4a6553a1" (UID: "fffbdd6c-84da-4932-8f44-03ab4a6553a1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:15:48.018732 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.018367    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fffbdd6c-84da-4932-8f44-03ab4a6553a1" (UID: "fffbdd6c-84da-4932-8f44-03ab4a6553a1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:15:48.018732 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.018462    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:15:48.018732 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.018486    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:15:48.018732 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.018500    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:15:48.020405 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.020382    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-dshm" (OuterVolumeSpecName: "dshm") pod "fffbdd6c-84da-4932-8f44-03ab4a6553a1" (UID: "fffbdd6c-84da-4932-8f44-03ab4a6553a1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:15:48.020550 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.020518    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fffbdd6c-84da-4932-8f44-03ab4a6553a1-kube-api-access-plswc" (OuterVolumeSpecName: "kube-api-access-plswc") pod "fffbdd6c-84da-4932-8f44-03ab4a6553a1" (UID: "fffbdd6c-84da-4932-8f44-03ab4a6553a1"). InnerVolumeSpecName "kube-api-access-plswc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:15:48.020615 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.020517    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fffbdd6c-84da-4932-8f44-03ab4a6553a1" (UID: "fffbdd6c-84da-4932-8f44-03ab4a6553a1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:15:48.048138 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.048105    2581 generic.go:356] "Generic (PLEG): container finished" podID="fffbdd6c-84da-4932-8f44-03ab4a6553a1" containerID="542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3" exitCode=0
Jul 09 19:15:48.048263 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.048144    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"
Jul 09 19:15:48.048263 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.048152    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6" event={"ID":"fffbdd6c-84da-4932-8f44-03ab4a6553a1","Type":"ContainerDied","Data":"542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3"}
Jul 09 19:15:48.048263 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.048183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6" event={"ID":"fffbdd6c-84da-4932-8f44-03ab4a6553a1","Type":"ContainerDied","Data":"819c32c511ae9b740f4c4125eee4791f535473ab4c309c0f653b05608b853206"}
Jul 09 19:15:48.048263 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.048201    2581 scope.go:117] "RemoveContainer" containerID="542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3"
Jul 09 19:15:48.057161 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.057144    2581 scope.go:117] "RemoveContainer" containerID="542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3"
Jul 09 19:15:48.057464 ip-10-0-139-1 kubenswrapper[2581]: E0709 19:15:48.057434    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3\": container with ID starting with 542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3 not found: ID does not exist" containerID="542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3"
Jul 09 19:15:48.057593 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.057474    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3"} err="failed to get container status \"542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3\": rpc error: code = NotFound desc = could not find container \"542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3\": container with ID starting with 542498ed6c1189696da1c466940f76c82933a8e0919f654647aea189387d2ba3 not found: ID does not exist"
Jul 09 19:15:48.072576 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.072553    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"]
Jul 09 19:15:48.080980 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.080962    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4cb532e2/e2e-lifecycle-model-4cb532e2-kserve-6f97b8ffc9-c5xb6"]
Jul 09 19:15:48.119336 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.119312    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffbdd6c-84da-4932-8f44-03ab4a6553a1-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:15:48.119336 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.119335    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plswc\" (UniqueName: \"kubernetes.io/projected/fffbdd6c-84da-4932-8f44-03ab4a6553a1-kube-api-access-plswc\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:15:48.119611 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.119345    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fffbdd6c-84da-4932-8f44-03ab4a6553a1-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:15:48.738197 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:48.738161    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fffbdd6c-84da-4932-8f44-03ab4a6553a1" path="/var/lib/kubelet/pods/fffbdd6c-84da-4932-8f44-03ab4a6553a1/volumes"
Jul 09 19:15:52.070040 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:52.069988    2581 generic.go:356] "Generic (PLEG): container finished" podID="ca65d9ce-9ec7-4314-8310-c5cb65c75bf1" containerID="f2dfa2da7398f14ee237469f442a140acb5fd55c0d7a61d6748f63505d8d3cf4" exitCode=137
Jul 09 19:15:52.070443 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:52.070053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m" event={"ID":"ca65d9ce-9ec7-4314-8310-c5cb65c75bf1","Type":"ContainerDied","Data":"f2dfa2da7398f14ee237469f442a140acb5fd55c0d7a61d6748f63505d8d3cf4"}
Jul 09 19:15:52.187521 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:52.187493    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"
Jul 09 19:15:52.258327 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:52.258288    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn2mf\" (UniqueName: \"kubernetes.io/projected/ca65d9ce-9ec7-4314-8310-c5cb65c75bf1-kube-api-access-jn2mf\") pod \"ca65d9ce-9ec7-4314-8310-c5cb65c75bf1\" (UID: \"ca65d9ce-9ec7-4314-8310-c5cb65c75bf1\") "
Jul 09 19:15:52.260500 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:52.260473    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca65d9ce-9ec7-4314-8310-c5cb65c75bf1-kube-api-access-jn2mf" (OuterVolumeSpecName: "kube-api-access-jn2mf") pod "ca65d9ce-9ec7-4314-8310-c5cb65c75bf1" (UID: "ca65d9ce-9ec7-4314-8310-c5cb65c75bf1"). InnerVolumeSpecName "kube-api-access-jn2mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:15:52.359881 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:52.359840    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn2mf\" (UniqueName: \"kubernetes.io/projected/ca65d9ce-9ec7-4314-8310-c5cb65c75bf1-kube-api-access-jn2mf\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:15:53.076414 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:53.076320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m" event={"ID":"ca65d9ce-9ec7-4314-8310-c5cb65c75bf1","Type":"ContainerDied","Data":"3a045e87a0a119fc48c1c957d4f0dfc7793af3147b4ea6e3b4503bf3d09f3d02"}
Jul 09 19:15:53.076414 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:53.076359    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"
Jul 09 19:15:53.076414 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:53.076381    2581 scope.go:117] "RemoveContainer" containerID="f2dfa2da7398f14ee237469f442a140acb5fd55c0d7a61d6748f63505d8d3cf4"
Jul 09 19:15:53.098006 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:53.097979    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"]
Jul 09 19:15:53.104997 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:53.104966    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-4cb532e2-29727075-69s6m"]
Jul 09 19:15:54.738973 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:15:54.738940    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca65d9ce-9ec7-4314-8310-c5cb65c75bf1" path="/var/lib/kubelet/pods/ca65d9ce-9ec7-4314-8310-c5cb65c75bf1/volumes"
Jul 09 19:16:00.013987 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:00.013949    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"]
Jul 09 19:16:00.014383 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:00.014151    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc" podUID="5450b9a2-7955-4646-9f2e-067c25cd7666" containerName="cleanup" containerID="cri-o://9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c" gracePeriod=30
Jul 09 19:16:16.204160 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:16.204127    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:16:28.097285 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:28.097244    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:16:30.182169 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.182144    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"
Jul 09 19:16:30.255869 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.255839    2581 generic.go:356] "Generic (PLEG): container finished" podID="5450b9a2-7955-4646-9f2e-067c25cd7666" containerID="9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c" exitCode=137
Jul 09 19:16:30.256049 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.255886    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"
Jul 09 19:16:30.256049 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.255892    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc" event={"ID":"5450b9a2-7955-4646-9f2e-067c25cd7666","Type":"ContainerDied","Data":"9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c"}
Jul 09 19:16:30.256049 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.255937    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc" event={"ID":"5450b9a2-7955-4646-9f2e-067c25cd7666","Type":"ContainerDied","Data":"5b7b843b3f8ed835b728db7443c3f4b1a97ce8e2e135f0cdbd2f1d3f5a59d4b8"}
Jul 09 19:16:30.256049 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.255960    2581 scope.go:117] "RemoveContainer" containerID="9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c"
Jul 09 19:16:30.264061 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.264045    2581 scope.go:117] "RemoveContainer" containerID="9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c"
Jul 09 19:16:30.264279 ip-10-0-139-1 kubenswrapper[2581]: E0709 19:16:30.264261    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c\": container with ID starting with 9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c not found: ID does not exist" containerID="9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c"
Jul 09 19:16:30.264338 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.264289    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c"} err="failed to get container status \"9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c\": rpc error: code = NotFound desc = could not find container \"9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c\": container with ID starting with 9e7d56c237acb75c54f072b2aef709ccb6c9cedba7b387fd11ecf15feaa2d09c not found: ID does not exist"
Jul 09 19:16:30.279812 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.279748    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsz5f\" (UniqueName: \"kubernetes.io/projected/5450b9a2-7955-4646-9f2e-067c25cd7666-kube-api-access-nsz5f\") pod \"5450b9a2-7955-4646-9f2e-067c25cd7666\" (UID: \"5450b9a2-7955-4646-9f2e-067c25cd7666\") "
Jul 09 19:16:30.281895 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.281873    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5450b9a2-7955-4646-9f2e-067c25cd7666-kube-api-access-nsz5f" (OuterVolumeSpecName: "kube-api-access-nsz5f") pod "5450b9a2-7955-4646-9f2e-067c25cd7666" (UID: "5450b9a2-7955-4646-9f2e-067c25cd7666"). InnerVolumeSpecName "kube-api-access-nsz5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:16:30.380949 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.380907    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsz5f\" (UniqueName: \"kubernetes.io/projected/5450b9a2-7955-4646-9f2e-067c25cd7666-kube-api-access-nsz5f\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:16:30.580858 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.580825    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"]
Jul 09 19:16:30.588947 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.588920    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-bx4bc"]
Jul 09 19:16:30.738097 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:30.738054    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5450b9a2-7955-4646-9f2e-067c25cd7666" path="/var/lib/kubelet/pods/5450b9a2-7955-4646-9f2e-067c25cd7666/volumes"
Jul 09 19:16:39.411285 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:16:39.411194    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:17:28.868851 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.868819    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"]
Jul 09 19:17:28.869573 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.869103    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fffbdd6c-84da-4932-8f44-03ab4a6553a1" containerName="main"
Jul 09 19:17:28.869573 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.869113    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fffbdd6c-84da-4932-8f44-03ab4a6553a1" containerName="main"
Jul 09 19:17:28.869573 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.869121    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca65d9ce-9ec7-4314-8310-c5cb65c75bf1" containerName="cleanup"
Jul 09 19:17:28.869573 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.869126    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca65d9ce-9ec7-4314-8310-c5cb65c75bf1" containerName="cleanup"
Jul 09 19:17:28.869573 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.869142    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5450b9a2-7955-4646-9f2e-067c25cd7666" containerName="cleanup"
Jul 09 19:17:28.869573 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.869148    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5450b9a2-7955-4646-9f2e-067c25cd7666" containerName="cleanup"
Jul 09 19:17:28.869573 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.869195    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca65d9ce-9ec7-4314-8310-c5cb65c75bf1" containerName="cleanup"
Jul 09 19:17:28.869573 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.869203    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fffbdd6c-84da-4932-8f44-03ab4a6553a1" containerName="main"
Jul 09 19:17:28.869573 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.869211    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5450b9a2-7955-4646-9f2e-067c25cd7666" containerName="cleanup"
Jul 09 19:17:28.872299 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.872281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:28.875206 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.875185    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fcd3da-openshift-default-dockercfg-x28bw\""
Jul 09 19:17:28.884964 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.884941    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"]
Jul 09 19:17:28.974581 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.974520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-data\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:28.974581 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.974578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-token\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:28.974879 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.974632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-credential-socket\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:28.974879 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.974687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-certs\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:28.974879 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.974708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istiod-ca-cert\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:28.974879 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.974733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-envoy\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:28.974879 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.974815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-socket\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:28.974879 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.974852    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-podinfo\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:28.975095 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:28.974884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9jvg\" (UniqueName: \"kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-kube-api-access-f9jvg\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.075647 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.075585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-data\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.075647 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.075620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-token\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.075647 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.075640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-credential-socket\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.075647 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.075667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-certs\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.076194 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.075690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istiod-ca-cert\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.076194 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.075716    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-envoy\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.076194 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.075756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-socket\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.076194 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.075779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-podinfo\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.076194 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.075805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9jvg\" (UniqueName: \"kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-kube-api-access-f9jvg\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.076194 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.076172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-data\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.076514 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.076306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-certs\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.076688 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.076518    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-socket\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.076900 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.076793    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istiod-ca-cert\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.076900 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.076863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-credential-socket\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.078392 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.078362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-envoy\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.078531 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.078515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-podinfo\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.085340 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.085304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-token\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.085461 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.085438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9jvg\" (UniqueName: \"kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-kube-api-access-f9jvg\") pod \"e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") " pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.183683 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.183589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:29.322969 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.322944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"]
Jul 09 19:17:29.324605 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:17:29.324570    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393c9a5a_7f7c_418f_84f1_2b141f52cfa2.slice/crio-c14dca3880cbd756576482b873450546a8671ebb91e66b527bca90a0f5970914 WatchSource:0}: Error finding container c14dca3880cbd756576482b873450546a8671ebb91e66b527bca90a0f5970914: Status 404 returned error can't find the container with id c14dca3880cbd756576482b873450546a8671ebb91e66b527bca90a0f5970914
Jul 09 19:17:29.326949 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.326914    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:17:29.327057 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.326993    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:17:29.327057 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.327037    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:17:29.531656 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.531556    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" event={"ID":"393c9a5a-7f7c-418f-84f1-2b141f52cfa2","Type":"ContainerStarted","Data":"fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b"}
Jul 09 19:17:29.531656 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:29.531628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" event={"ID":"393c9a5a-7f7c-418f-84f1-2b141f52cfa2","Type":"ContainerStarted","Data":"c14dca3880cbd756576482b873450546a8671ebb91e66b527bca90a0f5970914"}
Jul 09 19:17:30.183797 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:30.183747    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:30.188477 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:30.188448    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:30.213798 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:30.213749    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" podStartSLOduration=2.213733003 podStartE2EDuration="2.213733003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:17:29.555692411 +0000 UTC m=+1935.349816470" watchObservedRunningTime="2026-07-09 19:17:30.213733003 +0000 UTC m=+1936.007857034"
Jul 09 19:17:30.536482 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:30.536388    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:30.537282 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:30.537259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:32.200310 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:32.200274    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:17:45.302603 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:45.302564    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:17:48.633225 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:48.633190    2581 generic.go:356] "Generic (PLEG): container finished" podID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerID="fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b" exitCode=0
Jul 09 19:17:48.633736 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:48.633243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" event={"ID":"393c9a5a-7f7c-418f-84f1-2b141f52cfa2","Type":"ContainerDied","Data":"fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b"}
Jul 09 19:17:48.633736 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:48.633632    2581 scope.go:117] "RemoveContainer" containerID="fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b"
Jul 09 19:17:48.634614 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:48.634585    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:17:48.634718 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:48.634653    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:17:48.634718 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:48.634708    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:17:49.643437 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:49.643391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" event={"ID":"393c9a5a-7f7c-418f-84f1-2b141f52cfa2","Type":"ContainerStarted","Data":"27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d"}
Jul 09 19:17:50.183833 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:50.183795    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:50.184042 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:50.184020    2581 patch_prober.go:28] interesting pod/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 09 19:17:50.184091 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:50.184068    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 09 19:17:51.184691 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:51.184650    2581 patch_prober.go:28] interesting pod/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 09 19:17:51.185079 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:51.184707    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 09 19:17:52.184733 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:52.184692    2581 patch_prober.go:28] interesting pod/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 09 19:17:52.185095 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:52.184750    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 09 19:17:53.184942 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:53.184900    2581 patch_prober.go:28] interesting pod/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 09 19:17:53.185352 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:53.184961    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 09 19:17:54.188600 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:54.188571    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:54.189077 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:54.188971    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:54.189741 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:54.189720    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:17:57.098872 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:57.098833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:17:59.402375 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.402290    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"]
Jul 09 19:17:59.405433 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.405415    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.408439 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.408417    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fcd3da\"/\"kube-root-ca.crt\""
Jul 09 19:17:59.409736 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.409718    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fcd3da\"/\"openshift-service-ca.crt\""
Jul 09 19:17:59.409824 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.409723    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fcd3da\"/\"default-dockercfg-dn4sz\""
Jul 09 19:17:59.409883 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.409723    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fcd3da\"/\"test-model-fcd3da-kserve-self-signed-certs\""
Jul 09 19:17:59.419958 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.419933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"]
Jul 09 19:17:59.539403 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.539361    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-home\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.539696 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.539417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4lg\" (UniqueName: \"kubernetes.io/projected/655c0d9e-27c6-4215-aad5-ad8b64a4623a-kube-api-access-8g4lg\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.539696 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.539504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-dshm\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.539696 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.539553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tmp-dir\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.539696 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.539606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tls-certs\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.539696 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.539634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-model-cache\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.640988 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.640946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-home\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.640988 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.641002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4lg\" (UniqueName: \"kubernetes.io/projected/655c0d9e-27c6-4215-aad5-ad8b64a4623a-kube-api-access-8g4lg\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.641265 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.641032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-dshm\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.641265 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.641051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tmp-dir\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.641265 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.641078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tls-certs\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.641265 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.641104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-model-cache\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.641478 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.641452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-home\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.641558 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.641477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tmp-dir\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.641611 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.641570    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-model-cache\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.643505 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.643485    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-dshm\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.643785 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.643767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tls-certs\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.652834 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.652770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4lg\" (UniqueName: \"kubernetes.io/projected/655c0d9e-27c6-4215-aad5-ad8b64a4623a-kube-api-access-8g4lg\") pod \"test-model-fcd3da-kserve-59dd9b96f9-pll4g\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") " pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.714080 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.714028    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:17:59.855196 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:17:59.855174    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"]
Jul 09 19:17:59.856870 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:17:59.856833    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod655c0d9e_27c6_4215_aad5_ad8b64a4623a.slice/crio-48f571f30711c79e6b19aacd3b518f8e860698b3c63864609b4109322c4330b6 WatchSource:0}: Error finding container 48f571f30711c79e6b19aacd3b518f8e860698b3c63864609b4109322c4330b6: Status 404 returned error can't find the container with id 48f571f30711c79e6b19aacd3b518f8e860698b3c63864609b4109322c4330b6
Jul 09 19:18:00.704001 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:00.703965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g" event={"ID":"655c0d9e-27c6-4215-aad5-ad8b64a4623a","Type":"ContainerStarted","Data":"f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748"}
Jul 09 19:18:00.704444 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:00.704010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g" event={"ID":"655c0d9e-27c6-4215-aad5-ad8b64a4623a","Type":"ContainerStarted","Data":"48f571f30711c79e6b19aacd3b518f8e860698b3c63864609b4109322c4330b6"}
Jul 09 19:18:00.723352 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:00.723298    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g" podStartSLOduration=1.72327912 podStartE2EDuration="1.72327912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:17:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:18:00.722656227 +0000 UTC m=+1966.516780312" watchObservedRunningTime="2026-07-09 19:18:00.72327912 +0000 UTC m=+1966.517403148"
Jul 09 19:18:09.714259 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:09.714176    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:18:09.714259 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:09.714235    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:18:09.726656 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:09.726631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:18:09.758183 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:09.758147    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:18:13.000405 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:13.000369    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:18:20.276061 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:20.276029    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"]
Jul 09 19:18:28.001366 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:28.001314    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:18:35.296722 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.296666    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g" podUID="655c0d9e-27c6-4215-aad5-ad8b64a4623a" containerName="main" containerID="cri-o://f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748" gracePeriod=45
Jul 09 19:18:35.539792 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.539768    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:18:35.644513 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.644480    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-home\") pod \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") "
Jul 09 19:18:35.644513 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.644518    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tmp-dir\") pod \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") "
Jul 09 19:18:35.644795 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.644568    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g4lg\" (UniqueName: \"kubernetes.io/projected/655c0d9e-27c6-4215-aad5-ad8b64a4623a-kube-api-access-8g4lg\") pod \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") "
Jul 09 19:18:35.644795 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.644587    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-dshm\") pod \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") "
Jul 09 19:18:35.644795 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.644609    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tls-certs\") pod \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") "
Jul 09 19:18:35.644795 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.644660    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-model-cache\") pod \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\" (UID: \"655c0d9e-27c6-4215-aad5-ad8b64a4623a\") "
Jul 09 19:18:35.644973 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.644814    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-home" (OuterVolumeSpecName: "home") pod "655c0d9e-27c6-4215-aad5-ad8b64a4623a" (UID: "655c0d9e-27c6-4215-aad5-ad8b64a4623a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:35.644973 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.644831    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "655c0d9e-27c6-4215-aad5-ad8b64a4623a" (UID: "655c0d9e-27c6-4215-aad5-ad8b64a4623a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:35.644973 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.644920    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:18:35.645121 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.644997    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:18:35.645121 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.645028    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-model-cache" (OuterVolumeSpecName: "model-cache") pod "655c0d9e-27c6-4215-aad5-ad8b64a4623a" (UID: "655c0d9e-27c6-4215-aad5-ad8b64a4623a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:35.647022 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.646990    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-dshm" (OuterVolumeSpecName: "dshm") pod "655c0d9e-27c6-4215-aad5-ad8b64a4623a" (UID: "655c0d9e-27c6-4215-aad5-ad8b64a4623a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:35.647022 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.647002    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "655c0d9e-27c6-4215-aad5-ad8b64a4623a" (UID: "655c0d9e-27c6-4215-aad5-ad8b64a4623a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:18:35.647166 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.647032    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/655c0d9e-27c6-4215-aad5-ad8b64a4623a-kube-api-access-8g4lg" (OuterVolumeSpecName: "kube-api-access-8g4lg") pod "655c0d9e-27c6-4215-aad5-ad8b64a4623a" (UID: "655c0d9e-27c6-4215-aad5-ad8b64a4623a"). InnerVolumeSpecName "kube-api-access-8g4lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:18:35.746408 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.746379    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g4lg\" (UniqueName: \"kubernetes.io/projected/655c0d9e-27c6-4215-aad5-ad8b64a4623a-kube-api-access-8g4lg\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:18:35.746408 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.746407    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:18:35.746620 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.746416    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/655c0d9e-27c6-4215-aad5-ad8b64a4623a-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:18:35.746620 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.746425    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/655c0d9e-27c6-4215-aad5-ad8b64a4623a-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:18:35.874191 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.874151    2581 generic.go:356] "Generic (PLEG): container finished" podID="655c0d9e-27c6-4215-aad5-ad8b64a4623a" containerID="f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748" exitCode=0
Jul 09 19:18:35.874191 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.874192    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"
Jul 09 19:18:35.874413 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.874204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g" event={"ID":"655c0d9e-27c6-4215-aad5-ad8b64a4623a","Type":"ContainerDied","Data":"f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748"}
Jul 09 19:18:35.874413 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.874243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g" event={"ID":"655c0d9e-27c6-4215-aad5-ad8b64a4623a","Type":"ContainerDied","Data":"48f571f30711c79e6b19aacd3b518f8e860698b3c63864609b4109322c4330b6"}
Jul 09 19:18:35.874413 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.874263    2581 scope.go:117] "RemoveContainer" containerID="f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748"
Jul 09 19:18:35.883853 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.883835    2581 scope.go:117] "RemoveContainer" containerID="f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748"
Jul 09 19:18:35.884107 ip-10-0-139-1 kubenswrapper[2581]: E0709 19:18:35.884088    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748\": container with ID starting with f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748 not found: ID does not exist" containerID="f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748"
Jul 09 19:18:35.884168 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.884122    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748"} err="failed to get container status \"f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748\": rpc error: code = NotFound desc = could not find container \"f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748\": container with ID starting with f51b24e0092f3b3415e128c6d6fe76533cc6341f2c69b88c493fd25a6970e748 not found: ID does not exist"
Jul 09 19:18:35.899144 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.899080    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"]
Jul 09 19:18:35.903435 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:35.903412    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-fcd3da/test-model-fcd3da-kserve-59dd9b96f9-pll4g"]
Jul 09 19:18:36.737667 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:18:36.737637    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="655c0d9e-27c6-4215-aad5-ad8b64a4623a" path="/var/lib/kubelet/pods/655c0d9e-27c6-4215-aad5-ad8b64a4623a/volumes"
Jul 09 19:19:08.400862 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:08.400824    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:19:11.800641 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:11.800608    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"]
Jul 09 19:19:11.801290 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:11.800831    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy" containerID="cri-o://27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d" gracePeriod=30
Jul 09 19:19:17.056929 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.056903    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:19:17.066206 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.066147    2581 generic.go:356] "Generic (PLEG): container finished" podID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerID="27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d" exitCode=0
Jul 09 19:19:17.066206 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.066190    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"
Jul 09 19:19:17.066341 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.066207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" event={"ID":"393c9a5a-7f7c-418f-84f1-2b141f52cfa2","Type":"ContainerDied","Data":"27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d"}
Jul 09 19:19:17.066341 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.066251    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh" event={"ID":"393c9a5a-7f7c-418f-84f1-2b141f52cfa2","Type":"ContainerDied","Data":"c14dca3880cbd756576482b873450546a8671ebb91e66b527bca90a0f5970914"}
Jul 09 19:19:17.066341 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.066273    2581 scope.go:117] "RemoveContainer" containerID="27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d"
Jul 09 19:19:17.081192 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.081163    2581 scope.go:117] "RemoveContainer" containerID="fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b"
Jul 09 19:19:17.087941 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.087915    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-token\") pod \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") "
Jul 09 19:19:17.088093 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.087960    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-certs\") pod \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") "
Jul 09 19:19:17.088093 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.088008    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9jvg\" (UniqueName: \"kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-kube-api-access-f9jvg\") pod \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") "
Jul 09 19:19:17.088093 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.088051    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-socket\") pod \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") "
Jul 09 19:19:17.088093 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.088082    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-envoy\") pod \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") "
Jul 09 19:19:17.088381 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.088106    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-podinfo\") pod \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") "
Jul 09 19:19:17.088381 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.088328    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "393c9a5a-7f7c-418f-84f1-2b141f52cfa2" (UID: "393c9a5a-7f7c-418f-84f1-2b141f52cfa2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:19:17.088381 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.088342    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "393c9a5a-7f7c-418f-84f1-2b141f52cfa2" (UID: "393c9a5a-7f7c-418f-84f1-2b141f52cfa2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:19:17.090476 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.090451    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "393c9a5a-7f7c-418f-84f1-2b141f52cfa2" (UID: "393c9a5a-7f7c-418f-84f1-2b141f52cfa2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:19:17.090611 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.090457    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-token" (OuterVolumeSpecName: "istio-token") pod "393c9a5a-7f7c-418f-84f1-2b141f52cfa2" (UID: "393c9a5a-7f7c-418f-84f1-2b141f52cfa2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:19:17.091267 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.091109    2581 scope.go:117] "RemoveContainer" containerID="27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d"
Jul 09 19:19:17.091267 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.091233    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "393c9a5a-7f7c-418f-84f1-2b141f52cfa2" (UID: "393c9a5a-7f7c-418f-84f1-2b141f52cfa2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:19:17.091436 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.091414    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-kube-api-access-f9jvg" (OuterVolumeSpecName: "kube-api-access-f9jvg") pod "393c9a5a-7f7c-418f-84f1-2b141f52cfa2" (UID: "393c9a5a-7f7c-418f-84f1-2b141f52cfa2"). InnerVolumeSpecName "kube-api-access-f9jvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:19:17.091501 ip-10-0-139-1 kubenswrapper[2581]: E0709 19:19:17.091437    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d\": container with ID starting with 27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d not found: ID does not exist" containerID="27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d"
Jul 09 19:19:17.091501 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.091471    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d"} err="failed to get container status \"27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d\": rpc error: code = NotFound desc = could not find container \"27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d\": container with ID starting with 27321283551d9694ab3a6824c71a63453f9c7d31e76934c9f4649f5002b2041d not found: ID does not exist"
Jul 09 19:19:17.091501 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.091496    2581 scope.go:117] "RemoveContainer" containerID="fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b"
Jul 09 19:19:17.091805 ip-10-0-139-1 kubenswrapper[2581]: E0709 19:19:17.091788    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b\": container with ID starting with fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b not found: ID does not exist" containerID="fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b"
Jul 09 19:19:17.091865 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.091810    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b"} err="failed to get container status \"fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b\": rpc error: code = NotFound desc = could not find container \"fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b\": container with ID starting with fdb154cc6a2e86203df06fcf51d9a3a543ac63327084fd0217a154633257fe7b not found: ID does not exist"
Jul 09 19:19:17.188711 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.188674    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-credential-socket\") pod \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") "
Jul 09 19:19:17.188883 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.188722    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istiod-ca-cert\") pod \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") "
Jul 09 19:19:17.188883 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.188749    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-data\") pod \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\" (UID: \"393c9a5a-7f7c-418f-84f1-2b141f52cfa2\") "
Jul 09 19:19:17.188954 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.188945    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-envoy\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:19:17.188988 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.188962    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-podinfo\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:19:17.188988 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.188974    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-token\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:19:17.189054 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.188986    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:19:17.189054 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.189000    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9jvg\" (UniqueName: \"kubernetes.io/projected/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-kube-api-access-f9jvg\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:19:17.189054 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.189016    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-workload-socket\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:19:17.189054 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.189022    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "393c9a5a-7f7c-418f-84f1-2b141f52cfa2" (UID: "393c9a5a-7f7c-418f-84f1-2b141f52cfa2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:19:17.189181 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.189084    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "393c9a5a-7f7c-418f-84f1-2b141f52cfa2" (UID: "393c9a5a-7f7c-418f-84f1-2b141f52cfa2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:19:17.189435 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.189416    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-data" (OuterVolumeSpecName: "istio-data") pod "393c9a5a-7f7c-418f-84f1-2b141f52cfa2" (UID: "393c9a5a-7f7c-418f-84f1-2b141f52cfa2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:19:17.289773 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.289734    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-credential-socket\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:19:17.289773 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.289766    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istiod-ca-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:19:17.289773 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.289777    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393c9a5a-7f7c-418f-84f1-2b141f52cfa2-istio-data\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:19:17.390389 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.390361    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"]
Jul 09 19:19:17.395345 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:17.395320    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fcd3da-openshift-default-7f9bd8ffbf-92hzh"]
Jul 09 19:19:18.738183 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:18.738146    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" path="/var/lib/kubelet/pods/393c9a5a-7f7c-418f-84f1-2b141f52cfa2/volumes"
Jul 09 19:19:23.095520 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:23.095490    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:19:40.507862 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:40.507778    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:19:51.535756 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.535721    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"]
Jul 09 19:19:51.536253 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.536137    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655c0d9e-27c6-4215-aad5-ad8b64a4623a" containerName="main"
Jul 09 19:19:51.536253 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.536151    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="655c0d9e-27c6-4215-aad5-ad8b64a4623a" containerName="main"
Jul 09 19:19:51.536253 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.536164    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy"
Jul 09 19:19:51.536253 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.536172    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy"
Jul 09 19:19:51.536253 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.536195    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy"
Jul 09 19:19:51.536253 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.536203    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy"
Jul 09 19:19:51.536464 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.536271    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="655c0d9e-27c6-4215-aad5-ad8b64a4623a" containerName="main"
Jul 09 19:19:51.536464 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.536283    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy"
Jul 09 19:19:51.536464 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.536294    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="393c9a5a-7f7c-418f-84f1-2b141f52cfa2" containerName="istio-proxy"
Jul 09 19:19:51.538876 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.538855    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.541695 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.541674    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-6e8c75-openshift-default-dockercfg-59lh2\""
Jul 09 19:19:51.554682 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.554660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"]
Jul 09 19:19:51.664926 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.664893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8zv2\" (UniqueName: \"kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-kube-api-access-v8zv2\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.665124 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.664957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-socket\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.665124 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.664985    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-envoy\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.665124 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.665029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-credential-socket\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.665124 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.665053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-istio-token\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.665329 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.665118    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-certs\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.665329 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.665164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2d716f8-107e-42c5-942f-cc066673103a-istio-podinfo\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.665329 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.665211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-data\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.665329 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.665246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2d716f8-107e-42c5-942f-cc066673103a-istiod-ca-cert\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766003 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.765968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-data\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766003 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2d716f8-107e-42c5-942f-cc066673103a-istiod-ca-cert\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766270 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8zv2\" (UniqueName: \"kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-kube-api-access-v8zv2\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766270 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-socket\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766270 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-envoy\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766270 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-credential-socket\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766270 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-istio-token\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766270 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-certs\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766270 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2d716f8-107e-42c5-942f-cc066673103a-istio-podinfo\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766661 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-data\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766716 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766668    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-socket\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.766783 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.766761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-credential-socket\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.767088 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.767031    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-certs\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.767088 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.767046    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2d716f8-107e-42c5-942f-cc066673103a-istiod-ca-cert\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.768491 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.768465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-envoy\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.768881 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.768864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2d716f8-107e-42c5-942f-cc066673103a-istio-podinfo\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.777374 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.777348    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8zv2\" (UniqueName: \"kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-kube-api-access-v8zv2\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.777576 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.777556    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-istio-token\") pod \"e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") " pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.849628 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.849600    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:51.989590 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.989563    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"]
Jul 09 19:19:51.990912 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:19:51.990887    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d716f8_107e_42c5_942f_cc066673103a.slice/crio-a93498d170f2ca682c7e756f10ba088a585ca9240c7f0ab736493d882f32f174 WatchSource:0}: Error finding container a93498d170f2ca682c7e756f10ba088a585ca9240c7f0ab736493d882f32f174: Status 404 returned error can't find the container with id a93498d170f2ca682c7e756f10ba088a585ca9240c7f0ab736493d882f32f174
Jul 09 19:19:51.992927 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.992891    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:19:51.993019 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.992958    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:19:51.993019 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:51.992990    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:19:52.235859 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:52.235750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" event={"ID":"f2d716f8-107e-42c5-942f-cc066673103a","Type":"ContainerStarted","Data":"d44bd39a87b58e5544aeb6f63ad65335d3df4f48f6e677f99810fc739a2449c6"}
Jul 09 19:19:52.235859 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:52.235831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" event={"ID":"f2d716f8-107e-42c5-942f-cc066673103a","Type":"ContainerStarted","Data":"a93498d170f2ca682c7e756f10ba088a585ca9240c7f0ab736493d882f32f174"}
Jul 09 19:19:52.259007 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:52.258959    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" podStartSLOduration=1.258944652 podStartE2EDuration="1.258944652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:19:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:19:52.257680375 +0000 UTC m=+2078.051804426" watchObservedRunningTime="2026-07-09 19:19:52.258944652 +0000 UTC m=+2078.053068680"
Jul 09 19:19:52.850338 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:52.850304    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:53.855219 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:53.855190    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:54.244872 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:54.244783    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:54.245837 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:54.245817    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:19:54.809821 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:19:54.809786    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:20:08.504660 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:08.504618    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:20:09.717437 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:09.716505    2581 patch_prober.go:28] interesting pod/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": read tcp 10.133.0.2:56032->10.133.0.42:15021: read: connection reset by peer" start-of-body=
Jul 09 19:20:09.717437 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:09.716577    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": read tcp 10.133.0.2:56032->10.133.0.42:15021: read: connection reset by peer"
Jul 09 19:20:10.322962 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:10.322927    2581 generic.go:356] "Generic (PLEG): container finished" podID="f2d716f8-107e-42c5-942f-cc066673103a" containerID="d44bd39a87b58e5544aeb6f63ad65335d3df4f48f6e677f99810fc739a2449c6" exitCode=0
Jul 09 19:20:10.323163 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:10.323004    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" event={"ID":"f2d716f8-107e-42c5-942f-cc066673103a","Type":"ContainerDied","Data":"d44bd39a87b58e5544aeb6f63ad65335d3df4f48f6e677f99810fc739a2449c6"}
Jul 09 19:20:10.323458 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:10.323441    2581 scope.go:117] "RemoveContainer" containerID="d44bd39a87b58e5544aeb6f63ad65335d3df4f48f6e677f99810fc739a2449c6"
Jul 09 19:20:10.324429 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:10.324406    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:20:10.324490 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:10.324465    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:20:10.324525 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:10.324496    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:20:11.332851 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:11.332807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" event={"ID":"f2d716f8-107e-42c5-942f-cc066673103a","Type":"ContainerStarted","Data":"7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21"}
Jul 09 19:20:11.849895 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:11.849859    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:20:11.850298 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:11.850268    2581 patch_prober.go:28] interesting pod/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 09 19:20:11.850358 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:11.850333    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 09 19:20:12.850181 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:12.850147    2581 patch_prober.go:28] interesting pod/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 09 19:20:12.850591 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:12.850203    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 09 19:20:13.850680 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:13.850644    2581 patch_prober.go:28] interesting pod/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 09 19:20:13.851064 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:13.850698    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 09 19:20:14.813381 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:14.813354    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:20:14.817044 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:14.817021    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:20:14.850958 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:14.850925    2581 patch_prober.go:28] interesting pod/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 09 19:20:14.851292 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:14.850995    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 09 19:20:15.854353 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:15.854314    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:20:15.854823 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:15.854726    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:20:15.855370 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:15.855354    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:20:25.990428 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:20:25.990390    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:21:00.718771 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.718728    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"]
Jul 09 19:21:00.722033 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.722014    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.728054 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.728031    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"default-dockercfg-g5t4x\""
Jul 09 19:21:00.729423 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.729400    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"auth-test-model-a966ef-kserve-self-signed-certs\""
Jul 09 19:21:00.729527 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.729401    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"openshift-service-ca.crt\""
Jul 09 19:21:00.729527 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.729410    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"kube-root-ca.crt\""
Jul 09 19:21:00.737792 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.737766    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"]
Jul 09 19:21:00.849941 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.849908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-dshm\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.849941 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.849948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-tmp-dir\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.850169 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.850052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-model-cache\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.850169 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.850132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-home\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.850246 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.850220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/966c836d-7485-45cc-8766-bf978283198e-tls-certs\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.850289 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.850249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkr9z\" (UniqueName: \"kubernetes.io/projected/966c836d-7485-45cc-8766-bf978283198e-kube-api-access-fkr9z\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.951360 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.951323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-dshm\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.951360 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.951363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-tmp-dir\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.951632 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.951402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-model-cache\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.951632 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.951462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-home\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.951632 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.951485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/966c836d-7485-45cc-8766-bf978283198e-tls-certs\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.951632 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.951508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkr9z\" (UniqueName: \"kubernetes.io/projected/966c836d-7485-45cc-8766-bf978283198e-kube-api-access-fkr9z\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.951850 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.951777    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-tmp-dir\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.951850 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.951804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-home\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.951957 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.951887    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-model-cache\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.953906 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.953877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-dshm\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.954953 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.954926    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/966c836d-7485-45cc-8766-bf978283198e-tls-certs\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:00.963246 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:00.963210    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkr9z\" (UniqueName: \"kubernetes.io/projected/966c836d-7485-45cc-8766-bf978283198e-kube-api-access-fkr9z\") pod \"auth-test-model-a966ef-kserve-5bc7754687-d22w7\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") " pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:01.031186 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:01.031097    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:01.166573 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:01.166531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"]
Jul 09 19:21:01.168419 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:21:01.168384    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod966c836d_7485_45cc_8766_bf978283198e.slice/crio-8354552f0e00e4aa6bdcbeac83cf4da282b344d32a0827938b2d9ac9c09791f1 WatchSource:0}: Error finding container 8354552f0e00e4aa6bdcbeac83cf4da282b344d32a0827938b2d9ac9c09791f1: Status 404 returned error can't find the container with id 8354552f0e00e4aa6bdcbeac83cf4da282b344d32a0827938b2d9ac9c09791f1
Jul 09 19:21:01.573157 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:01.573120    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7" event={"ID":"966c836d-7485-45cc-8766-bf978283198e","Type":"ContainerStarted","Data":"b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e"}
Jul 09 19:21:01.573157 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:01.573162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7" event={"ID":"966c836d-7485-45cc-8766-bf978283198e","Type":"ContainerStarted","Data":"8354552f0e00e4aa6bdcbeac83cf4da282b344d32a0827938b2d9ac9c09791f1"}
Jul 09 19:21:01.592867 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:01.592821    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7" podStartSLOduration=1.592806285 podStartE2EDuration="1.592806285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:21:01.592216096 +0000 UTC m=+2147.386340124" watchObservedRunningTime="2026-07-09 19:21:01.592806285 +0000 UTC m=+2147.386930313"
Jul 09 19:21:04.394123 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:04.394088    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:21:11.031389 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:11.031290    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:11.031891 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:11.031564    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:11.043839 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:11.043818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:11.633033 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:11.632997    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:21:45.403942 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:21:45.403904    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:22:03.692990 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:22:03.692951    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:22:18.007655 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:22:18.007615    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:22:32.296409 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:22:32.296370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:22:50.505433 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:22:50.505395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:23:11.802384 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:11.802349    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:23:25.199934 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:25.199895    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"]
Jul 09 19:23:29.502219 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:29.502181    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:23:40.220342 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.220293    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7" podUID="966c836d-7485-45cc-8766-bf978283198e" containerName="main" containerID="cri-o://b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e" gracePeriod=45
Jul 09 19:23:40.467260 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.467238    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:23:40.508615 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.508519    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-home\") pod \"966c836d-7485-45cc-8766-bf978283198e\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") "
Jul 09 19:23:40.508615 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.508568    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-model-cache\") pod \"966c836d-7485-45cc-8766-bf978283198e\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") "
Jul 09 19:23:40.508615 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.508587    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-dshm\") pod \"966c836d-7485-45cc-8766-bf978283198e\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") "
Jul 09 19:23:40.508615 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.508614    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/966c836d-7485-45cc-8766-bf978283198e-tls-certs\") pod \"966c836d-7485-45cc-8766-bf978283198e\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") "
Jul 09 19:23:40.508909 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.508640    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-tmp-dir\") pod \"966c836d-7485-45cc-8766-bf978283198e\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") "
Jul 09 19:23:40.508909 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.508726    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkr9z\" (UniqueName: \"kubernetes.io/projected/966c836d-7485-45cc-8766-bf978283198e-kube-api-access-fkr9z\") pod \"966c836d-7485-45cc-8766-bf978283198e\" (UID: \"966c836d-7485-45cc-8766-bf978283198e\") "
Jul 09 19:23:40.508909 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.508842    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-model-cache" (OuterVolumeSpecName: "model-cache") pod "966c836d-7485-45cc-8766-bf978283198e" (UID: "966c836d-7485-45cc-8766-bf978283198e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:40.508909 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.508859    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-home" (OuterVolumeSpecName: "home") pod "966c836d-7485-45cc-8766-bf978283198e" (UID: "966c836d-7485-45cc-8766-bf978283198e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:40.509122 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.509003    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:23:40.509122 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.509041    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:23:40.509122 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.509065    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "966c836d-7485-45cc-8766-bf978283198e" (UID: "966c836d-7485-45cc-8766-bf978283198e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:40.511030 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.511003    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-dshm" (OuterVolumeSpecName: "dshm") pod "966c836d-7485-45cc-8766-bf978283198e" (UID: "966c836d-7485-45cc-8766-bf978283198e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:40.511127 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.511075    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/966c836d-7485-45cc-8766-bf978283198e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "966c836d-7485-45cc-8766-bf978283198e" (UID: "966c836d-7485-45cc-8766-bf978283198e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:23:40.511127 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.511109    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/966c836d-7485-45cc-8766-bf978283198e-kube-api-access-fkr9z" (OuterVolumeSpecName: "kube-api-access-fkr9z") pod "966c836d-7485-45cc-8766-bf978283198e" (UID: "966c836d-7485-45cc-8766-bf978283198e"). InnerVolumeSpecName "kube-api-access-fkr9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:23:40.610075 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.610040    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:23:40.610075 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.610068    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/966c836d-7485-45cc-8766-bf978283198e-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:23:40.610075 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.610076    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/966c836d-7485-45cc-8766-bf978283198e-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:23:40.610284 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:40.610085    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkr9z\" (UniqueName: \"kubernetes.io/projected/966c836d-7485-45cc-8766-bf978283198e-kube-api-access-fkr9z\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:23:41.339764 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:41.339729    2581 generic.go:356] "Generic (PLEG): container finished" podID="966c836d-7485-45cc-8766-bf978283198e" containerID="b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e" exitCode=0
Jul 09 19:23:41.340185 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:41.339775    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"
Jul 09 19:23:41.340185 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:41.339815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7" event={"ID":"966c836d-7485-45cc-8766-bf978283198e","Type":"ContainerDied","Data":"b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e"}
Jul 09 19:23:41.340185 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:41.339860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7" event={"ID":"966c836d-7485-45cc-8766-bf978283198e","Type":"ContainerDied","Data":"8354552f0e00e4aa6bdcbeac83cf4da282b344d32a0827938b2d9ac9c09791f1"}
Jul 09 19:23:41.340185 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:41.339878    2581 scope.go:117] "RemoveContainer" containerID="b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e"
Jul 09 19:23:41.348399 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:41.348383    2581 scope.go:117] "RemoveContainer" containerID="b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e"
Jul 09 19:23:41.348668 ip-10-0-139-1 kubenswrapper[2581]: E0709 19:23:41.348651    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e\": container with ID starting with b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e not found: ID does not exist" containerID="b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e"
Jul 09 19:23:41.348730 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:41.348675    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e"} err="failed to get container status \"b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e\": rpc error: code = NotFound desc = could not find container \"b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e\": container with ID starting with b34a459cd1ac9e71e60ae68fbaaa04c9c08cb6bd8b43d587ec28a576ccbd9c7e not found: ID does not exist"
Jul 09 19:23:41.358319 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:41.358296    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"]
Jul 09 19:23:41.364867 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:41.364847    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/auth-test-model-a966ef-kserve-5bc7754687-d22w7"]
Jul 09 19:23:41.699846 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:41.699762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:23:42.737299 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:23:42.737267    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="966c836d-7485-45cc-8766-bf978283198e" path="/var/lib/kubelet/pods/966c836d-7485-45cc-8766-bf978283198e/volumes"
Jul 09 19:24:07.004943 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.004870    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"]
Jul 09 19:24:07.007686 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.005998    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="966c836d-7485-45cc-8766-bf978283198e" containerName="main"
Jul 09 19:24:07.007686 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.006031    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="966c836d-7485-45cc-8766-bf978283198e" containerName="main"
Jul 09 19:24:07.007686 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.006194    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="966c836d-7485-45cc-8766-bf978283198e" containerName="main"
Jul 09 19:24:07.012226 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.009891    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.014483 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.014458    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"kube-root-ca.crt\""
Jul 09 19:24:07.014483 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.014469    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"openshift-service-ca.crt\""
Jul 09 19:24:07.014707 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.014493    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"default-dockercfg-g5t4x\""
Jul 09 19:24:07.014707 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.014473    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"sub-test-model-a966ef-kserve-self-signed-certs\""
Jul 09 19:24:07.017661 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.017641    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"]
Jul 09 19:24:07.132951 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.132915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-tmp-dir\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.133139 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.132964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghkhv\" (UniqueName: \"kubernetes.io/projected/36110179-8a01-43f0-ad45-2e6650b121a0-kube-api-access-ghkhv\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.133139 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.133021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36110179-8a01-43f0-ad45-2e6650b121a0-tls-certs\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.133139 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.133059    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-dshm\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.133139 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.133092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-home\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.133139 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.133123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-model-cache\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.234496 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.234460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghkhv\" (UniqueName: \"kubernetes.io/projected/36110179-8a01-43f0-ad45-2e6650b121a0-kube-api-access-ghkhv\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.234496 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.234499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36110179-8a01-43f0-ad45-2e6650b121a0-tls-certs\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.234805 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.234528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-dshm\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.234805 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.234596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-home\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.234805 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.234637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-model-cache\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.234805 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.234727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-tmp-dir\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.235094 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.235065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-home\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.235144 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.235114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-model-cache\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.235144 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.235126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-tmp-dir\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.237088 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.237065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-dshm\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.237229 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.237211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36110179-8a01-43f0-ad45-2e6650b121a0-tls-certs\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.244852 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.244827    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghkhv\" (UniqueName: \"kubernetes.io/projected/36110179-8a01-43f0-ad45-2e6650b121a0-kube-api-access-ghkhv\") pod \"sub-test-model-a966ef-kserve-74cbfff465-5dsw8\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") " pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.322792 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.322701    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:07.456097 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:07.456070    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"]
Jul 09 19:24:07.458152 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:24:07.458127    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36110179_8a01_43f0_ad45_2e6650b121a0.slice/crio-a596cc03c5432c68deb5be04b0febf5b96c5bc52c86726abc9bc1d6c80322890 WatchSource:0}: Error finding container a596cc03c5432c68deb5be04b0febf5b96c5bc52c86726abc9bc1d6c80322890: Status 404 returned error can't find the container with id a596cc03c5432c68deb5be04b0febf5b96c5bc52c86726abc9bc1d6c80322890
Jul 09 19:24:08.468624 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:08.468585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8" event={"ID":"36110179-8a01-43f0-ad45-2e6650b121a0","Type":"ContainerStarted","Data":"2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e"}
Jul 09 19:24:08.468997 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:08.468632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8" event={"ID":"36110179-8a01-43f0-ad45-2e6650b121a0","Type":"ContainerStarted","Data":"a596cc03c5432c68deb5be04b0febf5b96c5bc52c86726abc9bc1d6c80322890"}
Jul 09 19:24:08.489361 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:08.489310    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8" podStartSLOduration=2.489294211 podStartE2EDuration="2.489294211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:24:08.487307884 +0000 UTC m=+2334.281431942" watchObservedRunningTime="2026-07-09 19:24:08.489294211 +0000 UTC m=+2334.283418217"
Jul 09 19:24:11.394595 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:11.394559    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:24:17.322965 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:17.322911    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:17.323685 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:17.323015    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:17.335020 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:17.334995    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:17.527712 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:17.527684    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:24:25.701283 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:25.701242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:24:45.996073 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:45.996033    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:24:51.987391 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:24:51.987359    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"]
Jul 09 19:25:03.192574 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:03.192515    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:25:07.007850 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.007807    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8" podUID="36110179-8a01-43f0-ad45-2e6650b121a0" containerName="main" containerID="cri-o://2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e" gracePeriod=45
Jul 09 19:25:07.251596 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.251568    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:25:07.347253 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.347220    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghkhv\" (UniqueName: \"kubernetes.io/projected/36110179-8a01-43f0-ad45-2e6650b121a0-kube-api-access-ghkhv\") pod \"36110179-8a01-43f0-ad45-2e6650b121a0\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") "
Jul 09 19:25:07.347436 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.347291    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36110179-8a01-43f0-ad45-2e6650b121a0-tls-certs\") pod \"36110179-8a01-43f0-ad45-2e6650b121a0\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") "
Jul 09 19:25:07.347436 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.347316    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-dshm\") pod \"36110179-8a01-43f0-ad45-2e6650b121a0\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") "
Jul 09 19:25:07.347436 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.347369    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-home\") pod \"36110179-8a01-43f0-ad45-2e6650b121a0\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") "
Jul 09 19:25:07.347436 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.347405    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-tmp-dir\") pod \"36110179-8a01-43f0-ad45-2e6650b121a0\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") "
Jul 09 19:25:07.347436 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.347428    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-model-cache\") pod \"36110179-8a01-43f0-ad45-2e6650b121a0\" (UID: \"36110179-8a01-43f0-ad45-2e6650b121a0\") "
Jul 09 19:25:07.347774 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.347746    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-home" (OuterVolumeSpecName: "home") pod "36110179-8a01-43f0-ad45-2e6650b121a0" (UID: "36110179-8a01-43f0-ad45-2e6650b121a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:07.347774 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.347762    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36110179-8a01-43f0-ad45-2e6650b121a0" (UID: "36110179-8a01-43f0-ad45-2e6650b121a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:07.347892 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.347755    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "36110179-8a01-43f0-ad45-2e6650b121a0" (UID: "36110179-8a01-43f0-ad45-2e6650b121a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:07.348118 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.348048    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:25:07.348118 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.348076    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:25:07.348118 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.348090    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:25:07.349635 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.349612    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36110179-8a01-43f0-ad45-2e6650b121a0-kube-api-access-ghkhv" (OuterVolumeSpecName: "kube-api-access-ghkhv") pod "36110179-8a01-43f0-ad45-2e6650b121a0" (UID: "36110179-8a01-43f0-ad45-2e6650b121a0"). InnerVolumeSpecName "kube-api-access-ghkhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:25:07.350179 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.350160    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36110179-8a01-43f0-ad45-2e6650b121a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36110179-8a01-43f0-ad45-2e6650b121a0" (UID: "36110179-8a01-43f0-ad45-2e6650b121a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:25:07.350227 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.350159    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-dshm" (OuterVolumeSpecName: "dshm") pod "36110179-8a01-43f0-ad45-2e6650b121a0" (UID: "36110179-8a01-43f0-ad45-2e6650b121a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:07.448961 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.448924    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghkhv\" (UniqueName: \"kubernetes.io/projected/36110179-8a01-43f0-ad45-2e6650b121a0-kube-api-access-ghkhv\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:25:07.448961 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.448953    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36110179-8a01-43f0-ad45-2e6650b121a0-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:25:07.448961 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.448963    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36110179-8a01-43f0-ad45-2e6650b121a0-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:25:07.751883 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.751804    2581 generic.go:356] "Generic (PLEG): container finished" podID="36110179-8a01-43f0-ad45-2e6650b121a0" containerID="2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e" exitCode=0
Jul 09 19:25:07.751883 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.751858    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"
Jul 09 19:25:07.751883 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.751867    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8" event={"ID":"36110179-8a01-43f0-ad45-2e6650b121a0","Type":"ContainerDied","Data":"2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e"}
Jul 09 19:25:07.752115 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.751896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8" event={"ID":"36110179-8a01-43f0-ad45-2e6650b121a0","Type":"ContainerDied","Data":"a596cc03c5432c68deb5be04b0febf5b96c5bc52c86726abc9bc1d6c80322890"}
Jul 09 19:25:07.752115 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.751912    2581 scope.go:117] "RemoveContainer" containerID="2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e"
Jul 09 19:25:07.760929 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.760912    2581 scope.go:117] "RemoveContainer" containerID="2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e"
Jul 09 19:25:07.761170 ip-10-0-139-1 kubenswrapper[2581]: E0709 19:25:07.761152    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e\": container with ID starting with 2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e not found: ID does not exist" containerID="2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e"
Jul 09 19:25:07.761206 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.761178    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e"} err="failed to get container status \"2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e\": rpc error: code = NotFound desc = could not find container \"2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e\": container with ID starting with 2f28e131775052d0ac894da28e163122b4dd69d3529ec1b82741e2214c06059e not found: ID does not exist"
Jul 09 19:25:07.775097 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.775074    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"]
Jul 09 19:25:07.779942 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:07.779921    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/sub-test-model-a966ef-kserve-74cbfff465-5dsw8"]
Jul 09 19:25:08.742144 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:08.742108    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36110179-8a01-43f0-ad45-2e6650b121a0" path="/var/lib/kubelet/pods/36110179-8a01-43f0-ad45-2e6650b121a0/volumes"
Jul 09 19:25:14.845707 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:14.845675    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:25:14.851150 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:14.851127    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kksj7_4b9a8392-e896-4032-a97b-645d8fba6b45/ovn-acl-logging/0.log"
Jul 09 19:25:19.500483 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:19.500448    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:25:39.905481 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:39.905403    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"]
Jul 09 19:25:39.905911 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:39.905735    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36110179-8a01-43f0-ad45-2e6650b121a0" containerName="main"
Jul 09 19:25:39.905911 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:39.905745    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="36110179-8a01-43f0-ad45-2e6650b121a0" containerName="main"
Jul 09 19:25:39.905911 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:39.905817    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="36110179-8a01-43f0-ad45-2e6650b121a0" containerName="main"
Jul 09 19:25:39.909034 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:39.909014    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:39.911641 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:39.911621    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"kube-root-ca.crt\""
Jul 09 19:25:39.911737 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:39.911622    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"openshift-service-ca.crt\""
Jul 09 19:25:39.912887 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:39.912872    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"default-dockercfg-g5t4x\""
Jul 09 19:25:39.913075 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:39.913056    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a966ef\"/\"rate-test-model-a966ef-kserve-self-signed-certs\""
Jul 09 19:25:39.918612 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:39.918592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"]
Jul 09 19:25:40.031269 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.031218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-dshm\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.031463 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.031305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-home\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.031463 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.031334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tmp-dir\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.031463 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.031350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tls-certs\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.031463 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.031396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-model-cache\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.031463 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.031414    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxtbn\" (UniqueName: \"kubernetes.io/projected/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-kube-api-access-nxtbn\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.132351 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.132306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-dshm\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.132574 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.132375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-home\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.132574 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.132403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tmp-dir\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.132574 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.132419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tls-certs\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.132574 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.132438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-model-cache\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.132574 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.132461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxtbn\" (UniqueName: \"kubernetes.io/projected/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-kube-api-access-nxtbn\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.132854 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.132830    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tmp-dir\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.132917 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.132895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-model-cache\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.132970 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.132909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-home\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.134820 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.134799    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-dshm\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.135061 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.135046    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tls-certs\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.142247 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.142221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxtbn\" (UniqueName: \"kubernetes.io/projected/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-kube-api-access-nxtbn\") pod \"rate-test-model-a966ef-kserve-5675db746c-jznjv\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") " pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.219383 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.219296    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:40.354392 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.354368    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"]
Jul 09 19:25:40.356002 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:25:40.355975    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded5bb7a8_bed0_4cc9_a3f4_97c2a38d7776.slice/crio-4b7d5ebf036ad4389a6564ded44b898f10d8e59af50df4dc38680af36dbb0575 WatchSource:0}: Error finding container 4b7d5ebf036ad4389a6564ded44b898f10d8e59af50df4dc38680af36dbb0575: Status 404 returned error can't find the container with id 4b7d5ebf036ad4389a6564ded44b898f10d8e59af50df4dc38680af36dbb0575
Jul 09 19:25:40.907906 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.907867    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv" event={"ID":"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776","Type":"ContainerStarted","Data":"069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef"}
Jul 09 19:25:40.908291 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.907912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv" event={"ID":"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776","Type":"ContainerStarted","Data":"4b7d5ebf036ad4389a6564ded44b898f10d8e59af50df4dc38680af36dbb0575"}
Jul 09 19:25:40.928081 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:40.928028    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv" podStartSLOduration=1.92801308 podStartE2EDuration="1.92801308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:25:40.927791554 +0000 UTC m=+2426.721915593" watchObservedRunningTime="2026-07-09 19:25:40.92801308 +0000 UTC m=+2426.722137088"
Jul 09 19:25:44.590526 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:44.590487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:25:50.220329 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:50.220275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:50.220840 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:50.220347    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:50.233114 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:50.233089    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:25:50.965055 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:25:50.965027    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:26:06.691613 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:06.691578    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:26:21.898043 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:21.898008    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:26:29.708089 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:29.708052    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"]
Jul 09 19:26:41.098355 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:41.098321    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:26:44.728396 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:44.728338    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv" podUID="ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" containerName="main" containerID="cri-o://069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef" gracePeriod=45
Jul 09 19:26:44.979473 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:44.979414    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:26:45.077869 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.077834    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tls-certs\") pod \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") "
Jul 09 19:26:45.078065 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.077889    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-model-cache\") pod \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") "
Jul 09 19:26:45.078065 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.077912    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tmp-dir\") pod \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") "
Jul 09 19:26:45.078065 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.077951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxtbn\" (UniqueName: \"kubernetes.io/projected/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-kube-api-access-nxtbn\") pod \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") "
Jul 09 19:26:45.078065 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.077980    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-home\") pod \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") "
Jul 09 19:26:45.078065 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.078015    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-dshm\") pod \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\" (UID: \"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776\") "
Jul 09 19:26:45.078330 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.078172    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-model-cache" (OuterVolumeSpecName: "model-cache") pod "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" (UID: "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:26:45.078330 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.078220    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" (UID: "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:26:45.078330 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.078287    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-model-cache\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:26:45.078330 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.078305    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-home" (OuterVolumeSpecName: "home") pod "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" (UID: "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:26:45.080210 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.080187    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" (UID: "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:26:45.080337 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.080320    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-dshm" (OuterVolumeSpecName: "dshm") pod "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" (UID: "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:26:45.080385 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.080350    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-kube-api-access-nxtbn" (OuterVolumeSpecName: "kube-api-access-nxtbn") pod "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" (UID: "ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776"). InnerVolumeSpecName "kube-api-access-nxtbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:26:45.178925 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.178890    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tls-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:26:45.178925 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.178919    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-tmp-dir\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:26:45.178925 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.178928    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxtbn\" (UniqueName: \"kubernetes.io/projected/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-kube-api-access-nxtbn\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:26:45.179161 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.178939    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-home\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:26:45.179161 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.178947    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776-dshm\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:26:45.219207 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.219170    2581 generic.go:356] "Generic (PLEG): container finished" podID="ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" containerID="069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef" exitCode=0
Jul 09 19:26:45.219207 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.219210    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"
Jul 09 19:26:45.219411 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.219263    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv" event={"ID":"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776","Type":"ContainerDied","Data":"069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef"}
Jul 09 19:26:45.219411 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.219302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv" event={"ID":"ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776","Type":"ContainerDied","Data":"4b7d5ebf036ad4389a6564ded44b898f10d8e59af50df4dc38680af36dbb0575"}
Jul 09 19:26:45.219411 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.219320    2581 scope.go:117] "RemoveContainer" containerID="069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef"
Jul 09 19:26:45.228559 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.228519    2581 scope.go:117] "RemoveContainer" containerID="069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef"
Jul 09 19:26:45.228834 ip-10-0-139-1 kubenswrapper[2581]: E0709 19:26:45.228809    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef\": container with ID starting with 069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef not found: ID does not exist" containerID="069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef"
Jul 09 19:26:45.228920 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.228840    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef"} err="failed to get container status \"069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef\": rpc error: code = NotFound desc = could not find container \"069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef\": container with ID starting with 069def5e3df013f3bfecf2bf72b3d8a69dc8fa49d9eacaeaacb2278c259e27ef not found: ID does not exist"
Jul 09 19:26:45.242990 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.242935    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"]
Jul 09 19:26:45.247583 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:45.247562    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a966ef/rate-test-model-a966ef-kserve-5675db746c-jznjv"]
Jul 09 19:26:46.737216 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:26:46.737185    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" path="/var/lib/kubelet/pods/ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776/volumes"
Jul 09 19:27:06.404561 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:06.404467    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:27:09.708495 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:09.708461    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"]
Jul 09 19:27:09.708967 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:09.708713    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy" containerID="cri-o://7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21" gracePeriod=30
Jul 09 19:27:14.936288 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.936252    2581 scope.go:117] "RemoveContainer" containerID="d44bd39a87b58e5544aeb6f63ad65335d3df4f48f6e677f99810fc739a2449c6"
Jul 09 19:27:14.971610 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.971558    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:27:14.998972 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.998943    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-credential-socket\") pod \"f2d716f8-107e-42c5-942f-cc066673103a\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") "
Jul 09 19:27:14.999134 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.998979    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-data\") pod \"f2d716f8-107e-42c5-942f-cc066673103a\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") "
Jul 09 19:27:14.999134 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999012    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-socket\") pod \"f2d716f8-107e-42c5-942f-cc066673103a\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") "
Jul 09 19:27:14.999134 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999035    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2d716f8-107e-42c5-942f-cc066673103a-istio-podinfo\") pod \"f2d716f8-107e-42c5-942f-cc066673103a\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") "
Jul 09 19:27:14.999134 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999072    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-envoy\") pod \"f2d716f8-107e-42c5-942f-cc066673103a\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") "
Jul 09 19:27:14.999134 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999115    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2d716f8-107e-42c5-942f-cc066673103a-istiod-ca-cert\") pod \"f2d716f8-107e-42c5-942f-cc066673103a\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") "
Jul 09 19:27:14.999362 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999173    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-certs\") pod \"f2d716f8-107e-42c5-942f-cc066673103a\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") "
Jul 09 19:27:14.999362 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999204    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8zv2\" (UniqueName: \"kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-kube-api-access-v8zv2\") pod \"f2d716f8-107e-42c5-942f-cc066673103a\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") "
Jul 09 19:27:14.999362 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999255    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-istio-token\") pod \"f2d716f8-107e-42c5-942f-cc066673103a\" (UID: \"f2d716f8-107e-42c5-942f-cc066673103a\") "
Jul 09 19:27:14.999362 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999297    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2d716f8-107e-42c5-942f-cc066673103a" (UID: "f2d716f8-107e-42c5-942f-cc066673103a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:14.999362 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999323    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2d716f8-107e-42c5-942f-cc066673103a" (UID: "f2d716f8-107e-42c5-942f-cc066673103a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:14.999641 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999510    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-credential-socket\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:27:14.999641 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999528    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-socket\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:27:14.999846 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999823    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2d716f8-107e-42c5-942f-cc066673103a" (UID: "f2d716f8-107e-42c5-942f-cc066673103a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:14.999991 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999897    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2d716f8-107e-42c5-942f-cc066673103a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2d716f8-107e-42c5-942f-cc066673103a" (UID: "f2d716f8-107e-42c5-942f-cc066673103a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:27:15.000063 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:14.999986    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2d716f8-107e-42c5-942f-cc066673103a" (UID: "f2d716f8-107e-42c5-942f-cc066673103a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:15.001970 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.001942    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2d716f8-107e-42c5-942f-cc066673103a" (UID: "f2d716f8-107e-42c5-942f-cc066673103a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:15.002100 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.001975    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2d716f8-107e-42c5-942f-cc066673103a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2d716f8-107e-42c5-942f-cc066673103a" (UID: "f2d716f8-107e-42c5-942f-cc066673103a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:27:15.002100 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.002027    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-kube-api-access-v8zv2" (OuterVolumeSpecName: "kube-api-access-v8zv2") pod "f2d716f8-107e-42c5-942f-cc066673103a" (UID: "f2d716f8-107e-42c5-942f-cc066673103a"). InnerVolumeSpecName "kube-api-access-v8zv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:15.002215 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.002111    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2d716f8-107e-42c5-942f-cc066673103a" (UID: "f2d716f8-107e-42c5-942f-cc066673103a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:15.100194 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.100162    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-istio-token\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:27:15.100194 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.100187    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-data\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:27:15.100194 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.100195    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2d716f8-107e-42c5-942f-cc066673103a-istio-podinfo\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:27:15.100194 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.100203    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-istio-envoy\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:27:15.100461 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.100211    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2d716f8-107e-42c5-942f-cc066673103a-istiod-ca-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:27:15.100461 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.100219    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2d716f8-107e-42c5-942f-cc066673103a-workload-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:27:15.100461 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.100226    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8zv2\" (UniqueName: \"kubernetes.io/projected/f2d716f8-107e-42c5-942f-cc066673103a-kube-api-access-v8zv2\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\""
Jul 09 19:27:15.364387 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.364352    2581 generic.go:356] "Generic (PLEG): container finished" podID="f2d716f8-107e-42c5-942f-cc066673103a" containerID="7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21" exitCode=0
Jul 09 19:27:15.364617 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.364406    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"
Jul 09 19:27:15.364617 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.364438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" event={"ID":"f2d716f8-107e-42c5-942f-cc066673103a","Type":"ContainerDied","Data":"7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21"}
Jul 09 19:27:15.364617 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.364532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp" event={"ID":"f2d716f8-107e-42c5-942f-cc066673103a","Type":"ContainerDied","Data":"a93498d170f2ca682c7e756f10ba088a585ca9240c7f0ab736493d882f32f174"}
Jul 09 19:27:15.364617 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.364580    2581 scope.go:117] "RemoveContainer" containerID="7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21"
Jul 09 19:27:15.373988 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.373965    2581 scope.go:117] "RemoveContainer" containerID="7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21"
Jul 09 19:27:15.374302 ip-10-0-139-1 kubenswrapper[2581]: E0709 19:27:15.374283    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21\": container with ID starting with 7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21 not found: ID does not exist" containerID="7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21"
Jul 09 19:27:15.374363 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.374311    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21"} err="failed to get container status \"7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21\": rpc error: code = NotFound desc = could not find container \"7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21\": container with ID starting with 7b4d50118154032f83601246990ae7b562c7c2a823bebf4381de7cf0bf95bc21 not found: ID does not exist"
Jul 09 19:27:15.387871 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.387840    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"]
Jul 09 19:27:15.393130 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:15.393096    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-6e8c75-openshift-default-55df4df84c-jsmlp"]
Jul 09 19:27:16.737801 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:16.737763    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2d716f8-107e-42c5-942f-cc066673103a" path="/var/lib/kubelet/pods/f2d716f8-107e-42c5-942f-cc066673103a/volumes"
Jul 09 19:27:19.087769 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:19.087739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wjxgm"]
Jul 09 19:27:24.438557 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:24.438497    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5_4120eb56-8eb8-4797-95cd-47d1244e2e3b/manager/0.log"
Jul 09 19:27:24.447416 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:24.447390    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5_4120eb56-8eb8-4797-95cd-47d1244e2e3b/copy-manifests/0.log"
Jul 09 19:27:25.808179 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:25.808139    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk_ff0b2514-3df0-4109-9810-ebd9a0478e7a/util/0.log"
Jul 09 19:27:25.815869 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:25.815819    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk_ff0b2514-3df0-4109-9810-ebd9a0478e7a/pull/0.log"
Jul 09 19:27:25.823451 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:25.823434    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk_ff0b2514-3df0-4109-9810-ebd9a0478e7a/extract/0.log"
Jul 09 19:27:25.942223 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:25.942193    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx_141bb1ac-1580-4ca6-8604-7b9c23f496ee/util/0.log"
Jul 09 19:27:25.953761 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:25.953739    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx_141bb1ac-1580-4ca6-8604-7b9c23f496ee/pull/0.log"
Jul 09 19:27:25.962629 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:25.962607    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx_141bb1ac-1580-4ca6-8604-7b9c23f496ee/extract/0.log"
Jul 09 19:27:26.081247 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:26.081169    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk_fe4fa3e5-a453-4f97-a71b-57968f947297/util/0.log"
Jul 09 19:27:26.089205 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:26.089179    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk_fe4fa3e5-a453-4f97-a71b-57968f947297/pull/0.log"
Jul 09 19:27:26.097527 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:26.097503    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk_fe4fa3e5-a453-4f97-a71b-57968f947297/extract/0.log"
Jul 09 19:27:26.218396 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:26.218368    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d_f9869c79-0709-4589-a4b3-62b4baa3743d/util/0.log"
Jul 09 19:27:26.226656 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:26.226633    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d_f9869c79-0709-4589-a4b3-62b4baa3743d/pull/0.log"
Jul 09 19:27:26.235092 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:26.235073    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d_f9869c79-0709-4589-a4b3-62b4baa3743d/extract/0.log"
Jul 09 19:27:27.078060 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:27.078029    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wjxgm_8030d374-40ff-459b-a5e8-6135032302c0/limitador/0.log"
Jul 09 19:27:27.555654 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:27.555621    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678pxr2p_b13886bf-a723-41e3-b19f-980aa456be4b/istio-proxy/0.log"
Jul 09 19:27:27.677354 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:27.677325    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-99tz8_787ee0f8-852f-4348-915c-893015003d53/discovery/0.log"
Jul 09 19:27:28.389642 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:28.389612    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dd6d8cb96-bbfgl_ad4227bf-dec9-4ad3-87f0-a369b054e449/router/0.log"
Jul 09 19:27:29.107172 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:29.107131    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9hfsr_f166b419-bc01-44a1-8624-7b140272342c/main/0.log"
Jul 09 19:27:36.774361 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:36.774335    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g8kxr_b45dd2b4-b722-4fbb-bdbd-ffbba1c194dd/global-pull-secret-syncer/0.log"
Jul 09 19:27:36.942465 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:36.942419    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vvq6l_5561e5bc-2db6-45b2-ba6f-02f141a62cd8/konnectivity-agent/0.log"
Jul 09 19:27:37.017326 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:37.017303    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-1.ec2.internal_b500d70da3cf2cd4e34be1f2b83e6615/haproxy/0.log"
Jul 09 19:27:41.160872 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.160839    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk_ff0b2514-3df0-4109-9810-ebd9a0478e7a/extract/0.log"
Jul 09 19:27:41.189617 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.189584    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk_ff0b2514-3df0-4109-9810-ebd9a0478e7a/util/0.log"
Jul 09 19:27:41.215229 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.215204    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zhfbk_ff0b2514-3df0-4109-9810-ebd9a0478e7a/pull/0.log"
Jul 09 19:27:41.254519 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.254493    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx_141bb1ac-1580-4ca6-8604-7b9c23f496ee/extract/0.log"
Jul 09 19:27:41.279708 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.279681    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx_141bb1ac-1580-4ca6-8604-7b9c23f496ee/util/0.log"
Jul 09 19:27:41.306949 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.306917    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06zqnx_141bb1ac-1580-4ca6-8604-7b9c23f496ee/pull/0.log"
Jul 09 19:27:41.338083 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.338055    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk_fe4fa3e5-a453-4f97-a71b-57968f947297/extract/0.log"
Jul 09 19:27:41.361063 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.361035    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk_fe4fa3e5-a453-4f97-a71b-57968f947297/util/0.log"
Jul 09 19:27:41.390880 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.390858    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9ggk_fe4fa3e5-a453-4f97-a71b-57968f947297/pull/0.log"
Jul 09 19:27:41.413498 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.413423    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d_f9869c79-0709-4589-a4b3-62b4baa3743d/extract/0.log"
Jul 09 19:27:41.440680 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.440653    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d_f9869c79-0709-4589-a4b3-62b4baa3743d/util/0.log"
Jul 09 19:27:41.466358 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:41.466333    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j852d_f9869c79-0709-4589-a4b3-62b4baa3743d/pull/0.log"
Jul 09 19:27:42.109990 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:42.109961    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wjxgm_8030d374-40ff-459b-a5e8-6135032302c0/limitador/0.log"
Jul 09 19:27:43.883313 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:43.883280    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-br5dg_e5fe7c21-4264-4cd4-a06c-65ea61b3994f/cluster-monitoring-operator/0.log"
Jul 09 19:27:44.272952 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:44.272871    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pdjks_d44b442c-798a-49b5-8ad8-bc2b250be17b/node-exporter/0.log"
Jul 09 19:27:44.298171 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:44.298142    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pdjks_d44b442c-798a-49b5-8ad8-bc2b250be17b/kube-rbac-proxy/0.log"
Jul 09 19:27:44.324717 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:44.324694    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pdjks_d44b442c-798a-49b5-8ad8-bc2b250be17b/init-textfile/0.log"
Jul 09 19:27:46.182250 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.182222    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-h6f6v_0af19108-65d5-4eda-ae6a-6db2614bdf1b/networking-console-plugin/0.log"
Jul 09 19:27:46.548867 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.548786    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"]
Jul 09 19:27:46.549085 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.549072    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" containerName="main"
Jul 09 19:27:46.549175 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.549086    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" containerName="main"
Jul 09 19:27:46.549175 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.549101    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy"
Jul 09 19:27:46.549175 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.549106    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy"
Jul 09 19:27:46.549175 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.549113    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy"
Jul 09 19:27:46.549175 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.549118    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy"
Jul 09 19:27:46.549175 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.549169    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy"
Jul 09 19:27:46.549356 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.549178    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d716f8-107e-42c5-942f-cc066673103a" containerName="istio-proxy"
Jul 09 19:27:46.549356 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.549185    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed5bb7a8-bed0-4cc9-a3f4-97c2a38d7776" containerName="main"
Jul 09 19:27:46.552381 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.552356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.555148 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.555127    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qgfk6\"/\"default-dockercfg-2s96h\""
Jul 09 19:27:46.555267 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.555127    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qgfk6\"/\"openshift-service-ca.crt\""
Jul 09 19:27:46.556321 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.556305    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qgfk6\"/\"kube-root-ca.crt\""
Jul 09 19:27:46.564176 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.564148    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"]
Jul 09 19:27:46.666746 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.666707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57sjj\" (UniqueName: \"kubernetes.io/projected/e435111a-3e59-48ec-9e01-f3894ac6306c-kube-api-access-57sjj\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.666746 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.666748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-podres\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.666960 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.666799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-proc\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.666960 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.666822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-lib-modules\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.666960 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.666889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-sys\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.767460 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.767428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-proc\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.767460 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.767460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-lib-modules\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.767685 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.767578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-proc\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.767685 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.767617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-sys\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.767685 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.767671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57sjj\" (UniqueName: \"kubernetes.io/projected/e435111a-3e59-48ec-9e01-f3894ac6306c-kube-api-access-57sjj\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.767797 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.767693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-lib-modules\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.767797 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.767693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-podres\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.767797 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.767743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-sys\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.767797 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.767775    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e435111a-3e59-48ec-9e01-f3894ac6306c-podres\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.777575 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.777547    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57sjj\" (UniqueName: \"kubernetes.io/projected/e435111a-3e59-48ec-9e01-f3894ac6306c-kube-api-access-57sjj\") pod \"perf-node-gather-daemonset-p7hnk\" (UID: \"e435111a-3e59-48ec-9e01-f3894ac6306c\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:46.863029 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:46.863000    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:47.006633 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:47.006606    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"]
Jul 09 19:27:47.008469 ip-10-0-139-1 kubenswrapper[2581]: W0709 19:27:47.008444    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode435111a_3e59_48ec_9e01_f3894ac6306c.slice/crio-2bc4100f26c7a4f9c5007ad7e8966da0bc53ffca018017bb4fa14d0cefdf7a7b WatchSource:0}: Error finding container 2bc4100f26c7a4f9c5007ad7e8966da0bc53ffca018017bb4fa14d0cefdf7a7b: Status 404 returned error can't find the container with id 2bc4100f26c7a4f9c5007ad7e8966da0bc53ffca018017bb4fa14d0cefdf7a7b
Jul 09 19:27:47.463431 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:47.463347    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79f7ffff56-4kvmd_e2b5848a-6916-4374-b817-0d233e2cca9d/console/0.log"
Jul 09 19:27:47.513601 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:47.513570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk" event={"ID":"e435111a-3e59-48ec-9e01-f3894ac6306c","Type":"ContainerStarted","Data":"8e2f0c8e8357942d9dfdb29b926569f4eeb50de64774453bf705778f228a24a6"}
Jul 09 19:27:47.513773 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:47.513619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk" event={"ID":"e435111a-3e59-48ec-9e01-f3894ac6306c","Type":"ContainerStarted","Data":"2bc4100f26c7a4f9c5007ad7e8966da0bc53ffca018017bb4fa14d0cefdf7a7b"}
Jul 09 19:27:47.513773 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:47.513669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:47.535133 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:47.535084    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk" podStartSLOduration=1.535070396 podStartE2EDuration="1.535070396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:27:47.53399307 +0000 UTC m=+2553.328117119" watchObservedRunningTime="2026-07-09 19:27:47.535070396 +0000 UTC m=+2553.329194424"
Jul 09 19:27:49.254302 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:49.254277    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xtq28_482b4db1-4b68-44ec-8b1d-eb5a8d720d43/dns/0.log"
Jul 09 19:27:49.288978 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:49.288952    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xtq28_482b4db1-4b68-44ec-8b1d-eb5a8d720d43/kube-rbac-proxy/0.log"
Jul 09 19:27:49.352839 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:49.352813    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-htlst_76039738-c73a-4be3-95a1-2f46e01435ad/dns-node-resolver/0.log"
Jul 09 19:27:50.050597 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:50.050567    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zrgtd_cbe257a6-701c-4e95-8bd5-327628080f1f/node-ca/0.log"
Jul 09 19:27:51.017354 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:51.017320    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678pxr2p_b13886bf-a723-41e3-b19f-980aa456be4b/istio-proxy/0.log"
Jul 09 19:27:51.138678 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:51.138640    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-99tz8_787ee0f8-852f-4348-915c-893015003d53/discovery/0.log"
Jul 09 19:27:51.388252 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:51.388224    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dd6d8cb96-bbfgl_ad4227bf-dec9-4ad3-87f0-a369b054e449/router/0.log"
Jul 09 19:27:52.097197 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:52.097173    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kfsz9_5c237efc-5b7f-4eb1-b3e1-0e842ca51fdd/serve-healthcheck-canary/0.log"
Jul 09 19:27:52.823818 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:52.823789    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2bcx_edc1e2a7-b34b-4aa0-9258-4bad9d88d777/kube-rbac-proxy/0.log"
Jul 09 19:27:52.848597 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:52.848561    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2bcx_edc1e2a7-b34b-4aa0-9258-4bad9d88d777/exporter/0.log"
Jul 09 19:27:52.872749 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:52.872725    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2bcx_edc1e2a7-b34b-4aa0-9258-4bad9d88d777/extractor/0.log"
Jul 09 19:27:53.528045 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:53.528017    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-p7hnk"
Jul 09 19:27:55.534529 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:55.534501    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5_4120eb56-8eb8-4797-95cd-47d1244e2e3b/manager/0.log"
Jul 09 19:27:55.558115 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:55.558089    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c9d9c8f47-6w2n5_4120eb56-8eb8-4797-95cd-47d1244e2e3b/copy-manifests/0.log"
Jul 09 19:27:56.474358 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:56.474327    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678pxr2p_b13886bf-a723-41e3-b19f-980aa456be4b/istio-proxy/0.log"
Jul 09 19:27:56.587963 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:56.587938    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-99tz8_787ee0f8-852f-4348-915c-893015003d53/discovery/0.log"
Jul 09 19:27:56.785901 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:56.785831    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dd6d8cb96-bbfgl_ad4227bf-dec9-4ad3-87f0-a369b054e449/router/0.log"
Jul 09 19:27:57.029501 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:57.029472    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f9b9fdbf7-jdzxc_6e6c9bea-e69c-41b3-944d-85561765bfa1/manager/0.log"
Jul 09 19:27:57.059588 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:57.059495    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9whnn_61cc0a7b-49b7-4878-8c8b-a2dd738cad26/openshift-lws-operator/0.log"
Jul 09 19:27:58.118654 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:58.118620    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678pxr2p_b13886bf-a723-41e3-b19f-980aa456be4b/istio-proxy/0.log"
Jul 09 19:27:58.223281 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:58.223250    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-99tz8_787ee0f8-852f-4348-915c-893015003d53/discovery/0.log"
Jul 09 19:27:58.433037 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:27:58.433006    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dd6d8cb96-bbfgl_ad4227bf-dec9-4ad3-87f0-a369b054e449/router/0.log"
Jul 09 19:28:04.272106 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:28:04.272079    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2cjm_a9158700-77bf-4a4c-bcd0-7b4044d2cafc/kube-multus-additional-cni-plugins/0.log"
Jul 09 19:28:04.297461 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:28:04.297431    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2cjm_a9158700-77bf-4a4c-bcd0-7b4044d2cafc/egress-router-binary-copy/0.log"
Jul 09 19:28:04.320258 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:28:04.320237    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2cjm_a9158700-77bf-4a4c-bcd0-7b4044d2cafc/cni-plugins/0.log"
Jul 09 19:28:04.342514 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:28:04.342492    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2cjm_a9158700-77bf-4a4c-bcd0-7b4044d2cafc/bond-cni-plugin/0.log"
Jul 09 19:28:04.369451 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:28:04.369429    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2cjm_a9158700-77bf-4a4c-bcd0-7b4044d2cafc/routeoverride-cni/0.log"
Jul 09 19:28:04.392808 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:28:04.392792    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2cjm_a9158700-77bf-4a4c-bcd0-7b4044d2cafc/whereabouts-cni-bincopy/0.log"
Jul 09 19:28:04.417506 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:28:04.417484    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2cjm_a9158700-77bf-4a4c-bcd0-7b4044d2cafc/whereabouts-cni/0.log"
Jul 09 19:28:04.517496 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:28:04.517467    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t8wc8_4091e474-68c7-4a0e-9c55-7bd741bd65cc/kube-multus/0.log"
Jul 09 19:28:04.646379 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:28:04.646351    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m2z8q_735851e3-381c-495a-a69b-ab40850b0010/network-metrics-daemon/0.log"
Jul 09 19:28:04.670311 ip-10-0-139-1 kubenswrapper[2581]: I0709 19:28:04.670289    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m2z8q_735851e3-381c-495a-a69b-ab40850b0010/kube-rbac-proxy/0.log"