Jul 07 14:24:27.871304 ip-10-0-141-139 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.224518    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231216    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231236    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231242    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231246    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231253    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231257    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231262    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:28.302045 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231265    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:28.294608 ip-10-0-141-139 systemd[1]: Started Kubernetes Kubelet.
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231268    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231271    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231276    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231279    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231283    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231287    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231291    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231295    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231299    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231303    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231307    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231313    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231320    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231325    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231333    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231337    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231342    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:28.305414 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231346    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231350    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231355    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231360    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231364    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231375    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231380    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231385    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231389    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231393    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231397    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231401    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231404    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231409    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231413    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231417    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231421    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231425    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231429    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231433    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:28.306682 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231436    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231440    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231444    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231448    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231452    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231459    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231464    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231468    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231472    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231476    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231479    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231482    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231486    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231490    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231494    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231498    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231503    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231508    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231511    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:28.313922 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231515    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231519    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231523    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231532    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231535    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231540    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231543    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231548    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231553    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231557    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231562    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231572    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231576    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231580    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231584    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231588    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231592    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231596    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231600    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231604    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:28.315344 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231607    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231612    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231616    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231620    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231624    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231628    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231632    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231636    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231639    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231643    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231647    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231650    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231654    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231658    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.231662    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232682    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232692    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232697    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232700    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232704    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:28.316261 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232707    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232710    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232715    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232719    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232722    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232725    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232728    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232731    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232735    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232739    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232741    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232744    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232747    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232750    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232752    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232755    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232757    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232760    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232763    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:28.317427 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232765    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232768    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232770    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232773    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232775    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232778    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232781    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232783    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232786    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232788    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232790    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232811    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232817    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232820    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232824    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232827    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232830    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232832    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232835    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:28.318622 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232838    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232840    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232842    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232845    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232848    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232853    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232855    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232858    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232860    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232863    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232866    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232868    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232871    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232873    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232876    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232879    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232882    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232884    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232887    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232890    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:28.319942 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232892    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232895    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232899    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232901    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232904    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232907    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232909    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232912    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232916    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232918    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232921    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232924    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232926    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232929    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232931    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232934    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232937    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232940    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232943    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232945    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:28.320833 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232948    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232951    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232954    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232978    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232981    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232985    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232987    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232990    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232993    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232995    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.232998    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233001    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233004    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233007    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233009    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233012    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233440    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233446    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233450    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233453    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:28.321706 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233456    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233459    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233463    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233466    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233469    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233472    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233474    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233477    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233480    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233483    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233486    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233489    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233491    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233494    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233497    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233499    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233502    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233504    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233507    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:28.322331 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233509    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233513    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233516    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233519    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233521    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233527    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233530    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233533    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233536    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233538    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233541    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233543    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233546    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233549    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233552    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233555    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233557    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233560    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233563    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233565    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:28.323589 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233568    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233572    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233575    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233578    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233581    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233584    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233587    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233590    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233593    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233595    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233598    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233600    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233603    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233605    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233608    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233611    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233615    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233620    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:28.324216 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233623    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233626    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233629    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233632    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233635    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233637    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233640    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233642    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233645    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233648    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233650    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233653    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233655    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233657    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233660    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233662    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233665    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233667    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233670    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233673    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:28.324832 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233675    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233677    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233680    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233686    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233689    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233691    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233694    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233696    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233699    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233701    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233704    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233708    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233711    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233713    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233716    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233720    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233723    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.233726    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233797    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233804    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 14:24:28.325455 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233811    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233816    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233820    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233824    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233828    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233832    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233836    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233839    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233842    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233845    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233848    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233851    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233854    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233857    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233860    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233865    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233869    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233872    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233875    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233878    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233882    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233886    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233889    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 14:24:28.326075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233894    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233897    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233900    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233904    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233907    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233910    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233913    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233917    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233920    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233923    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233926    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233929    2583 flags.go:64] FLAG: --enable-server="true"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233933    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233938    2583 flags.go:64] FLAG: --event-burst="100"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233941    2583 flags.go:64] FLAG: --event-qps="50"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233944    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233948    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233950    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233955    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233971    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233974    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233978    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233981    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233984    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233988    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 14:24:28.326942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233991    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233994    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.233997    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234000    2583 flags.go:64] FLAG: --feature-gates=""
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234004    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234007    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234010    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234016    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234019    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234022    2583 flags.go:64] FLAG: --help="false"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234024    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234027    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234030    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234033    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234037    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234040    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234043    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234046    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234049    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234052    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234056    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234059    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234062    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234064    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 14:24:28.328235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234067    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234070    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234073    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234076    2583 flags.go:64] FLAG: --lock-file=""
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234078    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234081    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234084    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234091    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234093    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234096    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234099    2583 flags.go:64] FLAG: --logging-format="text"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234102    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234105    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234108    2583 flags.go:64] FLAG: --manifest-url=""
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234111    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234117    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234120    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234124    2583 flags.go:64] FLAG: --max-pods="110"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234127    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234130    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234133    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234136    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234139    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234142    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234145    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 14:24:28.329085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234152    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234155    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234158    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234161    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234165    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234171    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234174    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234177    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234180    2583 flags.go:64] FLAG: --port="10250"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234184    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234187    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-014694429db71646a"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234190    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234193    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234196    2583 flags.go:64] FLAG: --register-node="true"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234199    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234204    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234207    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234210    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234213    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234216    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234232    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234237    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234242    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234245    2583 flags.go:64] FLAG: --runonce="false"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234248    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 14:24:28.329796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234252    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234254    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234257    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234260    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234263    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234266    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234269    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234272    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234275    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234278    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234281    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234284    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234287    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234290    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234295    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234298    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234301    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234305    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234307    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234322    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234326    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234329    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234333    2583 flags.go:64] FLAG: --v="2"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234338    2583 flags.go:64] FLAG: --version="false"
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234342    2583 flags.go:64] FLAG: --vmodule=""
Jul 07 14:24:28.330555 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234346    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.234349    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234481    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234486    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234491    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234495    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234498    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234501    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234503    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234506    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234509    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234511    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234514    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234517    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234520    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234522    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234525    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234527    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234530    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234533    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:28.534061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234536    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234538    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234541    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234543    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234546    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234548    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234551    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234553    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234555    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234560    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234562    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234565    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234567    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234570    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234573    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234575    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234579    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234582    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234584    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:28.563697 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234587    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234590    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234592    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234595    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234597    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234600    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234602    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234605    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234607    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234609    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234612    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234614    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234617    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234619    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234623    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234626    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234629    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234632    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234634    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:28.564636 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234637    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234640    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234642    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234646    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234649    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234651    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234654    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234656    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234659    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234662    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234666    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234668    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234671    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234674    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234676    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234679    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234681    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234684    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234686    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234689    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:28.565468 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234692    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234694    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234697    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234699    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234702    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234704    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234707    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234709    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234712    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234715    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234718    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234722    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234725    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234728    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234731    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234735    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234738    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234740    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234743    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234746    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:28.566186 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234748    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234751    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.234755    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.235567    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.242298    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.242324    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.242347    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.242353    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242412    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242417    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242421    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242424    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242427    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242429    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242432    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:28.566928 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242435    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242439    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242442    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242445    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242448    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242451    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242453    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242456    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242459    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242461    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242465    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242469    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242472    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242476    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242478    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242481    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242484    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242487    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242489    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242492    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:28.567551 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242495    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242498    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242501    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242504    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242507    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242509    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242512    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242514    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242517    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242519    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242522    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242524    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242527    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242529    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242532    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242535    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242537    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242539    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242543    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:28.569012 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242547    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242550    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242552    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242555    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242557    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242560    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242563    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242565    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242568    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242570    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242573    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242575    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242577    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242580    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242583    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242586    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242589    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242592    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242596    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:28.569709 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242599    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242602    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242605    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242607    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242610    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242612    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242615    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242617    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242620    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242623    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242626    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242629    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242631    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242634    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242637    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242639    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242642    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242644    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242647    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242649    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:28.570618 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242652    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242654    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242657    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242659    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242662    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242664    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242667    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242670    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242672    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242675    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242678    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242681    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242683    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242686    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.242691    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:24:28.571460 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242809    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242816    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242819    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242821    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242824    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242827    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242830    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242832    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242834    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242837    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242840    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242842    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242845    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242847    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242850    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242852    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242855    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242858    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242862    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:28.776796 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242865    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242868    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242871    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242873    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242876    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242884    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242888    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242892    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242896    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242899    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242904    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242907    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242910    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242912    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242915    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242917    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242920    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242923    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242925    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:28.778421 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242928    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242931    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242933    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242936    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242938    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242940    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242943    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242946    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242948    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242951    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242954    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242972    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242975    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242978    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242981    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242984    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242988    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242992    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242996    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:28.779131 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.242999    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243002    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243005    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243007    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243012    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243015    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243018    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243021    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243023    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243026    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243028    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243031    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243033    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243036    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243038    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243041    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243044    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243046    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243049    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243052    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:28.779726 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243054    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243057    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243059    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243062    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243064    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243067    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243069    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243072    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243074    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243077    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243079    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243083    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243086    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243088    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243091    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243093    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243097    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243101    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243103    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243106    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:28.780453 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243108    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:28.243112    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.243117    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.243254    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.245464    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.246667    2583 server.go:1019] "Starting client certificate rotation"
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.246770    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.246811    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.249162    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.250863    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.264546    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.266592    2583 log.go:25] "Validated CRI v1 image API"
Jul 07 14:24:28.781095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.267362    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 14:24:28.781520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.270278    2583 fs.go:135] Filesystem UUIDs: map[3fee4f9d-a67b-46a1-8bc0-4971be5e55ae:/dev/nvme0n1p3 5abf7480-6961-45a0-8892-684b1b43f181:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 07 14:24:28.781520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.270292    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.274567    2583 manager.go:216] Machine: {Timestamp:2026-07-07 14:24:28.274083683 +0000 UTC m=+0.301591781 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093286 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec272fd8f9570304df6be2099fc8037f SystemUUID:ec272fd8-f957-0304-df6b-e2099fc8037f BootID:75042bd4-1bd7-48bd-9680-d7bd5a73d2a3 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8a:9a:2d:b8:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8a:9a:2d:b8:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:47:bc:87:68:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.274671    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.274753    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.276795    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.276821    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.277980    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.277992    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.278000    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.278594    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.279823    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.283872    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.284013    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.284042    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.284054    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.284068    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.284080    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.284090    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 14:24:28.781898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.284513    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.284535    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.284633    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.286483    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.288587    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.288616    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289677    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289691    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289697    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289702    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289711    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289717    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289725    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289730    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289736    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289743    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289756    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.289762    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.290417    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.290424    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.293660    2583 server.go:1268] "Started kubelet"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.293712    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.293749    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.293825    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.297219    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.298832    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.299456    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.299715    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.299772    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.304292    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.304367    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.307214    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.307295    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.307307    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.307380    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.307446    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.307453    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.307598    2583 factory.go:55] Registering systemd factory
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.307619    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.308035    2583 factory.go:153] Registering CRI-O factory
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.308046    2583 factory.go:223] Registration of the crio container factory successfully
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.308095    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.308119    2583 factory.go:103] Registering Raw factory
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.308134    2583 manager.go:1196] Started watching for new ooms in manager
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.309129    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 14:24:28.782675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.309293    2583 manager.go:349] Starting recovery of all containers
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.310739    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.310794    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.311329    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hgt5l"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.310884    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-139.ec2.internal.18c0080499e6887f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-139.ec2.internal,UID:ip-10-0-141-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-139.ec2.internal,},FirstTimestamp:2026-07-07 14:24:28.293630079 +0000 UTC m=+0.321138225,LastTimestamp:2026-07-07 14:24:28.293630079 +0000 UTC m=+0.321138225,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-139.ec2.internal,}"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.319459    2583 manager.go:354] Recovery completed
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.322177    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hgt5l"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.323858    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.327999    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.328022    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.328031    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.328665    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.328675    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.328689    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.329157    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.330047    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.330075    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.330089    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.330603    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-139.ec2.internal.18c008049bf3261a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-139.ec2.internal,UID:ip-10-0-141-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-139.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-139.ec2.internal,},FirstTimestamp:2026-07-07 14:24:28.32801129 +0000 UTC m=+0.355519389,LastTimestamp:2026-07-07 14:24:28.32801129 +0000 UTC m=+0.355519389,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-139.ec2.internal,}"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.330848    2583 policy_none.go:49] "None policy: Start"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.330862    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.330875    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.332907    2583 policy_none.go:47] "Start"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.375726    2583 manager.go:337] "Starting Device Plugin manager"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.375762    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.375772    2583 server.go:87] "Starting device plugin registration server"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.376021    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.376055    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.376399    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.376473    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.376481    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.377112    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 14:24:28.784087 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.377359    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.460325    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.461719    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.461773    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.461803    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.461853    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.464336    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.476807    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.477836    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.477870    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.477882    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.477910    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.487229    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.487256    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-139.ec2.internal\": node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.505150    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.562276    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal"]
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.562377    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.564460    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.564499    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.564515    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.566929    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.567084    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.567112    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.567755    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.567772    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.567789    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.567799    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.567816    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.567802    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.570244    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.570277    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.571038    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.571071    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.571095    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.602233    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-139.ec2.internal\" not found" node="ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.605248    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.607351    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-139.ec2.internal\" not found" node="ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.785167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.609140    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5bea2a7ea053e86fd5618f8d006eb10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal\" (UID: \"b5bea2a7ea053e86fd5618f8d006eb10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.786345 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.609171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5bea2a7ea053e86fd5618f8d006eb10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal\" (UID: \"b5bea2a7ea053e86fd5618f8d006eb10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.786345 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.609201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d0582c3b390fb22f9648ea732036658-config\") pod \"kube-apiserver-proxy-ip-10-0-141-139.ec2.internal\" (UID: \"5d0582c3b390fb22f9648ea732036658\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.786345 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.709774    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:28.786345 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.709859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d0582c3b390fb22f9648ea732036658-config\") pod \"kube-apiserver-proxy-ip-10-0-141-139.ec2.internal\" (UID: \"5d0582c3b390fb22f9648ea732036658\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.786345 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.709893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5bea2a7ea053e86fd5618f8d006eb10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal\" (UID: \"b5bea2a7ea053e86fd5618f8d006eb10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.786345 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.709912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5bea2a7ea053e86fd5618f8d006eb10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal\" (UID: \"b5bea2a7ea053e86fd5618f8d006eb10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.786345 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.709985    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5bea2a7ea053e86fd5618f8d006eb10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal\" (UID: \"b5bea2a7ea053e86fd5618f8d006eb10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.786345 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.709999    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5bea2a7ea053e86fd5618f8d006eb10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal\" (UID: \"b5bea2a7ea053e86fd5618f8d006eb10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.786345 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.710047    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d0582c3b390fb22f9648ea732036658-config\") pod \"kube-apiserver-proxy-ip-10-0-141-139.ec2.internal\" (UID: \"5d0582c3b390fb22f9648ea732036658\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.985466 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.812843    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:28.985466 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.912692    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.985466 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:28.912768    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:28.985466 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:28.913992    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:29.193902 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:29.014146    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:29.193902 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:29.114954    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:29.380793 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:29.215183    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:29.380793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.247831    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 14:24:29.380793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.248054    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 14:24:29.380793 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:29.316749    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:29.380793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.325047    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:19:28 +0000 UTC" deadline="2027-12-02 07:24:02.342660614 +0000 UTC"
Jul 07 14:24:29.380793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.325079    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12304h59m33.017584701s"
Jul 07 14:24:29.510619 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:29.417136    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-139.ec2.internal\" not found"
Jul 07 14:24:29.510619 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.490667    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:29.512806 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.512663    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:29.693108 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.518848    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:29.693108 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.527012    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 14:24:29.693108 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.527852    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal"
Jul 07 14:24:29.693108 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.540638    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 14:24:29.693108 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:29.625855    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0582c3b390fb22f9648ea732036658.slice/crio-5b52540eb62446ec87dda60df88c34decc31679806bf952ab3ac4a2dbce905c4 WatchSource:0}: Error finding container 5b52540eb62446ec87dda60df88c34decc31679806bf952ab3ac4a2dbce905c4: Status 404 returned error can't find the container with id 5b52540eb62446ec87dda60df88c34decc31679806bf952ab3ac4a2dbce905c4
Jul 07 14:24:29.693108 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:29.626226    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bea2a7ea053e86fd5618f8d006eb10.slice/crio-a0ef282e734a70d3482cdb9eb8a20fa12e268eb193d73f933510539bb61db9a8 WatchSource:0}: Error finding container a0ef282e734a70d3482cdb9eb8a20fa12e268eb193d73f933510539bb61db9a8: Status 404 returned error can't find the container with id a0ef282e734a70d3482cdb9eb8a20fa12e268eb193d73f933510539bb61db9a8
Jul 07 14:24:29.693108 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.633237    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:24:29.918751 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:29.861673    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:30.297994 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.285051    2583 apiserver.go:52] "Watching apiserver"
Jul 07 14:24:30.297994 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.292735    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 14:24:30.297994 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.293200    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal","openshift-multus/multus-additional-cni-plugins-8chjr","openshift-network-diagnostics/network-check-target-vlzfg","kube-system/global-pull-secret-syncer-hwrbj","openshift-cluster-node-tuning-operator/tuned-mpmqh","openshift-dns/node-resolver-kz2tg","openshift-image-registry/node-ca-7hjnz","openshift-multus/multus-xjtt9","openshift-multus/network-metrics-daemon-hh5cg","openshift-network-operator/iptables-alerter-f65s9","openshift-ovn-kubernetes/ovnkube-node-7z9z2","kube-system/konnectivity-agent-j9b2b"]
Jul 07 14:24:30.297994 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.296119    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.300280 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.298767    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.303144    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.304681    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.304703    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9l67r\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.305439    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.305640    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.306349    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zx7p5\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.306413    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.306487    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.306505    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.306513    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.306606    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.306651    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.306752    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.306756    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.306759    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7czgm\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.307172    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.308371    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.308675    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.309019    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.309298    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.309648    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.309980    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xksww\""
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.311228    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.311307    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.312392    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.312470    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:30.377974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.316008    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.433944 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.433902    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-systemd\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.433961    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-run\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.433996    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/783ae988-c52f-431e-bdbe-bbd637aa6cba-ovn-node-metrics-cert\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434029    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce806fe6-2831-4f5b-b098-0ca02394d02b-serviceca\") pod \"node-ca-7hjnz\" (UID: \"ce806fe6-2831-4f5b-b098-0ca02394d02b\") " pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-sysconfig\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-slash\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434143    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-var-lib-openvswitch\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-etc-openvswitch\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434205    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-os-release\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434236    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-tuned\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-systemd-units\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-run-systemd\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434334    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-run-openvswitch\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434364    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b370c905-2d81-4dcf-87a1-24cc322046db-konnectivity-ca\") pod \"konnectivity-agent-j9b2b\" (UID: \"b370c905-2d81-4dcf-87a1-24cc322046db\") " pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-system-cni-dir\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434428    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b62ed01-d6a2-41a9-8725-5da7f402e07c-kubelet-config\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:30.434745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81a0adae-7087-46ed-ab48-0fa69eaf7ba0-hosts-file\") pod \"node-resolver-kz2tg\" (UID: \"81a0adae-7087-46ed-ab48-0fa69eaf7ba0\") " pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-lib-modules\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phpzw\" (UniqueName: \"kubernetes.io/projected/2a71b229-1fae-4b8a-aba1-31c039cce5f7-kube-api-access-phpzw\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-cni-bin\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434662    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-modprobe-d\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434706    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-var-lib-kubelet\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-run-ovn\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434766    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-log-socket\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434800    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmcmp\" (UniqueName: \"kubernetes.io/projected/783ae988-c52f-431e-bdbe-bbd637aa6cba-kube-api-access-cmcmp\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b62ed01-d6a2-41a9-8725-5da7f402e07c-dbus\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434875    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-sysctl-conf\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434904    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b370c905-2d81-4dcf-87a1-24cc322046db-agent-certs\") pod \"konnectivity-agent-j9b2b\" (UID: \"b370c905-2d81-4dcf-87a1-24cc322046db\") " pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434939    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b9a4b09-d6c8-4340-873a-db98e632588c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.434975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435013    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81a0adae-7087-46ed-ab48-0fa69eaf7ba0-tmp-dir\") pod \"node-resolver-kz2tg\" (UID: \"81a0adae-7087-46ed-ab48-0fa69eaf7ba0\") " pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.435622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435063    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-sysctl-d\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-node-log\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b9a4b09-d6c8-4340-873a-db98e632588c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btfhr\" (UniqueName: \"kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr\") pod \"network-check-target-vlzfg\" (UID: \"12ffe0f4-f24b-4751-abd8-6996416bb666\") " pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-sys\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435228    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-cni-netd\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/783ae988-c52f-431e-bdbe-bbd637aa6cba-ovnkube-config\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435323    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-run-netns\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435355    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/783ae988-c52f-431e-bdbe-bbd637aa6cba-env-overrides\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgm4b\" (UniqueName: \"kubernetes.io/projected/4b9a4b09-d6c8-4340-873a-db98e632588c-kube-api-access-pgm4b\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435425    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce806fe6-2831-4f5b-b098-0ca02394d02b-host\") pod \"node-ca-7hjnz\" (UID: \"ce806fe6-2831-4f5b-b098-0ca02394d02b\") " pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b9a4b09-d6c8-4340-873a-db98e632588c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-646d2\" (UniqueName: \"kubernetes.io/projected/ce806fe6-2831-4f5b-b098-0ca02394d02b-kube-api-access-646d2\") pod \"node-ca-7hjnz\" (UID: \"ce806fe6-2831-4f5b-b098-0ca02394d02b\") " pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-kubernetes\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a71b229-1fae-4b8a-aba1-31c039cce5f7-tmp\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.436423 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-kubelet\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.437171 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-cnibin\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.437171 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435665    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj5hr\" (UniqueName: \"kubernetes.io/projected/81a0adae-7087-46ed-ab48-0fa69eaf7ba0-kube-api-access-sj5hr\") pod \"node-resolver-kz2tg\" (UID: \"81a0adae-7087-46ed-ab48-0fa69eaf7ba0\") " pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.437171 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-host\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.437171 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435734    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-run-ovn-kubernetes\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.437171 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.435765    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/783ae988-c52f-431e-bdbe-bbd637aa6cba-ovnkube-script-lib\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.437568 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.437539    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.438872 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.438844    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 14:24:30.439657 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.439167    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 14:24:30.439657 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.439411    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 14:24:30.439657 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.439478    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 14:24:30.440517 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.440493    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mh8jq\""
Jul 07 14:24:30.444593 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.444314    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.444901 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.444720    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 14:24:30.445255 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.445074    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 14:24:30.445255 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.445091    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pgbhx"
Jul 07 14:24:30.445255 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.445108    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pgbhx"
Jul 07 14:24:30.445463 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.445257    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmv7h\""
Jul 07 14:24:30.446860 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.446477    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.446860 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.446671    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 14:24:30.448538 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.448517    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 14:24:30.450333 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.449376    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:30.450333 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.449458    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:30.450333 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.449815    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-np46r\""
Jul 07 14:24:30.450333 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.449999    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 14:24:30.450333 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.450231    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 14:24:30.450694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.450558    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-klhtc\""
Jul 07 14:24:30.451789 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.451767    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.454362 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.454087    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:24:30.454623 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.454594    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 14:24:30.454826 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.454807    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 14:24:30.455114 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.455098    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v5pdp\""
Jul 07 14:24:30.470342 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.470295    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal" event={"ID":"b5bea2a7ea053e86fd5618f8d006eb10","Type":"ContainerStarted","Data":"a0ef282e734a70d3482cdb9eb8a20fa12e268eb193d73f933510539bb61db9a8"}
Jul 07 14:24:30.474173 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.474148    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal" event={"ID":"5d0582c3b390fb22f9648ea732036658","Type":"ContainerStarted","Data":"5b52540eb62446ec87dda60df88c34decc31679806bf952ab3ac4a2dbce905c4"}
Jul 07 14:24:30.508557 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.508532    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 14:24:30.536389 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/783ae988-c52f-431e-bdbe-bbd637aa6cba-env-overrides\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.536389 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgm4b\" (UniqueName: \"kubernetes.io/projected/4b9a4b09-d6c8-4340-873a-db98e632588c-kube-api-access-pgm4b\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.536609 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce806fe6-2831-4f5b-b098-0ca02394d02b-host\") pod \"node-ca-7hjnz\" (UID: \"ce806fe6-2831-4f5b-b098-0ca02394d02b\") " pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.536609 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b9a4b09-d6c8-4340-873a-db98e632588c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.536609 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-646d2\" (UniqueName: \"kubernetes.io/projected/ce806fe6-2831-4f5b-b098-0ca02394d02b-kube-api-access-646d2\") pod \"node-ca-7hjnz\" (UID: \"ce806fe6-2831-4f5b-b098-0ca02394d02b\") " pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.536609 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-kubernetes\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.536609 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a71b229-1fae-4b8a-aba1-31c039cce5f7-tmp\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.536609 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-kubelet\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.536609 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-cnibin\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.536609 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536606    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj5hr\" (UniqueName: \"kubernetes.io/projected/81a0adae-7087-46ed-ab48-0fa69eaf7ba0-kube-api-access-sj5hr\") pod \"node-resolver-kz2tg\" (UID: \"81a0adae-7087-46ed-ab48-0fa69eaf7ba0\") " pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536644    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-etc-kubernetes\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536672    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-host\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536698    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-run-ovn-kubernetes\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/783ae988-c52f-431e-bdbe-bbd637aa6cba-ovnkube-script-lib\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536741    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-run-netns\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-systemd\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-run\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/783ae988-c52f-431e-bdbe-bbd637aa6cba-ovn-node-metrics-cert\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce806fe6-2831-4f5b-b098-0ca02394d02b-serviceca\") pod \"node-ca-7hjnz\" (UID: \"ce806fe6-2831-4f5b-b098-0ca02394d02b\") " pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-registration-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536858    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-multus-socket-dir-parent\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536892    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-multus-conf-dir\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x76md\" (UniqueName: \"kubernetes.io/projected/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-kube-api-access-x76md\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536926    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-sysconfig\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536944    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/783ae988-c52f-431e-bdbe-bbd637aa6cba-env-overrides\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.536959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-slash\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537067    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-var-lib-openvswitch\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-etc-openvswitch\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537131    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-os-release\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537004    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-slash\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537213    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-var-lib-openvswitch\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537236    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-run-ovn-kubernetes\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-var-lib-cni-bin\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537260    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce806fe6-2831-4f5b-b098-0ca02394d02b-host\") pod \"node-ca-7hjnz\" (UID: \"ce806fe6-2831-4f5b-b098-0ca02394d02b\") " pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537284    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-tuned\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537300    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-etc-openvswitch\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-systemd-units\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-run-systemd\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537384    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-systemd\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537393    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-run-openvswitch\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537376    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-os-release\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537432    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-kubelet\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-etc-selinux\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.537959 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-var-lib-kubelet\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-hostroot\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-run-k8s-cni-cncf-io\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537567    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/613a5efe-2555-4745-b39c-84ace21b125e-multus-daemon-config\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b370c905-2d81-4dcf-87a1-24cc322046db-konnectivity-ca\") pod \"konnectivity-agent-j9b2b\" (UID: \"b370c905-2d81-4dcf-87a1-24cc322046db\") " pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537663    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-system-cni-dir\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537666    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b62ed01-d6a2-41a9-8725-5da7f402e07c-kubelet-config\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537723    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b421450-16c4-4694-a460-9a8354b21491-host-slash\") pod \"iptables-alerter-f65s9\" (UID: \"0b421450-16c4-4694-a460-9a8354b21491\") " pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537783    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81a0adae-7087-46ed-ab48-0fa69eaf7ba0-hosts-file\") pod \"node-resolver-kz2tg\" (UID: \"81a0adae-7087-46ed-ab48-0fa69eaf7ba0\") " pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537840    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-lib-modules\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537867    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phpzw\" (UniqueName: \"kubernetes.io/projected/2a71b229-1fae-4b8a-aba1-31c039cce5f7-kube-api-access-phpzw\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537892    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-cni-bin\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-socket-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-modprobe-d\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.538849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537951    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-systemd-units\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-var-lib-kubelet\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-run-ovn\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538065    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-system-cni-dir\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538078    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-run-ovn\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538106    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-log-socket\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538126    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b62ed01-d6a2-41a9-8725-5da7f402e07c-kubelet-config\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmcmp\" (UniqueName: \"kubernetes.io/projected/783ae988-c52f-431e-bdbe-bbd637aa6cba-kube-api-access-cmcmp\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b421450-16c4-4694-a460-9a8354b21491-iptables-alerter-script\") pod \"iptables-alerter-f65s9\" (UID: \"0b421450-16c4-4694-a460-9a8354b21491\") " pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-multus-cni-dir\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-cnibin\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538254    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b9a4b09-d6c8-4340-873a-db98e632588c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b62ed01-d6a2-41a9-8725-5da7f402e07c-dbus\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-sysctl-conf\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b370c905-2d81-4dcf-87a1-24cc322046db-agent-certs\") pod \"konnectivity-agent-j9b2b\" (UID: \"b370c905-2d81-4dcf-87a1-24cc322046db\") " pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538347    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-lib-modules\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538355    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b9a4b09-d6c8-4340-873a-db98e632588c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.539784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/613a5efe-2555-4745-b39c-84ace21b125e-cni-binary-copy\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538415    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-cni-bin\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-var-lib-cni-multus\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538457    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81a0adae-7087-46ed-ab48-0fa69eaf7ba0-tmp-dir\") pod \"node-resolver-kz2tg\" (UID: \"81a0adae-7087-46ed-ab48-0fa69eaf7ba0\") " pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538485    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/783ae988-c52f-431e-bdbe-bbd637aa6cba-ovnkube-script-lib\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538513    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-modprobe-d\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-sysctl-d\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-node-log\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538567    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-var-lib-kubelet\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538594    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-host\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538606    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-node-log\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd78q\" (UniqueName: \"kubernetes.io/projected/0b421450-16c4-4694-a460-9a8354b21491-kube-api-access-hd78q\") pod \"iptables-alerter-f65s9\" (UID: \"0b421450-16c4-4694-a460-9a8354b21491\") " pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538640    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-os-release\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b9a4b09-d6c8-4340-873a-db98e632588c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btfhr\" (UniqueName: \"kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr\") pod \"network-check-target-vlzfg\" (UID: \"12ffe0f4-f24b-4751-abd8-6996416bb666\") " pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538685    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-sysctl-d\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.540665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538704    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-device-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538721    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-system-cni-dir\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538740    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538749    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81a0adae-7087-46ed-ab48-0fa69eaf7ba0-tmp-dir\") pod \"node-resolver-kz2tg\" (UID: \"81a0adae-7087-46ed-ab48-0fa69eaf7ba0\") " pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538757    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-sys\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-cni-netd\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538795    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538809    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-sysctl-conf\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538324    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-cnibin\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538180    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538236    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81a0adae-7087-46ed-ab48-0fa69eaf7ba0-hosts-file\") pod \"node-resolver-kz2tg\" (UID: \"81a0adae-7087-46ed-ab48-0fa69eaf7ba0\") " pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.538811    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-sys-fs\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.537439    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-run-openvswitch\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539069    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-run\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539131    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-kubernetes\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539136    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvl94\" (UniqueName: \"kubernetes.io/projected/0a302bb9-9e67-4429-b601-da1ad433a129-kube-api-access-jvl94\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-run-multus-certs\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.541590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539205    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b62ed01-d6a2-41a9-8725-5da7f402e07c-dbus\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8gq7\" (UniqueName: \"kubernetes.io/projected/613a5efe-2555-4745-b39c-84ace21b125e-kube-api-access-x8gq7\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539265    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-run-systemd\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539274    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-log-socket\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539312    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/783ae988-c52f-431e-bdbe-bbd637aa6cba-ovnkube-config\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539356    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b9a4b09-d6c8-4340-873a-db98e632588c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539395    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-run-netns\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-run-netns\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539429    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b9a4b09-d6c8-4340-873a-db98e632588c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539586    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/783ae988-c52f-431e-bdbe-bbd637aa6cba-host-cni-netd\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539356    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b9a4b09-d6c8-4340-873a-db98e632588c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539616    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce806fe6-2831-4f5b-b098-0ca02394d02b-serviceca\") pod \"node-ca-7hjnz\" (UID: \"ce806fe6-2831-4f5b-b098-0ca02394d02b\") " pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539667    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-sys\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.539691    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539403    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-sysconfig\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539768    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b370c905-2d81-4dcf-87a1-24cc322046db-konnectivity-ca\") pod \"konnectivity-agent-j9b2b\" (UID: \"b370c905-2d81-4dcf-87a1-24cc322046db\") " pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.539828    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret podName:4b62ed01-d6a2-41a9-8725-5da7f402e07c nodeName:}" failed. No retries permitted until 2026-07-07 14:24:31.039805263 +0000 UTC m=+3.067313354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret") pod "global-pull-secret-syncer-hwrbj" (UID: "4b62ed01-d6a2-41a9-8725-5da7f402e07c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:30.542519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.539934    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/783ae988-c52f-431e-bdbe-bbd637aa6cba-ovnkube-config\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.544468 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.544442    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/783ae988-c52f-431e-bdbe-bbd637aa6cba-ovn-node-metrics-cert\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.544609 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.544575    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a71b229-1fae-4b8a-aba1-31c039cce5f7-etc-tuned\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.544877 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.544854    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b370c905-2d81-4dcf-87a1-24cc322046db-agent-certs\") pod \"konnectivity-agent-j9b2b\" (UID: \"b370c905-2d81-4dcf-87a1-24cc322046db\") " pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:30.545255 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.545163    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a71b229-1fae-4b8a-aba1-31c039cce5f7-tmp\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.548688 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.548077    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:30.548688 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.548099    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:30.548688 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.548115    2583 projected.go:196] Error preparing data for projected volume kube-api-access-btfhr for pod openshift-network-diagnostics/network-check-target-vlzfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:30.548688 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.548175    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr podName:12ffe0f4-f24b-4751-abd8-6996416bb666 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:31.048156625 +0000 UTC m=+3.075664720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-btfhr" (UniqueName: "kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr") pod "network-check-target-vlzfg" (UID: "12ffe0f4-f24b-4751-abd8-6996416bb666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:30.549260 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.549222    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgm4b\" (UniqueName: \"kubernetes.io/projected/4b9a4b09-d6c8-4340-873a-db98e632588c-kube-api-access-pgm4b\") pod \"multus-additional-cni-plugins-8chjr\" (UID: \"4b9a4b09-d6c8-4340-873a-db98e632588c\") " pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.550227 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.550190    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj5hr\" (UniqueName: \"kubernetes.io/projected/81a0adae-7087-46ed-ab48-0fa69eaf7ba0-kube-api-access-sj5hr\") pod \"node-resolver-kz2tg\" (UID: \"81a0adae-7087-46ed-ab48-0fa69eaf7ba0\") " pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.552128 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.552072    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-646d2\" (UniqueName: \"kubernetes.io/projected/ce806fe6-2831-4f5b-b098-0ca02394d02b-kube-api-access-646d2\") pod \"node-ca-7hjnz\" (UID: \"ce806fe6-2831-4f5b-b098-0ca02394d02b\") " pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.553790 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.553733    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phpzw\" (UniqueName: \"kubernetes.io/projected/2a71b229-1fae-4b8a-aba1-31c039cce5f7-kube-api-access-phpzw\") pod \"tuned-mpmqh\" (UID: \"2a71b229-1fae-4b8a-aba1-31c039cce5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.559712 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.558863    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmcmp\" (UniqueName: \"kubernetes.io/projected/783ae988-c52f-431e-bdbe-bbd637aa6cba-kube-api-access-cmcmp\") pod \"ovnkube-node-7z9z2\" (UID: \"783ae988-c52f-431e-bdbe-bbd637aa6cba\") " pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.615267 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.615233    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mpmqh"
Jul 07 14:24:30.630438 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:30.630371    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a71b229_1fae_4b8a_aba1_31c039cce5f7.slice/crio-fd4f67eebdc54fdec144427859920870b2d92ce81bf621c82e142ebb30e6f486 WatchSource:0}: Error finding container fd4f67eebdc54fdec144427859920870b2d92ce81bf621c82e142ebb30e6f486: Status 404 returned error can't find the container with id fd4f67eebdc54fdec144427859920870b2d92ce81bf621c82e142ebb30e6f486
Jul 07 14:24:30.640529 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b421450-16c4-4694-a460-9a8354b21491-host-slash\") pod \"iptables-alerter-f65s9\" (UID: \"0b421450-16c4-4694-a460-9a8354b21491\") " pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.640654 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.640654 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-socket-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.640654 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b421450-16c4-4694-a460-9a8354b21491-iptables-alerter-script\") pod \"iptables-alerter-f65s9\" (UID: \"0b421450-16c4-4694-a460-9a8354b21491\") " pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.640654 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-multus-cni-dir\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.640878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-cnibin\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.640878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/613a5efe-2555-4745-b39c-84ace21b125e-cni-binary-copy\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.640878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640707    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b421450-16c4-4694-a460-9a8354b21491-host-slash\") pod \"iptables-alerter-f65s9\" (UID: \"0b421450-16c4-4694-a460-9a8354b21491\") " pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.640878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-var-lib-cni-multus\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.640878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd78q\" (UniqueName: \"kubernetes.io/projected/0b421450-16c4-4694-a460-9a8354b21491-kube-api-access-hd78q\") pod \"iptables-alerter-f65s9\" (UID: \"0b421450-16c4-4694-a460-9a8354b21491\") " pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.640878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640785    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-var-lib-cni-multus\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.640878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-os-release\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.640878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640847    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-device-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.640878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640874    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-system-cni-dir\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.641408 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640900    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:30.641408 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-sys-fs\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.641408 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640957    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-socket-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.641408 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvl94\" (UniqueName: \"kubernetes.io/projected/0a302bb9-9e67-4429-b601-da1ad433a129-kube-api-access-jvl94\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.641618 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641423    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-cnibin\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.641618 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641498    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-multus-cni-dir\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.641727 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641630    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-system-cni-dir\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.641727 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.640849    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.641727 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641646    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-os-release\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.641881 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.641738    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:30.641881 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641746    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-device-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.641881 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641764    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b421450-16c4-4694-a460-9a8354b21491-iptables-alerter-script\") pod \"iptables-alerter-f65s9\" (UID: \"0b421450-16c4-4694-a460-9a8354b21491\") " pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.641881 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:30.641797    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs podName:b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:31.141775905 +0000 UTC m=+3.169284008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs") pod "network-metrics-daemon-hh5cg" (UID: "b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:30.641881 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641833    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-sys-fs\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.642165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641884    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-run-multus-certs\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8gq7\" (UniqueName: \"kubernetes.io/projected/613a5efe-2555-4745-b39c-84ace21b125e-kube-api-access-x8gq7\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641936    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-run-multus-certs\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-etc-kubernetes\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642026    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-etc-kubernetes\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.641991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-run-netns\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-registration-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.642165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642106    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-multus-socket-dir-parent\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642077    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-run-netns\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-multus-conf-dir\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x76md\" (UniqueName: \"kubernetes.io/projected/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-kube-api-access-x76md\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642190    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/613a5efe-2555-4745-b39c-84ace21b125e-cni-binary-copy\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-var-lib-cni-bin\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642225    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-registration-dir\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-etc-selinux\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642258    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-multus-conf-dir\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642262    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-multus-socket-dir-parent\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-var-lib-kubelet\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-hostroot\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642322    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-var-lib-cni-bin\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642344    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-run-k8s-cni-cncf-io\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642362    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a302bb9-9e67-4429-b601-da1ad433a129-etc-selinux\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642364    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-var-lib-kubelet\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/613a5efe-2555-4745-b39c-84ace21b125e-multus-daemon-config\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642398    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-hostroot\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.642694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642458    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/613a5efe-2555-4745-b39c-84ace21b125e-host-run-k8s-cni-cncf-io\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.643508 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.642859    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/613a5efe-2555-4745-b39c-84ace21b125e-multus-daemon-config\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.653490 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.653455    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvl94\" (UniqueName: \"kubernetes.io/projected/0a302bb9-9e67-4429-b601-da1ad433a129-kube-api-access-jvl94\") pod \"aws-ebs-csi-driver-node-qntf8\" (UID: \"0a302bb9-9e67-4429-b601-da1ad433a129\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.654932 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.654904    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x76md\" (UniqueName: \"kubernetes.io/projected/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-kube-api-access-x76md\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:30.655265 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.655215    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8gq7\" (UniqueName: \"kubernetes.io/projected/613a5efe-2555-4745-b39c-84ace21b125e-kube-api-access-x8gq7\") pod \"multus-xjtt9\" (UID: \"613a5efe-2555-4745-b39c-84ace21b125e\") " pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.655548 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.655525    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd78q\" (UniqueName: \"kubernetes.io/projected/0b421450-16c4-4694-a460-9a8354b21491-kube-api-access-hd78q\") pod \"iptables-alerter-f65s9\" (UID: \"0b421450-16c4-4694-a460-9a8354b21491\") " pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.744974 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.744929    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:30.756479 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:30.756446    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783ae988_c52f_431e_bdbe_bbd637aa6cba.slice/crio-752b4d4da6156aae9e49c4bdd9a0537cf08b5e8c452cda3c6694a6141de4311c WatchSource:0}: Error finding container 752b4d4da6156aae9e49c4bdd9a0537cf08b5e8c452cda3c6694a6141de4311c: Status 404 returned error can't find the container with id 752b4d4da6156aae9e49c4bdd9a0537cf08b5e8c452cda3c6694a6141de4311c
Jul 07 14:24:30.759313 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.759286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:30.767336 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.767300    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8chjr"
Jul 07 14:24:30.773072 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:30.773041    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb370c905_2d81_4dcf_87a1_24cc322046db.slice/crio-90c56e6e0e7bdff0b9e11f5204ab2415e77409b2a9767147b1ebaaf07855b3f1 WatchSource:0}: Error finding container 90c56e6e0e7bdff0b9e11f5204ab2415e77409b2a9767147b1ebaaf07855b3f1: Status 404 returned error can't find the container with id 90c56e6e0e7bdff0b9e11f5204ab2415e77409b2a9767147b1ebaaf07855b3f1
Jul 07 14:24:30.775382 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.775358    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7hjnz"
Jul 07 14:24:30.778399 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:30.778371    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9a4b09_d6c8_4340_873a_db98e632588c.slice/crio-02e3cd52c66421c1a8ab812f6a055c2b5af30fab73d78f94150fccd2764ad029 WatchSource:0}: Error finding container 02e3cd52c66421c1a8ab812f6a055c2b5af30fab73d78f94150fccd2764ad029: Status 404 returned error can't find the container with id 02e3cd52c66421c1a8ab812f6a055c2b5af30fab73d78f94150fccd2764ad029
Jul 07 14:24:30.785298 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.785266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kz2tg"
Jul 07 14:24:30.786703 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:30.786681    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce806fe6_2831_4f5b_b098_0ca02394d02b.slice/crio-8555dfdf8fb85369ff8b0de9c2fbb6335ca7949863f0f4417f033ab1120b478b WatchSource:0}: Error finding container 8555dfdf8fb85369ff8b0de9c2fbb6335ca7949863f0f4417f033ab1120b478b: Status 404 returned error can't find the container with id 8555dfdf8fb85369ff8b0de9c2fbb6335ca7949863f0f4417f033ab1120b478b
Jul 07 14:24:30.794042 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.794015    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8"
Jul 07 14:24:30.797160 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:30.797125    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a0adae_7087_46ed_ab48_0fa69eaf7ba0.slice/crio-fb6fa42856f68f3eb45d830d75dbba6cca167a7e61128963267f10cb0b7a81dd WatchSource:0}: Error finding container fb6fa42856f68f3eb45d830d75dbba6cca167a7e61128963267f10cb0b7a81dd: Status 404 returned error can't find the container with id fb6fa42856f68f3eb45d830d75dbba6cca167a7e61128963267f10cb0b7a81dd
Jul 07 14:24:30.804248 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.804205    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xjtt9"
Jul 07 14:24:30.805606 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:30.805581    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a302bb9_9e67_4429_b601_da1ad433a129.slice/crio-96922a452a05efa4e82e2378914faaa095ec35f94cd69ed0a4f39c3f7416f32b WatchSource:0}: Error finding container 96922a452a05efa4e82e2378914faaa095ec35f94cd69ed0a4f39c3f7416f32b: Status 404 returned error can't find the container with id 96922a452a05efa4e82e2378914faaa095ec35f94cd69ed0a4f39c3f7416f32b
Jul 07 14:24:30.812140 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.812109    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f65s9"
Jul 07 14:24:30.817896 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:30.817865    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613a5efe_2555_4745_b39c_84ace21b125e.slice/crio-067c82f77d7540ad7cf2e06fcaaab4f9852f5233536fc69f6965d1c378b74c8e WatchSource:0}: Error finding container 067c82f77d7540ad7cf2e06fcaaab4f9852f5233536fc69f6965d1c378b74c8e: Status 404 returned error can't find the container with id 067c82f77d7540ad7cf2e06fcaaab4f9852f5233536fc69f6965d1c378b74c8e
Jul 07 14:24:30.822213 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:30.822190    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:30.824578 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:24:30.824551    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b421450_16c4_4694_a460_9a8354b21491.slice/crio-4291008883bed19093933aced64eed1796d25e89bd979d88fd36c0a2cde241c3 WatchSource:0}: Error finding container 4291008883bed19093933aced64eed1796d25e89bd979d88fd36c0a2cde241c3: Status 404 returned error can't find the container with id 4291008883bed19093933aced64eed1796d25e89bd979d88fd36c0a2cde241c3
Jul 07 14:24:31.045139 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.045035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:31.045303 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:31.045193    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:31.045303 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:31.045278    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret podName:4b62ed01-d6a2-41a9-8725-5da7f402e07c nodeName:}" failed. No retries permitted until 2026-07-07 14:24:32.045255491 +0000 UTC m=+4.072763578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret") pod "global-pull-secret-syncer-hwrbj" (UID: "4b62ed01-d6a2-41a9-8725-5da7f402e07c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:31.145652 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.145607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btfhr\" (UniqueName: \"kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr\") pod \"network-check-target-vlzfg\" (UID: \"12ffe0f4-f24b-4751-abd8-6996416bb666\") " pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:31.145869 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.145661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:31.145869 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:31.145815    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:31.145869 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:31.145820    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:31.145869 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:31.145848    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:31.145869 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:31.145861    2583 projected.go:196] Error preparing data for projected volume kube-api-access-btfhr for pod openshift-network-diagnostics/network-check-target-vlzfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:31.146167 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:31.145894    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs podName:b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:32.145873223 +0000 UTC m=+4.173381319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs") pod "network-metrics-daemon-hh5cg" (UID: "b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:31.146167 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:31.145918    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr podName:12ffe0f4-f24b-4751-abd8-6996416bb666 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:32.1459014 +0000 UTC m=+4.173409513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-btfhr" (UniqueName: "kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr") pod "network-check-target-vlzfg" (UID: "12ffe0f4-f24b-4751-abd8-6996416bb666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:31.448593 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.448486    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:19:30 +0000 UTC" deadline="2028-02-10 21:55:50.958126743 +0000 UTC"
Jul 07 14:24:31.448593 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.448529    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13999h31m19.5096026s"
Jul 07 14:24:31.462750 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.462724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:31.462901 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:31.462837    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:31.477829 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.477792    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8chjr" event={"ID":"4b9a4b09-d6c8-4340-873a-db98e632588c","Type":"ContainerStarted","Data":"02e3cd52c66421c1a8ab812f6a055c2b5af30fab73d78f94150fccd2764ad029"}
Jul 07 14:24:31.479120 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.479092    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9b2b" event={"ID":"b370c905-2d81-4dcf-87a1-24cc322046db","Type":"ContainerStarted","Data":"90c56e6e0e7bdff0b9e11f5204ab2415e77409b2a9767147b1ebaaf07855b3f1"}
Jul 07 14:24:31.480250 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.480224    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" event={"ID":"783ae988-c52f-431e-bdbe-bbd637aa6cba","Type":"ContainerStarted","Data":"752b4d4da6156aae9e49c4bdd9a0537cf08b5e8c452cda3c6694a6141de4311c"}
Jul 07 14:24:31.481966 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.481930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xjtt9" event={"ID":"613a5efe-2555-4745-b39c-84ace21b125e","Type":"ContainerStarted","Data":"067c82f77d7540ad7cf2e06fcaaab4f9852f5233536fc69f6965d1c378b74c8e"}
Jul 07 14:24:31.485730 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.485699    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8" event={"ID":"0a302bb9-9e67-4429-b601-da1ad433a129","Type":"ContainerStarted","Data":"96922a452a05efa4e82e2378914faaa095ec35f94cd69ed0a4f39c3f7416f32b"}
Jul 07 14:24:31.486863 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.486841    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mpmqh" event={"ID":"2a71b229-1fae-4b8a-aba1-31c039cce5f7","Type":"ContainerStarted","Data":"fd4f67eebdc54fdec144427859920870b2d92ce81bf621c82e142ebb30e6f486"}
Jul 07 14:24:31.488128 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.488101    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f65s9" event={"ID":"0b421450-16c4-4694-a460-9a8354b21491","Type":"ContainerStarted","Data":"4291008883bed19093933aced64eed1796d25e89bd979d88fd36c0a2cde241c3"}
Jul 07 14:24:31.489367 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.489335    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kz2tg" event={"ID":"81a0adae-7087-46ed-ab48-0fa69eaf7ba0","Type":"ContainerStarted","Data":"fb6fa42856f68f3eb45d830d75dbba6cca167a7e61128963267f10cb0b7a81dd"}
Jul 07 14:24:31.490573 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:31.490548    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7hjnz" event={"ID":"ce806fe6-2831-4f5b-b098-0ca02394d02b","Type":"ContainerStarted","Data":"8555dfdf8fb85369ff8b0de9c2fbb6335ca7949863f0f4417f033ab1120b478b"}
Jul 07 14:24:32.053050 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:32.052976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:32.053272 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:32.053199    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:32.053344 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:32.053274    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret podName:4b62ed01-d6a2-41a9-8725-5da7f402e07c nodeName:}" failed. No retries permitted until 2026-07-07 14:24:34.053253398 +0000 UTC m=+6.080761491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret") pod "global-pull-secret-syncer-hwrbj" (UID: "4b62ed01-d6a2-41a9-8725-5da7f402e07c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:32.155175 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:32.154266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btfhr\" (UniqueName: \"kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr\") pod \"network-check-target-vlzfg\" (UID: \"12ffe0f4-f24b-4751-abd8-6996416bb666\") " pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:32.155175 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:32.154325    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:32.155175 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:32.154497    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:32.155175 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:32.154565    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs podName:b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:34.15454422 +0000 UTC m=+6.182052310 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs") pod "network-metrics-daemon-hh5cg" (UID: "b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:32.155175 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:32.155017    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:32.155175 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:32.155053    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:32.155175 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:32.155069    2583 projected.go:196] Error preparing data for projected volume kube-api-access-btfhr for pod openshift-network-diagnostics/network-check-target-vlzfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:32.155175 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:32.155123    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr podName:12ffe0f4-f24b-4751-abd8-6996416bb666 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:34.155105907 +0000 UTC m=+6.182613997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-btfhr" (UniqueName: "kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr") pod "network-check-target-vlzfg" (UID: "12ffe0f4-f24b-4751-abd8-6996416bb666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:32.449779 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:32.449488    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:19:30 +0000 UTC" deadline="2028-03-21 13:02:15.835310932 +0000 UTC"
Jul 07 14:24:32.449779 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:32.449777    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14950h37m43.38553914s"
Jul 07 14:24:32.462986 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:32.462942    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:32.463154 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:32.463110    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:32.463679 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:32.463656    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:32.463808 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:32.463786    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:32.510091 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:32.509306    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal" event={"ID":"5d0582c3b390fb22f9648ea732036658","Type":"ContainerStarted","Data":"da7ffc59c4a8047fdbfcee9b5e1955e04c3c7f1705f0b1e487b4cf1dd1e150b0"}
Jul 07 14:24:33.462740 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:33.462648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:33.463304 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:33.462913    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:33.522896 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:33.522854    2583 generic.go:356] "Generic (PLEG): container finished" podID="b5bea2a7ea053e86fd5618f8d006eb10" containerID="203be89229df16e31ecaad81c72305286bc39644973d2e3527fbcf478c9de482" exitCode=0
Jul 07 14:24:33.523899 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:33.523872    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal" event={"ID":"b5bea2a7ea053e86fd5618f8d006eb10","Type":"ContainerDied","Data":"203be89229df16e31ecaad81c72305286bc39644973d2e3527fbcf478c9de482"}
Jul 07 14:24:33.545496 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:33.545433    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-139.ec2.internal" podStartSLOduration=3.545407993 podStartE2EDuration="3.545407993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:32.531131945 +0000 UTC m=+4.558640057" watchObservedRunningTime="2026-07-07 14:24:33.545407993 +0000 UTC m=+5.572916106"
Jul 07 14:24:34.070630 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:34.070589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:34.070861 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:34.070749    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:34.070861 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:34.070818    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret podName:4b62ed01-d6a2-41a9-8725-5da7f402e07c nodeName:}" failed. No retries permitted until 2026-07-07 14:24:38.070803016 +0000 UTC m=+10.098311103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret") pod "global-pull-secret-syncer-hwrbj" (UID: "4b62ed01-d6a2-41a9-8725-5da7f402e07c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:34.172225 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:34.171314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btfhr\" (UniqueName: \"kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr\") pod \"network-check-target-vlzfg\" (UID: \"12ffe0f4-f24b-4751-abd8-6996416bb666\") " pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:34.172225 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:34.171368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:34.172225 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:34.171562    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:34.172225 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:34.171629    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs podName:b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:38.171607563 +0000 UTC m=+10.199115680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs") pod "network-metrics-daemon-hh5cg" (UID: "b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:34.172225 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:34.172103    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:34.172225 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:34.172123    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:34.172225 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:34.172136    2583 projected.go:196] Error preparing data for projected volume kube-api-access-btfhr for pod openshift-network-diagnostics/network-check-target-vlzfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:34.172225 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:34.172187    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr podName:12ffe0f4-f24b-4751-abd8-6996416bb666 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:38.172171128 +0000 UTC m=+10.199679220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-btfhr" (UniqueName: "kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr") pod "network-check-target-vlzfg" (UID: "12ffe0f4-f24b-4751-abd8-6996416bb666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:34.465800 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:34.465122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:34.465800 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:34.465269    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:34.470126 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:34.465023    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:34.470126 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:34.467008    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:35.463045 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:35.462440    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:35.463045 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:35.462582    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:36.462582 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:36.462515    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:36.463092 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:36.462523    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:36.463092 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:36.462660    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:36.463092 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:36.462742    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:37.462818 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:37.462782    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:37.463239 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:37.462900    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:38.108249 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:38.108198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:38.108445 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:38.108356    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:38.108445 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:38.108434    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret podName:4b62ed01-d6a2-41a9-8725-5da7f402e07c nodeName:}" failed. No retries permitted until 2026-07-07 14:24:46.108413543 +0000 UTC m=+18.135921640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret") pod "global-pull-secret-syncer-hwrbj" (UID: "4b62ed01-d6a2-41a9-8725-5da7f402e07c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:38.208887 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:38.208849    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btfhr\" (UniqueName: \"kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr\") pod \"network-check-target-vlzfg\" (UID: \"12ffe0f4-f24b-4751-abd8-6996416bb666\") " pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:38.208887 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:38.208900    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:38.209159 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:38.209050    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:38.209159 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:38.209068    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:38.209159 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:38.209092    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:38.209159 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:38.209106    2583 projected.go:196] Error preparing data for projected volume kube-api-access-btfhr for pod openshift-network-diagnostics/network-check-target-vlzfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:38.209159 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:38.209111    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs podName:b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:46.209092634 +0000 UTC m=+18.236600724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs") pod "network-metrics-daemon-hh5cg" (UID: "b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:38.209159 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:38.209162    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr podName:12ffe0f4-f24b-4751-abd8-6996416bb666 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:46.209144995 +0000 UTC m=+18.236653083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-btfhr" (UniqueName: "kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr") pod "network-check-target-vlzfg" (UID: "12ffe0f4-f24b-4751-abd8-6996416bb666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:38.463837 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:38.463250    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:38.463837 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:38.463302    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:38.463837 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:38.463367    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:38.463837 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:38.463431    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:39.462865 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:39.462829    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:39.463072 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:39.462981    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:40.462354 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:40.462318    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:40.462831 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:40.462452    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:40.462831 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:40.462768    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:40.462937 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:40.462875    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:41.462488 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:41.462451    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:41.462950 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:41.462589    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:42.462543 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:42.462499    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:42.462952 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:42.462501    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:42.462952 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:42.462609    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:42.462952 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:42.462724    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:43.462575 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:43.462536    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:43.463012 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:43.462674    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:44.462495 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:44.462459    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:44.462687 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:44.462475    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:44.462687 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:44.462606    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:44.463037 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:44.462710    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:45.462720 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:45.462686    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:45.463189 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:45.462798    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:46.175221 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:46.175189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:46.175394 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:46.175332    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:46.175394 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:46.175394    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret podName:4b62ed01-d6a2-41a9-8725-5da7f402e07c nodeName:}" failed. No retries permitted until 2026-07-07 14:25:02.175378638 +0000 UTC m=+34.202886723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret") pod "global-pull-secret-syncer-hwrbj" (UID: "4b62ed01-d6a2-41a9-8725-5da7f402e07c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:46.275913 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:46.275878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btfhr\" (UniqueName: \"kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr\") pod \"network-check-target-vlzfg\" (UID: \"12ffe0f4-f24b-4751-abd8-6996416bb666\") " pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:46.275913 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:46.275919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:46.276187 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:46.276053    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:46.276187 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:46.276077    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:46.276187 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:46.276099    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:46.276187 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:46.276112    2583 projected.go:196] Error preparing data for projected volume kube-api-access-btfhr for pod openshift-network-diagnostics/network-check-target-vlzfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:46.276187 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:46.276118    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs podName:b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:02.27610167 +0000 UTC m=+34.303609756 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs") pod "network-metrics-daemon-hh5cg" (UID: "b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:46.276187 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:46.276160    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr podName:12ffe0f4-f24b-4751-abd8-6996416bb666 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:02.276145151 +0000 UTC m=+34.303653257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-btfhr" (UniqueName: "kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr") pod "network-check-target-vlzfg" (UID: "12ffe0f4-f24b-4751-abd8-6996416bb666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:46.462323 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:46.462269    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:46.462511 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:46.462408    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:46.462511 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:46.462486    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:46.462618 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:46.462597    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:47.462713 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:47.462673    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:47.463189 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:47.462807    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:48.463513 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:48.463450    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:48.464019 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:48.463579    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:48.464019 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:48.463637    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:48.464019 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:48.463753    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:49.462068 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:49.462029    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:49.462253 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:49.462155    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:50.462570 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:50.462539    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:50.462939 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:50.462539    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:50.462939 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:50.462653    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:50.462939 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:50.462743    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:51.462891 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.462731    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:51.463500 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:51.462979    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:51.564010 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.563979    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal" event={"ID":"b5bea2a7ea053e86fd5618f8d006eb10","Type":"ContainerStarted","Data":"d6c8f311fcf625c1aad738f94c59bee38668de96cb4f4d605ea2f48ef88ad7b9"}
Jul 07 14:24:51.565304 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.565283    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kz2tg" event={"ID":"81a0adae-7087-46ed-ab48-0fa69eaf7ba0","Type":"ContainerStarted","Data":"4ea40d5800bb5b2d5639e1ccdaf12d942cf987ed9963f7f5be7b46a8f91a9a9f"}
Jul 07 14:24:51.566608 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.566588    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7hjnz" event={"ID":"ce806fe6-2831-4f5b-b098-0ca02394d02b","Type":"ContainerStarted","Data":"1c28a2c4d48b2ae9b8b86b5a070321136c07d18c7e328578e48cb8c36682ebc6"}
Jul 07 14:24:51.568056 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.568036    2583 generic.go:356] "Generic (PLEG): container finished" podID="4b9a4b09-d6c8-4340-873a-db98e632588c" containerID="5905c12aba28a61c5be524ae5b1adb86f1f6ffad4ac2b7d4555355994c98dca2" exitCode=0
Jul 07 14:24:51.568119 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.568104    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8chjr" event={"ID":"4b9a4b09-d6c8-4340-873a-db98e632588c","Type":"ContainerDied","Data":"5905c12aba28a61c5be524ae5b1adb86f1f6ffad4ac2b7d4555355994c98dca2"}
Jul 07 14:24:51.569926 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.569885    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9b2b" event={"ID":"b370c905-2d81-4dcf-87a1-24cc322046db","Type":"ContainerStarted","Data":"5f88debd642230ac603c269360d85b2adcd3a6ed278a58bc3a56902de1c415f4"}
Jul 07 14:24:51.572264 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.572248    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:24:51.572568 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.572551    2583 generic.go:356] "Generic (PLEG): container finished" podID="783ae988-c52f-431e-bdbe-bbd637aa6cba" containerID="bea414efa316844f982c8dae7db9f9ce9209192ba08cd68143be61d257c59f12" exitCode=1
Jul 07 14:24:51.572656 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.572614    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" event={"ID":"783ae988-c52f-431e-bdbe-bbd637aa6cba","Type":"ContainerStarted","Data":"470e98769185baee4f9ff6ba1a99e69d9c228a1e0bb73e2e5359bf25afc666a1"}
Jul 07 14:24:51.572714 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.572695    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" event={"ID":"783ae988-c52f-431e-bdbe-bbd637aa6cba","Type":"ContainerStarted","Data":"908331bce80a838c041cb85ee66125d7b50f2a6e8c20fd4cc955a308c2ad718c"}
Jul 07 14:24:51.572758 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.572747    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" event={"ID":"783ae988-c52f-431e-bdbe-bbd637aa6cba","Type":"ContainerStarted","Data":"bc7fc2cd5ccb83750e5995dc4c00386d789fcffcbc9d71a041e48ea1c38d07b9"}
Jul 07 14:24:51.572804 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.572793    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" event={"ID":"783ae988-c52f-431e-bdbe-bbd637aa6cba","Type":"ContainerDied","Data":"bea414efa316844f982c8dae7db9f9ce9209192ba08cd68143be61d257c59f12"}
Jul 07 14:24:51.572859 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.572833    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" event={"ID":"783ae988-c52f-431e-bdbe-bbd637aa6cba","Type":"ContainerStarted","Data":"4899762753f2f453fd2fe129137e9e777788cf97431ba13464f42d646d19f22c"}
Jul 07 14:24:51.573991 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.573972    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xjtt9" event={"ID":"613a5efe-2555-4745-b39c-84ace21b125e","Type":"ContainerStarted","Data":"3f2a984d9aad167c08ff6117bfe3772f1d26bca70f63580929b0d71c81aa29a7"}
Jul 07 14:24:51.575252 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.575225    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8" event={"ID":"0a302bb9-9e67-4429-b601-da1ad433a129","Type":"ContainerStarted","Data":"3cd11ec1a1c573c1ccc25ec38fa0564194b6d8d2f8b6c74f1a052a0393131d3d"}
Jul 07 14:24:51.576367 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.576348    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mpmqh" event={"ID":"2a71b229-1fae-4b8a-aba1-31c039cce5f7","Type":"ContainerStarted","Data":"9c6d8b895cb2c828a06909e02e84ec4807d25aecc4c0a70c8b7ad75559d5d593"}
Jul 07 14:24:51.582916 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.582883    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-139.ec2.internal" podStartSLOduration=21.582872158 podStartE2EDuration="21.582872158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:51.582093797 +0000 UTC m=+23.609601906" watchObservedRunningTime="2026-07-07 14:24:51.582872158 +0000 UTC m=+23.610380266"
Jul 07 14:24:51.598878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.598843    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j9b2b" podStartSLOduration=2.618738408 podStartE2EDuration="22.598826671s" totalImagesPullingTime="19.980088263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:51.598552412 +0000 UTC m=+23.626060521" watchObservedRunningTime="2026-07-07 14:24:51.598826671 +0000 UTC m=+23.626334806"
Jul 07 14:24:51.642242 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.642191    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kz2tg" podStartSLOduration=2.686992921 podStartE2EDuration="22.642173588s" totalImagesPullingTime="19.955180667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:51.640922731 +0000 UTC m=+23.668430833" watchObservedRunningTime="2026-07-07 14:24:51.642173588 +0000 UTC m=+23.669681696"
Jul 07 14:24:51.660324 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.660279    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xjtt9" podStartSLOduration=2.686142374 podStartE2EDuration="22.660265659s" totalImagesPullingTime="19.974123285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:51.659914428 +0000 UTC m=+23.687422537" watchObservedRunningTime="2026-07-07 14:24:51.660265659 +0000 UTC m=+23.687773767"
Jul 07 14:24:51.681021 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.680952    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mpmqh" podStartSLOduration=2.557232308 podStartE2EDuration="22.680936236s" totalImagesPullingTime="20.123703928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:51.680759114 +0000 UTC m=+23.708267223" watchObservedRunningTime="2026-07-07 14:24:51.680936236 +0000 UTC m=+23.708444343"
Jul 07 14:24:51.696939 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:51.696883    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7hjnz" podStartSLOduration=2.729689469 podStartE2EDuration="22.696862045s" totalImagesPullingTime="19.967172576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:51.696763304 +0000 UTC m=+23.724271413" watchObservedRunningTime="2026-07-07 14:24:51.696862045 +0000 UTC m=+23.724370154"
Jul 07 14:24:52.462383 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:52.462344    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:52.462622 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:52.462471    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:52.462622 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:52.462543    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:52.462697 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:52.462672    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:52.581592 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:52.581564    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:24:52.582057 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:52.581951    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" event={"ID":"783ae988-c52f-431e-bdbe-bbd637aa6cba","Type":"ContainerStarted","Data":"44f5da9679efd7fe9b9e09b6b5567e54d88c83a77e52cbb37edaa71920c9df74"}
Jul 07 14:24:52.583236 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:52.583212    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f65s9" event={"ID":"0b421450-16c4-4694-a460-9a8354b21491","Type":"ContainerStarted","Data":"a436e953cd1f63a32da4fe0046e0b7990b80773f7a6eb41eb2c6b7f66b925b1e"}
Jul 07 14:24:52.874301 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:52.874272    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 14:24:53.453594 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:53.453491    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:24:52.874298601Z","UUID":"69602822-f566-4913-9b43-2986647ba678","Handler":null,"Name":"","Endpoint":""}
Jul 07 14:24:53.454821 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:53.454801    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 14:24:53.454930 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:53.454832    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 14:24:53.462120 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:53.462093    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:53.462233 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:53.462191    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:53.587346 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:53.587305    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8" event={"ID":"0a302bb9-9e67-4429-b601-da1ad433a129","Type":"ContainerStarted","Data":"f320106f2b4b484f52dd19a013fdd907cbc442469d3245671d529a677aed36e2"}
Jul 07 14:24:53.955369 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:53.955324    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:54.411778 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:54.411477    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:54.412297 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:54.412268    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:54.434107 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:54.434050    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f65s9" podStartSLOduration=5.502176844 podStartE2EDuration="25.434036554s" totalImagesPullingTime="19.93185971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:52.604168709 +0000 UTC m=+24.631676817" watchObservedRunningTime="2026-07-07 14:24:54.434036554 +0000 UTC m=+26.461544662"
Jul 07 14:24:54.466211 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:54.466183    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:54.466211 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:54.466206    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:54.466398 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:54.466280    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:54.466457 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:54.466405    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:54.592275 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:54.592243    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:24:54.592775 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:54.592671    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" event={"ID":"783ae988-c52f-431e-bdbe-bbd637aa6cba","Type":"ContainerStarted","Data":"b6775ca1139fca9f48dacef4241855b8126f0c9ecb9b9884bdef6104b7322ceb"}
Jul 07 14:24:54.595018 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:54.594987    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8" event={"ID":"0a302bb9-9e67-4429-b601-da1ad433a129","Type":"ContainerStarted","Data":"4e404c4b270e3b78b0f7c06eae0ef03271e347141f1cc0db5bf5728c19c2f618"}
Jul 07 14:24:54.595735 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:54.595709    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j9b2b"
Jul 07 14:24:54.641712 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:54.641652    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qntf8" podStartSLOduration=2.702253883 podStartE2EDuration="25.641630673s" totalImagesPullingTime="22.93937679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:54.622709123 +0000 UTC m=+26.650217231" watchObservedRunningTime="2026-07-07 14:24:54.641630673 +0000 UTC m=+26.669138782"
Jul 07 14:24:55.462757 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:55.462717    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:55.462940 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:55.462843    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:56.466452 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:56.466414    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:56.466452 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:56.466442    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:56.467099 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:56.466561    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:56.467099 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:56.466701    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:57.462699 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:57.462458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:57.462854 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:57.462784    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:57.609810 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:57.609787    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:24:57.610364 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:57.610166    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" event={"ID":"783ae988-c52f-431e-bdbe-bbd637aa6cba","Type":"ContainerStarted","Data":"9a6b2fb1eee6e94526e76354108e6033b8722f8319c3c2624bb08b0d5f40d506"}
Jul 07 14:24:57.610426 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:57.610407    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:57.610643 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:57.610622    2583 scope.go:117] "RemoveContainer" containerID="bea414efa316844f982c8dae7db9f9ce9209192ba08cd68143be61d257c59f12"
Jul 07 14:24:57.626287 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:57.626270    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:58.463494 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:58.463461    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:58.463700 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:58.463551    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:58.463700 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:58.463598    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:58.463700 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:58.463691    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:58.616642 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:58.616549    2583 generic.go:356] "Generic (PLEG): container finished" podID="4b9a4b09-d6c8-4340-873a-db98e632588c" containerID="36e397eccf073452f2a0c058f55acd6504ff2875ffba1ed7f9ebde2302f28714" exitCode=0
Jul 07 14:24:58.616642 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:58.616595    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8chjr" event={"ID":"4b9a4b09-d6c8-4340-873a-db98e632588c","Type":"ContainerDied","Data":"36e397eccf073452f2a0c058f55acd6504ff2875ffba1ed7f9ebde2302f28714"}
Jul 07 14:24:58.621432 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:58.621409    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:24:58.621819 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:58.621796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" event={"ID":"783ae988-c52f-431e-bdbe-bbd637aa6cba","Type":"ContainerStarted","Data":"39abd8b351111050c99734d5d497299f414ee7230d3bd3a3b9dea531653756d4"}
Jul 07 14:24:58.622017 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:58.621996    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:58.622135 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:58.622064    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:58.641599 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:58.641565    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:24:58.685561 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:58.685501    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2" podStartSLOduration=9.414496889 podStartE2EDuration="29.685485953s" totalImagesPullingTime="20.270989064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:58.68404912 +0000 UTC m=+30.711557229" watchObservedRunningTime="2026-07-07 14:24:58.685485953 +0000 UTC m=+30.712994060"
Jul 07 14:24:59.462247 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:59.462093    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:59.462683 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:59.462346    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:24:59.620313 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:59.620289    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hh5cg"]
Jul 07 14:24:59.620697 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:59.620465    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:24:59.620697 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:59.620620    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:24:59.621162 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:59.621058    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vlzfg"]
Jul 07 14:24:59.621260 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:59.621187    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:24:59.621308 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:59.621272    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:24:59.622274 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:59.622251    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hwrbj"]
Jul 07 14:24:59.626540 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:59.626524    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:24:59.626635 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:24:59.626565    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8chjr" event={"ID":"4b9a4b09-d6c8-4340-873a-db98e632588c","Type":"ContainerStarted","Data":"2e41528c14bceaeea995d55ee26b1609b5c38e1400648ec41f19a5a84a7d0aa4"}
Jul 07 14:24:59.626635 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:24:59.626615    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:25:00.633819 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:00.633771    2583 generic.go:356] "Generic (PLEG): container finished" podID="4b9a4b09-d6c8-4340-873a-db98e632588c" containerID="2e41528c14bceaeea995d55ee26b1609b5c38e1400648ec41f19a5a84a7d0aa4" exitCode=0
Jul 07 14:25:00.634373 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:00.633850    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8chjr" event={"ID":"4b9a4b09-d6c8-4340-873a-db98e632588c","Type":"ContainerDied","Data":"2e41528c14bceaeea995d55ee26b1609b5c38e1400648ec41f19a5a84a7d0aa4"}
Jul 07 14:25:01.463043 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:01.463013    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:25:01.463180 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:01.463046    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:25:01.463180 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:01.463013    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:25:01.463180 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:01.463132    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:25:01.463335 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:01.463179    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:25:01.463335 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:01.463297    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:25:01.638023 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:01.637952    2583 generic.go:356] "Generic (PLEG): container finished" podID="4b9a4b09-d6c8-4340-873a-db98e632588c" containerID="1f0e508059a432689435c833dfe6710bf57e5922c143d7f8639fcd25a35d0c4b" exitCode=0
Jul 07 14:25:01.638320 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:01.638020    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8chjr" event={"ID":"4b9a4b09-d6c8-4340-873a-db98e632588c","Type":"ContainerDied","Data":"1f0e508059a432689435c833dfe6710bf57e5922c143d7f8639fcd25a35d0c4b"}
Jul 07 14:25:02.188254 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:02.188217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:25:02.188431 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:02.188326    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:25:02.188431 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:02.188378    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret podName:4b62ed01-d6a2-41a9-8725-5da7f402e07c nodeName:}" failed. No retries permitted until 2026-07-07 14:25:34.18836501 +0000 UTC m=+66.215873096 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret") pod "global-pull-secret-syncer-hwrbj" (UID: "4b62ed01-d6a2-41a9-8725-5da7f402e07c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:25:02.289254 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:02.289216    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btfhr\" (UniqueName: \"kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr\") pod \"network-check-target-vlzfg\" (UID: \"12ffe0f4-f24b-4751-abd8-6996416bb666\") " pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:25:02.289254 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:02.289254    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:25:02.289496 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:02.289387    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:25:02.289496 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:02.289412    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:25:02.289496 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:02.289424    2583 projected.go:196] Error preparing data for projected volume kube-api-access-btfhr for pod openshift-network-diagnostics/network-check-target-vlzfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:25:02.289496 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:02.289472    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr podName:12ffe0f4-f24b-4751-abd8-6996416bb666 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:34.289458412 +0000 UTC m=+66.316966497 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-btfhr" (UniqueName: "kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr") pod "network-check-target-vlzfg" (UID: "12ffe0f4-f24b-4751-abd8-6996416bb666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:25:02.289496 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:02.289394    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:25:02.289685 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:02.289523    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs podName:b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:34.289509977 +0000 UTC m=+66.317018063 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs") pod "network-metrics-daemon-hh5cg" (UID: "b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:25:03.279874 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:03.279844    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kz2tg_81a0adae-7087-46ed-ab48-0fa69eaf7ba0/dns-node-resolver/0.log"
Jul 07 14:25:03.463025 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:03.462994    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:25:03.463025 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:03.463026    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:25:03.463259 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:03.463026    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:25:03.463259 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:03.463131    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh5cg" podUID="b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8"
Jul 07 14:25:03.463259 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:03.463200    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlzfg" podUID="12ffe0f4-f24b-4751-abd8-6996416bb666"
Jul 07 14:25:03.463391 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:03.463277    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwrbj" podUID="4b62ed01-d6a2-41a9-8725-5da7f402e07c"
Jul 07 14:25:03.850781 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:03.850753    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7hjnz_ce806fe6-2831-4f5b-b098-0ca02394d02b/node-ca/0.log"
Jul 07 14:25:04.854091 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:04.854060    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-139.ec2.internal" event="NodeReady"
Jul 07 14:25:04.854510 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:04.854194    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 14:25:05.462222 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:05.462178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:25:05.462222 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:05.462217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:25:05.462478 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:05.462217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:25:05.466457 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:05.466432    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 14:25:05.466611 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:05.466462    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:25:05.467516 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:05.467496    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:25:05.467623 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:05.467532    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p9bwj\""
Jul 07 14:25:05.467623 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:05.467490    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 14:25:05.467729 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:05.467708    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rzdvx\""
Jul 07 14:25:07.654225 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:07.654021    2583 generic.go:356] "Generic (PLEG): container finished" podID="4b9a4b09-d6c8-4340-873a-db98e632588c" containerID="f166db63c52db689aa0c4069140ce06a5d50c0e102841e56ef1d9c8132cef1ad" exitCode=0
Jul 07 14:25:07.654608 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:07.654105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8chjr" event={"ID":"4b9a4b09-d6c8-4340-873a-db98e632588c","Type":"ContainerDied","Data":"f166db63c52db689aa0c4069140ce06a5d50c0e102841e56ef1d9c8132cef1ad"}
Jul 07 14:25:08.659758 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:08.659722    2583 generic.go:356] "Generic (PLEG): container finished" podID="4b9a4b09-d6c8-4340-873a-db98e632588c" containerID="5b9ac8e058aa3b2fb978ddfc2a0723b4c8457b5d8fe02469c5db82d33fbd73eb" exitCode=0
Jul 07 14:25:08.660159 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:08.659768    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8chjr" event={"ID":"4b9a4b09-d6c8-4340-873a-db98e632588c","Type":"ContainerDied","Data":"5b9ac8e058aa3b2fb978ddfc2a0723b4c8457b5d8fe02469c5db82d33fbd73eb"}
Jul 07 14:25:09.665264 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:09.665224    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8chjr" event={"ID":"4b9a4b09-d6c8-4340-873a-db98e632588c","Type":"ContainerStarted","Data":"2b5865b24ae06a74ed625a05beb425fe333ea146a41347fbc5a4636aa1bfa27a"}
Jul 07 14:25:09.690665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:09.690616    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8chjr" podStartSLOduration=7.739547448 podStartE2EDuration="40.690599835s" totalImagesPullingTime="32.951052387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:09.689114973 +0000 UTC m=+41.716623080" watchObservedRunningTime="2026-07-07 14:25:09.690599835 +0000 UTC m=+41.718107944"
Jul 07 14:25:27.863858 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.863822    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77d5894fc5-fmv84"]
Jul 07 14:25:27.866160 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.866142    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:27.888267 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.888237    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 14:25:27.889197 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.889182    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 14:25:27.895913 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.895891    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 14:25:27.895913 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.895891    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5f4rp\""
Jul 07 14:25:27.903647 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.903624    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 14:25:27.911100 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.911075    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"]
Jul 07 14:25:27.912743 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.912727    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"
Jul 07 14:25:27.926744 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.926712    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j2gfl\""
Jul 07 14:25:27.926941 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.926914    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 14:25:27.927129 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.927098    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 14:25:27.927976 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.927940    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77d5894fc5-fmv84"]
Jul 07 14:25:27.962050 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.962013    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"]
Jul 07 14:25:27.969409 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.969380    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-image-registry-private-configuration\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:27.969567 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.969416    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt4cx\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-kube-api-access-bt4cx\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:27.969567 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.969440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-installation-pull-secrets\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:27.969567 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.969464    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5262e097-9359-4f92-a8e4-eb82cbd5bd59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6cj2l\" (UID: \"5262e097-9359-4f92-a8e4-eb82cbd5bd59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"
Jul 07 14:25:27.969567 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.969531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5262e097-9359-4f92-a8e4-eb82cbd5bd59-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6cj2l\" (UID: \"5262e097-9359-4f92-a8e4-eb82cbd5bd59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"
Jul 07 14:25:27.969567 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.969558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-certificates\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:27.969812 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.969582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7dbdb18-4e32-40de-804b-0ab487985af1-ca-trust-extracted\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:27.969812 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.969666    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-trusted-ca\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:27.969812 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.969701    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-bound-sa-token\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:27.969812 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:27.969750    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-tls\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.023303 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.023263    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vvsck"]
Jul 07 14:25:28.025075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.025059    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.028191 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.028167    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 14:25:28.028334 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.028207    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-82rv6\""
Jul 07 14:25:28.028747 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.028733    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 14:25:28.030800 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.030773    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lz46q"]
Jul 07 14:25:28.032513 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.032496    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lz46q"
Jul 07 14:25:28.035721 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.035698    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 14:25:28.036794 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.036779    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fpbkf\""
Jul 07 14:25:28.037038 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.037023    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 14:25:28.037100 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.037087    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 14:25:28.038908 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.038850    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77d5894fc5-fmv84"]
Jul 07 14:25:28.039109 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:28.039081    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-bt4cx registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-77d5894fc5-fmv84" podUID="d7dbdb18-4e32-40de-804b-0ab487985af1"
Jul 07 14:25:28.051894 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.051865    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vvsck"]
Jul 07 14:25:28.070456 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7dbdb18-4e32-40de-804b-0ab487985af1-ca-trust-extracted\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.070615 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-trusted-ca\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.070615 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-bound-sa-token\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.070615 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070586    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/536150c4-2e30-4b5a-a24e-ceb149440515-tmp-dir\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.070793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jw28\" (UniqueName: \"kubernetes.io/projected/536150c4-2e30-4b5a-a24e-ceb149440515-kube-api-access-9jw28\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.070793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070647    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mzzf\" (UniqueName: \"kubernetes.io/projected/75c7bb46-b20d-48f9-b4ff-17d80865ad59-kube-api-access-9mzzf\") pod \"ingress-canary-lz46q\" (UID: \"75c7bb46-b20d-48f9-b4ff-17d80865ad59\") " pod="openshift-ingress-canary/ingress-canary-lz46q"
Jul 07 14:25:28.070793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-tls\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.070793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75c7bb46-b20d-48f9-b4ff-17d80865ad59-cert\") pod \"ingress-canary-lz46q\" (UID: \"75c7bb46-b20d-48f9-b4ff-17d80865ad59\") " pod="openshift-ingress-canary/ingress-canary-lz46q"
Jul 07 14:25:28.070793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-image-registry-private-configuration\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.070793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt4cx\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-kube-api-access-bt4cx\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.071119 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-installation-pull-secrets\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.071119 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5262e097-9359-4f92-a8e4-eb82cbd5bd59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6cj2l\" (UID: \"5262e097-9359-4f92-a8e4-eb82cbd5bd59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"
Jul 07 14:25:28.071119 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/536150c4-2e30-4b5a-a24e-ceb149440515-config-volume\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.071119 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070908    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/536150c4-2e30-4b5a-a24e-ceb149440515-metrics-tls\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.071119 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070947    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5262e097-9359-4f92-a8e4-eb82cbd5bd59-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6cj2l\" (UID: \"5262e097-9359-4f92-a8e4-eb82cbd5bd59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"
Jul 07 14:25:28.071119 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.070999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-certificates\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.071381 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.071366    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7dbdb18-4e32-40de-804b-0ab487985af1-ca-trust-extracted\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.072843 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.072345    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-certificates\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.072843 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.072631    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-trusted-ca\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.072843 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.072760    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5262e097-9359-4f92-a8e4-eb82cbd5bd59-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6cj2l\" (UID: \"5262e097-9359-4f92-a8e4-eb82cbd5bd59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"
Jul 07 14:25:28.075585 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.074602    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lz46q"]
Jul 07 14:25:28.078074 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.076582    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-image-registry-private-configuration\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.078074 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.076628    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5262e097-9359-4f92-a8e4-eb82cbd5bd59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6cj2l\" (UID: \"5262e097-9359-4f92-a8e4-eb82cbd5bd59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"
Jul 07 14:25:28.078074 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.076938    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-installation-pull-secrets\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.078829 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.078811    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-tls\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.084190 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.084162    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np"]
Jul 07 14:25:28.086752 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.086734    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np"
Jul 07 14:25:28.087349 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.087325    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-bound-sa-token\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.092570 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.092549    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-s5vv5\""
Jul 07 14:25:28.092676 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.092659    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 14:25:28.094973 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.094938    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-vdmrz"]
Jul 07 14:25:28.096648 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.096632    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-vdmrz"
Jul 07 14:25:28.099049 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.099031    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54b97d9bf8-jgxgw"]
Jul 07 14:25:28.100820 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.100781    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.102428 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.102408    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np"]
Jul 07 14:25:28.107357 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.107337    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 14:25:28.107445 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.107390    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 14:25:28.107512 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.107337    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 14:25:28.108004 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.107891    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 14:25:28.108909 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.108859    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 14:25:28.109024 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.108910    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-k5hhp\""
Jul 07 14:25:28.109024 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.108991    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 14:25:28.109791 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.109776    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n84t7\""
Jul 07 14:25:28.109909 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.109886    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 14:25:28.110518 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.110499    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt4cx\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-kube-api-access-bt4cx\") pod \"image-registry-77d5894fc5-fmv84\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") " pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.121515 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.121491    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-vdmrz"]
Jul 07 14:25:28.147208 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.147178    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b97d9bf8-jgxgw"]
Jul 07 14:25:28.172031 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.171992    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gvdln"]
Jul 07 14:25:28.172217 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/536150c4-2e30-4b5a-a24e-ceb149440515-tmp-dir\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.172274 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172245    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jw28\" (UniqueName: \"kubernetes.io/projected/536150c4-2e30-4b5a-a24e-ceb149440515-kube-api-access-9jw28\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.172321 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mzzf\" (UniqueName: \"kubernetes.io/projected/75c7bb46-b20d-48f9-b4ff-17d80865ad59-kube-api-access-9mzzf\") pod \"ingress-canary-lz46q\" (UID: \"75c7bb46-b20d-48f9-b4ff-17d80865ad59\") " pod="openshift-ingress-canary/ingress-canary-lz46q"
Jul 07 14:25:28.172321 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172306    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-service-ca\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.172421 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75c7bb46-b20d-48f9-b4ff-17d80865ad59-cert\") pod \"ingress-canary-lz46q\" (UID: \"75c7bb46-b20d-48f9-b4ff-17d80865ad59\") " pod="openshift-ingress-canary/ingress-canary-lz46q"
Jul 07 14:25:28.172421 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b91c417b-b2c3-41bb-a4d1-31cb5b201563-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vp8np\" (UID: \"b91c417b-b2c3-41bb-a4d1-31cb5b201563\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np"
Jul 07 14:25:28.172421 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172400    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-serving-cert\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.172546 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-oauth-config\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.172591 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-console-config\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.172634 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172619    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-oauth-serving-cert\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.172672 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172647    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/536150c4-2e30-4b5a-a24e-ceb149440515-tmp-dir\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.172672 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/536150c4-2e30-4b5a-a24e-ceb149440515-config-volume\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.172741 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172697    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnb9j\" (UniqueName: \"kubernetes.io/projected/5b60c7e5-41e8-429e-be46-a07b389a3358-kube-api-access-nnb9j\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.172741 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/536150c4-2e30-4b5a-a24e-ceb149440515-metrics-tls\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.172827 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.172751    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw5fg\" (UniqueName: \"kubernetes.io/projected/3b709fff-2821-4969-8132-611f41fc4de2-kube-api-access-qw5fg\") pod \"downloads-685bfb5f64-vdmrz\" (UID: \"3b709fff-2821-4969-8132-611f41fc4de2\") " pod="openshift-console/downloads-685bfb5f64-vdmrz"
Jul 07 14:25:28.173163 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.173137    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/536150c4-2e30-4b5a-a24e-ceb149440515-config-volume\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.174360 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.174344    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.175006 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.174986    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75c7bb46-b20d-48f9-b4ff-17d80865ad59-cert\") pod \"ingress-canary-lz46q\" (UID: \"75c7bb46-b20d-48f9-b4ff-17d80865ad59\") " pod="openshift-ingress-canary/ingress-canary-lz46q"
Jul 07 14:25:28.175096 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.175050    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/536150c4-2e30-4b5a-a24e-ceb149440515-metrics-tls\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.177128 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.177110    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ms4k\""
Jul 07 14:25:28.177898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.177876    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 14:25:28.178051 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.177926    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 14:25:28.179533 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.179513    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f995d989d-6skxq"]
Jul 07 14:25:28.181469 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.181449    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.182874 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.182857    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 14:25:28.193576 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.193556    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 14:25:28.197820 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.197795    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mzzf\" (UniqueName: \"kubernetes.io/projected/75c7bb46-b20d-48f9-b4ff-17d80865ad59-kube-api-access-9mzzf\") pod \"ingress-canary-lz46q\" (UID: \"75c7bb46-b20d-48f9-b4ff-17d80865ad59\") " pod="openshift-ingress-canary/ingress-canary-lz46q"
Jul 07 14:25:28.198434 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.198415    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gvdln"]
Jul 07 14:25:28.199773 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.199755    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jw28\" (UniqueName: \"kubernetes.io/projected/536150c4-2e30-4b5a-a24e-ceb149440515-kube-api-access-9jw28\") pod \"dns-default-vvsck\" (UID: \"536150c4-2e30-4b5a-a24e-ceb149440515\") " pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.208526 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.208497    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f995d989d-6skxq"]
Jul 07 14:25:28.221461 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.221438    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"
Jul 07 14:25:28.273662 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.273628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-bound-sa-token\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.273662 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.273658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-ca-trust-extracted\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.273884 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.273686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw5fg\" (UniqueName: \"kubernetes.io/projected/3b709fff-2821-4969-8132-611f41fc4de2-kube-api-access-qw5fg\") pod \"downloads-685bfb5f64-vdmrz\" (UID: \"3b709fff-2821-4969-8132-611f41fc4de2\") " pod="openshift-console/downloads-685bfb5f64-vdmrz"
Jul 07 14:25:28.273884 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.273754    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-registry-certificates\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.273884 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.273833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/30a0365e-e775-4d29-81d4-a86a2ece5931-data-volume\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.274043 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.273919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/30a0365e-e775-4d29-81d4-a86a2ece5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.274043 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.273953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-service-ca\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.274043 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.273992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b91c417b-b2c3-41bb-a4d1-31cb5b201563-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vp8np\" (UID: \"b91c417b-b2c3-41bb-a4d1-31cb5b201563\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np"
Jul 07 14:25:28.274043 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-image-registry-private-configuration\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.274043 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx7zn\" (UniqueName: \"kubernetes.io/projected/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-kube-api-access-hx7zn\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.274266 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-console-config\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.274266 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnb9j\" (UniqueName: \"kubernetes.io/projected/5b60c7e5-41e8-429e-be46-a07b389a3358-kube-api-access-nnb9j\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.274266 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274108    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/30a0365e-e775-4d29-81d4-a86a2ece5931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.274266 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274215    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4jjv\" (UniqueName: \"kubernetes.io/projected/30a0365e-e775-4d29-81d4-a86a2ece5931-kube-api-access-k4jjv\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.274266 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274252    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-installation-pull-secrets\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.274486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-oauth-config\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.274486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/30a0365e-e775-4d29-81d4-a86a2ece5931-crio-socket\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.274486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-trusted-ca\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.274486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-serving-cert\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.274666 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-oauth-serving-cert\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.274666 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274535    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-registry-tls\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.274764 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274667    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-service-ca\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.274819 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.274784    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-console-config\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.275215 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.275177    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-oauth-serving-cert\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.276748 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.276726    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-oauth-config\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.276912 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.276893    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b91c417b-b2c3-41bb-a4d1-31cb5b201563-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vp8np\" (UID: \"b91c417b-b2c3-41bb-a4d1-31cb5b201563\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np"
Jul 07 14:25:28.277107 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.277087    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-serving-cert\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.283387 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.283357    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw5fg\" (UniqueName: \"kubernetes.io/projected/3b709fff-2821-4969-8132-611f41fc4de2-kube-api-access-qw5fg\") pod \"downloads-685bfb5f64-vdmrz\" (UID: \"3b709fff-2821-4969-8132-611f41fc4de2\") " pod="openshift-console/downloads-685bfb5f64-vdmrz"
Jul 07 14:25:28.287774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.287750    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnb9j\" (UniqueName: \"kubernetes.io/projected/5b60c7e5-41e8-429e-be46-a07b389a3358-kube-api-access-nnb9j\") pod \"console-54b97d9bf8-jgxgw\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") " pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.338106 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.338078    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-82rv6\""
Jul 07 14:25:28.343769 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.343728    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:28.347981 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.347940    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fpbkf\""
Jul 07 14:25:28.351035 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.351012    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lz46q"
Jul 07 14:25:28.375726 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.375640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-registry-certificates\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.375726 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.375719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/30a0365e-e775-4d29-81d4-a86a2ece5931-data-volume\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.375936 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.375753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/30a0365e-e775-4d29-81d4-a86a2ece5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.375936 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.375787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-image-registry-private-configuration\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.375936 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.375818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx7zn\" (UniqueName: \"kubernetes.io/projected/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-kube-api-access-hx7zn\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.375936 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.375859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/30a0365e-e775-4d29-81d4-a86a2ece5931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.375936 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.375882    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4jjv\" (UniqueName: \"kubernetes.io/projected/30a0365e-e775-4d29-81d4-a86a2ece5931-kube-api-access-k4jjv\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.375936 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.375914    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-installation-pull-secrets\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.376235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.375996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/30a0365e-e775-4d29-81d4-a86a2ece5931-crio-socket\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.376235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.376020    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-trusted-ca\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.376235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.376053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-registry-tls\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.376235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.376081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-bound-sa-token\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.376235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.376108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-ca-trust-extracted\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.376235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.376118    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/30a0365e-e775-4d29-81d4-a86a2ece5931-data-volume\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.376596 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.376575    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/30a0365e-e775-4d29-81d4-a86a2ece5931-crio-socket\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.376773 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.376744    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-registry-certificates\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.377276 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.377202    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-ca-trust-extracted\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.377276 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.377230    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-trusted-ca\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.378757 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.378733    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-image-registry-private-configuration\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.379074 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.379053    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 14:25:28.379167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.379054    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-installation-pull-secrets\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.379167 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.379096    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 14:25:28.380264 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.380244    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-registry-tls\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.388514 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.386926    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/30a0365e-e775-4d29-81d4-a86a2ece5931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.388823 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.388722    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l"]
Jul 07 14:25:28.389761 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.389664    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/30a0365e-e775-4d29-81d4-a86a2ece5931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.390502 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.390454    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-bound-sa-token\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.392080 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.391894    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 14:25:28.394905 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:28.394730    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5262e097_9359_4f92_a8e4_eb82cbd5bd59.slice/crio-bb34d2524cefbe62779e8f5b52d540f0e21a507b9db580f08f51063ebc7d6b4b WatchSource:0}: Error finding container bb34d2524cefbe62779e8f5b52d540f0e21a507b9db580f08f51063ebc7d6b4b: Status 404 returned error can't find the container with id bb34d2524cefbe62779e8f5b52d540f0e21a507b9db580f08f51063ebc7d6b4b
Jul 07 14:25:28.398644 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.398590    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx7zn\" (UniqueName: \"kubernetes.io/projected/8ffdf414-4820-4169-8f7b-6fb25f9f8ad6-kube-api-access-hx7zn\") pod \"image-registry-6f995d989d-6skxq\" (UID: \"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6\") " pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.409998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.404661    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-s5vv5\""
Jul 07 14:25:28.409998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.404954    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 14:25:28.411574 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.411372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np"
Jul 07 14:25:28.411997 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.411881    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-k5hhp\""
Jul 07 14:25:28.414083 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.414060    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4jjv\" (UniqueName: \"kubernetes.io/projected/30a0365e-e775-4d29-81d4-a86a2ece5931-kube-api-access-k4jjv\") pod \"insights-runtime-extractor-gvdln\" (UID: \"30a0365e-e775-4d29-81d4-a86a2ece5931\") " pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.419533 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.419498    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-vdmrz"
Jul 07 14:25:28.421726 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.421457    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n84t7\""
Jul 07 14:25:28.429721 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.429669    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:28.498482 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.498446    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ms4k\""
Jul 07 14:25:28.504724 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.504265    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5f4rp\""
Jul 07 14:25:28.504724 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.504501    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gvdln"
Jul 07 14:25:28.509207 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.509174    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:28.520249 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.519760    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vvsck"]
Jul 07 14:25:28.541996 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.541863    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lz46q"]
Jul 07 14:25:28.544465 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:28.544436    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c7bb46_b20d_48f9_b4ff_17d80865ad59.slice/crio-a9254b8990211ad558d5cf22b14e29270d4462d46a070006f226351754d40da9 WatchSource:0}: Error finding container a9254b8990211ad558d5cf22b14e29270d4462d46a070006f226351754d40da9: Status 404 returned error can't find the container with id a9254b8990211ad558d5cf22b14e29270d4462d46a070006f226351754d40da9
Jul 07 14:25:28.636261 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.636172    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np"]
Jul 07 14:25:28.642068 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:28.642025    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91c417b_b2c3_41bb_a4d1_31cb5b201563.slice/crio-32b54d4e7efe2eb16537a4277d0cb83d57c6689229102465f6ae192614873a7e WatchSource:0}: Error finding container 32b54d4e7efe2eb16537a4277d0cb83d57c6689229102465f6ae192614873a7e: Status 404 returned error can't find the container with id 32b54d4e7efe2eb16537a4277d0cb83d57c6689229102465f6ae192614873a7e
Jul 07 14:25:28.668767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.668728    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b97d9bf8-jgxgw"]
Jul 07 14:25:28.671985 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.671887    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-vdmrz"]
Jul 07 14:25:28.675322 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:28.673806    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b60c7e5_41e8_429e_be46_a07b389a3358.slice/crio-db59b1a0cd162855ea362ae73973c1350dc186615bb9bece1917636d1bf33244 WatchSource:0}: Error finding container db59b1a0cd162855ea362ae73973c1350dc186615bb9bece1917636d1bf33244: Status 404 returned error can't find the container with id db59b1a0cd162855ea362ae73973c1350dc186615bb9bece1917636d1bf33244
Jul 07 14:25:28.676737 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:28.676702    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b709fff_2821_4969_8132_611f41fc4de2.slice/crio-b47679ade6f6a0fdaf018c39f8eece6df9a86ff6b7f0b6d5fd398035a6926525 WatchSource:0}: Error finding container b47679ade6f6a0fdaf018c39f8eece6df9a86ff6b7f0b6d5fd398035a6926525: Status 404 returned error can't find the container with id b47679ade6f6a0fdaf018c39f8eece6df9a86ff6b7f0b6d5fd398035a6926525
Jul 07 14:25:28.698533 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.698501    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gvdln"]
Jul 07 14:25:28.701950 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:28.701924    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a0365e_e775_4d29_81d4_a86a2ece5931.slice/crio-3f75c01afb82ce3eafccb805c5d08282ae601ad4b8e3b49e97519551b14aede5 WatchSource:0}: Error finding container 3f75c01afb82ce3eafccb805c5d08282ae601ad4b8e3b49e97519551b14aede5: Status 404 returned error can't find the container with id 3f75c01afb82ce3eafccb805c5d08282ae601ad4b8e3b49e97519551b14aede5
Jul 07 14:25:28.712647 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.712618    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lz46q" event={"ID":"75c7bb46-b20d-48f9-b4ff-17d80865ad59","Type":"ContainerStarted","Data":"a9254b8990211ad558d5cf22b14e29270d4462d46a070006f226351754d40da9"}
Jul 07 14:25:28.713651 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.713632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvdln" event={"ID":"30a0365e-e775-4d29-81d4-a86a2ece5931","Type":"ContainerStarted","Data":"3f75c01afb82ce3eafccb805c5d08282ae601ad4b8e3b49e97519551b14aede5"}
Jul 07 14:25:28.714617 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.714591    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vvsck" event={"ID":"536150c4-2e30-4b5a-a24e-ceb149440515","Type":"ContainerStarted","Data":"ef8d608b6368c980ea0e03c98890cedf71988aacc9534b6817b8432fbe6fbf03"}
Jul 07 14:25:28.715861 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.715839    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-vdmrz" event={"ID":"3b709fff-2821-4969-8132-611f41fc4de2","Type":"ContainerStarted","Data":"b47679ade6f6a0fdaf018c39f8eece6df9a86ff6b7f0b6d5fd398035a6926525"}
Jul 07 14:25:28.717075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.717050    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np" event={"ID":"b91c417b-b2c3-41bb-a4d1-31cb5b201563","Type":"ContainerStarted","Data":"32b54d4e7efe2eb16537a4277d0cb83d57c6689229102465f6ae192614873a7e"}
Jul 07 14:25:28.718342 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.718317    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b97d9bf8-jgxgw" event={"ID":"5b60c7e5-41e8-429e-be46-a07b389a3358","Type":"ContainerStarted","Data":"db59b1a0cd162855ea362ae73973c1350dc186615bb9bece1917636d1bf33244"}
Jul 07 14:25:28.719658 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.719610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l" event={"ID":"5262e097-9359-4f92-a8e4-eb82cbd5bd59","Type":"ContainerStarted","Data":"bb34d2524cefbe62779e8f5b52d540f0e21a507b9db580f08f51063ebc7d6b4b"}
Jul 07 14:25:28.719758 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.719679    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.722275 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.722255    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f995d989d-6skxq"]
Jul 07 14:25:28.725376 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:28.725354    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ffdf414_4820_4169_8f7b_6fb25f9f8ad6.slice/crio-af0fd0636a27067829ff9531ede0759078d6f3b8220d4e9dc6111d9593c2f9e6 WatchSource:0}: Error finding container af0fd0636a27067829ff9531ede0759078d6f3b8220d4e9dc6111d9593c2f9e6: Status 404 returned error can't find the container with id af0fd0636a27067829ff9531ede0759078d6f3b8220d4e9dc6111d9593c2f9e6
Jul 07 14:25:28.726222 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.726196    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:28.778703 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.778674    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-certificates\") pod \"d7dbdb18-4e32-40de-804b-0ab487985af1\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") "
Jul 07 14:25:28.778836 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.778711    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-bound-sa-token\") pod \"d7dbdb18-4e32-40de-804b-0ab487985af1\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") "
Jul 07 14:25:28.778836 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.778759    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-tls\") pod \"d7dbdb18-4e32-40de-804b-0ab487985af1\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") "
Jul 07 14:25:28.778836 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.778781    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-installation-pull-secrets\") pod \"d7dbdb18-4e32-40de-804b-0ab487985af1\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") "
Jul 07 14:25:28.778836 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.778818    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt4cx\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-kube-api-access-bt4cx\") pod \"d7dbdb18-4e32-40de-804b-0ab487985af1\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") "
Jul 07 14:25:28.779143 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.778846    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-image-registry-private-configuration\") pod \"d7dbdb18-4e32-40de-804b-0ab487985af1\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") "
Jul 07 14:25:28.779143 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.778883    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-trusted-ca\") pod \"d7dbdb18-4e32-40de-804b-0ab487985af1\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") "
Jul 07 14:25:28.779143 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.778917    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7dbdb18-4e32-40de-804b-0ab487985af1-ca-trust-extracted\") pod \"d7dbdb18-4e32-40de-804b-0ab487985af1\" (UID: \"d7dbdb18-4e32-40de-804b-0ab487985af1\") "
Jul 07 14:25:28.779371 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.779341    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7dbdb18-4e32-40de-804b-0ab487985af1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d7dbdb18-4e32-40de-804b-0ab487985af1" (UID: "d7dbdb18-4e32-40de-804b-0ab487985af1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:25:28.779464 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.779437    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d7dbdb18-4e32-40de-804b-0ab487985af1" (UID: "d7dbdb18-4e32-40de-804b-0ab487985af1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:25:28.779519 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.779471    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d7dbdb18-4e32-40de-804b-0ab487985af1" (UID: "d7dbdb18-4e32-40de-804b-0ab487985af1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:25:28.781334 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.781307    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-kube-api-access-bt4cx" (OuterVolumeSpecName: "kube-api-access-bt4cx") pod "d7dbdb18-4e32-40de-804b-0ab487985af1" (UID: "d7dbdb18-4e32-40de-804b-0ab487985af1"). InnerVolumeSpecName "kube-api-access-bt4cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:25:28.781334 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.781315    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d7dbdb18-4e32-40de-804b-0ab487985af1" (UID: "d7dbdb18-4e32-40de-804b-0ab487985af1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:25:28.781580 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.781553    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d7dbdb18-4e32-40de-804b-0ab487985af1" (UID: "d7dbdb18-4e32-40de-804b-0ab487985af1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:25:28.781693 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.781651    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d7dbdb18-4e32-40de-804b-0ab487985af1" (UID: "d7dbdb18-4e32-40de-804b-0ab487985af1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:25:28.781693 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.781673    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d7dbdb18-4e32-40de-804b-0ab487985af1" (UID: "d7dbdb18-4e32-40de-804b-0ab487985af1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:25:28.879693 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.879658    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-tls\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:25:28.879693 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.879691    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-installation-pull-secrets\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:25:28.880146 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.879705    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt4cx\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-kube-api-access-bt4cx\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:25:28.880146 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.879715    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7dbdb18-4e32-40de-804b-0ab487985af1-image-registry-private-configuration\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:25:28.880146 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.879725    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-trusted-ca\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:25:28.880146 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.879734    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7dbdb18-4e32-40de-804b-0ab487985af1-ca-trust-extracted\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:25:28.880146 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.879742    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7dbdb18-4e32-40de-804b-0ab487985af1-registry-certificates\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:25:28.880146 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:28.879751    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7dbdb18-4e32-40de-804b-0ab487985af1-bound-sa-token\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:25:29.737990 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:29.737212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d5894fc5-fmv84"
Jul 07 14:25:29.738792 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:29.738237    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f995d989d-6skxq" event={"ID":"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6","Type":"ContainerStarted","Data":"c7317c2b25b8c93f2e8d76683b2ba112edc92028fd08a09c21b871016555c20a"}
Jul 07 14:25:29.738792 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:29.738305    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f995d989d-6skxq" event={"ID":"8ffdf414-4820-4169-8f7b-6fb25f9f8ad6","Type":"ContainerStarted","Data":"af0fd0636a27067829ff9531ede0759078d6f3b8220d4e9dc6111d9593c2f9e6"}
Jul 07 14:25:29.738792 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:29.738357    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:29.830440 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:29.827373    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f995d989d-6skxq" podStartSLOduration=1.827348368 podStartE2EDuration="1.827348368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:29.797124811 +0000 UTC m=+61.824632920" watchObservedRunningTime="2026-07-07 14:25:29.827348368 +0000 UTC m=+61.854856471"
Jul 07 14:25:29.838059 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:29.838032    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77d5894fc5-fmv84"]
Jul 07 14:25:29.842904 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:29.842879    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77d5894fc5-fmv84"]
Jul 07 14:25:30.030084 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.028860    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-785d885946-msjq9"]
Jul 07 14:25:30.044532 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.044048    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.054326 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.051444    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785d885946-msjq9"]
Jul 07 14:25:30.057373 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.057347    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 14:25:30.091053 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.091006    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-serving-cert\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.091053 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.091054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-oauth-config\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.091324 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.091102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x22f6\" (UniqueName: \"kubernetes.io/projected/f956db00-b20d-46b3-9a46-ad4c01bef57a-kube-api-access-x22f6\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.091324 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.091167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-config\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.091324 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.091199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-service-ca\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.091324 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.091223    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-trusted-ca-bundle\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.091324 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.091252    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-oauth-serving-cert\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.193104 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.192329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x22f6\" (UniqueName: \"kubernetes.io/projected/f956db00-b20d-46b3-9a46-ad4c01bef57a-kube-api-access-x22f6\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.193104 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.192420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-config\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.193104 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.192464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-service-ca\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.193104 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.192486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-trusted-ca-bundle\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.193104 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.192517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-oauth-serving-cert\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.193104 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.192587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-serving-cert\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.193104 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.192611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-oauth-config\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.194204 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.193650    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-trusted-ca-bundle\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.194204 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.193719    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-config\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.194204 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.193952    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-oauth-serving-cert\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.194204 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.194047    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-service-ca\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.201595 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.201543    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-serving-cert\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.213380 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.213329    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-oauth-config\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.222503 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.222429    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x22f6\" (UniqueName: \"kubernetes.io/projected/f956db00-b20d-46b3-9a46-ad4c01bef57a-kube-api-access-x22f6\") pod \"console-785d885946-msjq9\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") " pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.365547 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.365069    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:30.470528 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.470278    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7dbdb18-4e32-40de-804b-0ab487985af1" path="/var/lib/kubelet/pods/d7dbdb18-4e32-40de-804b-0ab487985af1/volumes"
Jul 07 14:25:30.671725 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:30.671651    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7z9z2"
Jul 07 14:25:34.231821 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.231742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:25:34.234391 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.234361    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:25:34.244600 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.244572    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b62ed01-d6a2-41a9-8725-5da7f402e07c-original-pull-secret\") pod \"global-pull-secret-syncer-hwrbj\" (UID: \"4b62ed01-d6a2-41a9-8725-5da7f402e07c\") " pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:25:34.287251 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.287203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwrbj"
Jul 07 14:25:34.333527 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.332938    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btfhr\" (UniqueName: \"kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr\") pod \"network-check-target-vlzfg\" (UID: \"12ffe0f4-f24b-4751-abd8-6996416bb666\") " pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:25:34.333527 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.333010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:25:34.336048 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.335783    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:25:34.336048 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.335791    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 14:25:34.346730 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.346473    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 14:25:34.346883 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.346862    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8-metrics-certs\") pod \"network-metrics-daemon-hh5cg\" (UID: \"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8\") " pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:25:34.357796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.357766    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btfhr\" (UniqueName: \"kubernetes.io/projected/12ffe0f4-f24b-4751-abd8-6996416bb666-kube-api-access-btfhr\") pod \"network-check-target-vlzfg\" (UID: \"12ffe0f4-f24b-4751-abd8-6996416bb666\") " pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:25:34.578716 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.578640    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p9bwj\""
Jul 07 14:25:34.583910 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.583888    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rzdvx\""
Jul 07 14:25:34.584898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.584881    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh5cg"
Jul 07 14:25:34.592557 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:34.592536    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:25:35.716047 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:35.715944    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785d885946-msjq9"]
Jul 07 14:25:36.233077 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:36.233049    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf956db00_b20d_46b3_9a46_ad4c01bef57a.slice/crio-e9be5e51f25224d4bb456d2cd924223ba04dd70f47f3b3ccee0018f64681fb05 WatchSource:0}: Error finding container e9be5e51f25224d4bb456d2cd924223ba04dd70f47f3b3ccee0018f64681fb05: Status 404 returned error can't find the container with id e9be5e51f25224d4bb456d2cd924223ba04dd70f47f3b3ccee0018f64681fb05
Jul 07 14:25:36.778439 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:36.778402    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lz46q" event={"ID":"75c7bb46-b20d-48f9-b4ff-17d80865ad59","Type":"ContainerStarted","Data":"a2f3a4fdc6c57d9c7db62da05ad1b14ad3362e7da72b22a48a741a60987d8071"}
Jul 07 14:25:36.781567 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:36.781474    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785d885946-msjq9" event={"ID":"f956db00-b20d-46b3-9a46-ad4c01bef57a","Type":"ContainerStarted","Data":"e9be5e51f25224d4bb456d2cd924223ba04dd70f47f3b3ccee0018f64681fb05"}
Jul 07 14:25:36.851860 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:36.842570    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hwrbj"]
Jul 07 14:25:36.867245 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:36.865829    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hh5cg"]
Jul 07 14:25:36.874060 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:36.874002    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99c1ef1_74b3_4fd8_b8d1_0842c3c92dc8.slice/crio-7e66b63867f632b423f579661b6053b3b0e5ff9b7f880e62d35bfe3fbc8170b7 WatchSource:0}: Error finding container 7e66b63867f632b423f579661b6053b3b0e5ff9b7f880e62d35bfe3fbc8170b7: Status 404 returned error can't find the container with id 7e66b63867f632b423f579661b6053b3b0e5ff9b7f880e62d35bfe3fbc8170b7
Jul 07 14:25:36.888153 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:36.888082    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vlzfg"]
Jul 07 14:25:36.893139 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:36.893092    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ffe0f4_f24b_4751_abd8_6996416bb666.slice/crio-21a4cfab646c79e6777ff1f8355eaa0416b2da5f953acb73d9cc01f6f6e98c5a WatchSource:0}: Error finding container 21a4cfab646c79e6777ff1f8355eaa0416b2da5f953acb73d9cc01f6f6e98c5a: Status 404 returned error can't find the container with id 21a4cfab646c79e6777ff1f8355eaa0416b2da5f953acb73d9cc01f6f6e98c5a
Jul 07 14:25:37.790218 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.790099    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvdln" event={"ID":"30a0365e-e775-4d29-81d4-a86a2ece5931","Type":"ContainerStarted","Data":"6da864a6851a82815f565c42037ea1813ee25dc47d538ed65957cfe5ce533ee9"}
Jul 07 14:25:37.794128 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.793128    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vvsck" event={"ID":"536150c4-2e30-4b5a-a24e-ceb149440515","Type":"ContainerStarted","Data":"9387cf0964b4c5f92df9188c9e4cd0c8c11eda416251df121a3f73c6081ea45e"}
Jul 07 14:25:37.794128 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.793195    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vvsck" event={"ID":"536150c4-2e30-4b5a-a24e-ceb149440515","Type":"ContainerStarted","Data":"ecdc2f0e69c758116550abbb54f2e25d6ae7ca222e26522bf9e5ff411efeab6b"}
Jul 07 14:25:37.794128 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.794056    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:37.798065 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.797130    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np" event={"ID":"b91c417b-b2c3-41bb-a4d1-31cb5b201563","Type":"ContainerStarted","Data":"2d790dfcd12ea69e89de039ab2272cae3106bf8bf64a7dd8f7d08427621b4ea9"}
Jul 07 14:25:37.798065 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.797983    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np"
Jul 07 14:25:37.800498 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.800420    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hh5cg" event={"ID":"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8","Type":"ContainerStarted","Data":"7e66b63867f632b423f579661b6053b3b0e5ff9b7f880e62d35bfe3fbc8170b7"}
Jul 07 14:25:37.802075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.802008    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vlzfg" event={"ID":"12ffe0f4-f24b-4751-abd8-6996416bb666","Type":"ContainerStarted","Data":"21a4cfab646c79e6777ff1f8355eaa0416b2da5f953acb73d9cc01f6f6e98c5a"}
Jul 07 14:25:37.805527 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.805459    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np"
Jul 07 14:25:37.806286 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.805767    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b97d9bf8-jgxgw" event={"ID":"5b60c7e5-41e8-429e-be46-a07b389a3358","Type":"ContainerStarted","Data":"6ce8c4f1d57f5538bc1d7528892c133b09b0d1dd40635c98d151d7a12a39a80e"}
Jul 07 14:25:37.808329 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.808271    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l" event={"ID":"5262e097-9359-4f92-a8e4-eb82cbd5bd59","Type":"ContainerStarted","Data":"53f8db5faaa80033eb4d838ab8b93a4101f54eb3355736cde11dbdf24e392423"}
Jul 07 14:25:37.811724 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.811130    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785d885946-msjq9" event={"ID":"f956db00-b20d-46b3-9a46-ad4c01bef57a","Type":"ContainerStarted","Data":"592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949"}
Jul 07 14:25:37.814061 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.813941    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hwrbj" event={"ID":"4b62ed01-d6a2-41a9-8725-5da7f402e07c","Type":"ContainerStarted","Data":"9c4017488e6603e67e1add4f12c3a3716443225214303b077bf326d57b59b417"}
Jul 07 14:25:37.832950 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.832289    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vvsck" podStartSLOduration=3.140637325 podStartE2EDuration="10.832265078s" totalImagesPullingTime="7.691627753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:37.828812938 +0000 UTC m=+69.856321046" watchObservedRunningTime="2026-07-07 14:25:37.832265078 +0000 UTC m=+69.859773180"
Jul 07 14:25:37.956722 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.956653    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vp8np" podStartSLOduration=3.043224981 podStartE2EDuration="9.956629069s" totalImagesPullingTime="6.913404088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:37.953400154 +0000 UTC m=+69.980908263" watchObservedRunningTime="2026-07-07 14:25:37.956629069 +0000 UTC m=+69.984137179"
Jul 07 14:25:37.957707 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.957660    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lz46q" podStartSLOduration=3.274818223 podStartE2EDuration="10.957641548s" totalImagesPullingTime="7.682823325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:37.889138044 +0000 UTC m=+69.916646152" watchObservedRunningTime="2026-07-07 14:25:37.957641548 +0000 UTC m=+69.985149659"
Jul 07 14:25:37.981923 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:37.981589    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6cj2l" podStartSLOduration=3.149549607 podStartE2EDuration="10.981563612s" totalImagesPullingTime="7.832014005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:37.978330285 +0000 UTC m=+70.005838394" watchObservedRunningTime="2026-07-07 14:25:37.981563612 +0000 UTC m=+70.009071721"
Jul 07 14:25:38.036170 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:38.036103    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54b97d9bf8-jgxgw" podStartSLOduration=2.074401108 podStartE2EDuration="10.036079827s" totalImagesPullingTime="7.961678719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:38.034392917 +0000 UTC m=+70.061901026" watchObservedRunningTime="2026-07-07 14:25:38.036079827 +0000 UTC m=+70.063587938"
Jul 07 14:25:38.066411 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:38.065600    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-785d885946-msjq9" podStartSLOduration=8.065578517 podStartE2EDuration="8.065578517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:38.065208568 +0000 UTC m=+70.092716681" watchObservedRunningTime="2026-07-07 14:25:38.065578517 +0000 UTC m=+70.093086627"
Jul 07 14:25:38.430770 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:38.430737    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:38.430890 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:38.430859    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:38.437831 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:38.437804    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:38.820608 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:38.820562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvdln" event={"ID":"30a0365e-e775-4d29-81d4-a86a2ece5931","Type":"ContainerStarted","Data":"615dc9db8c2bce753eeb7f57b5d6ef68af7096e68c0b0d5a641e98de4d024bed"}
Jul 07 14:25:38.823774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:38.823213    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hh5cg" event={"ID":"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8","Type":"ContainerStarted","Data":"c6cdd4e1e5c5652cb3b7c549e808423195be1d56d89563a17f148cbc62701330"}
Jul 07 14:25:38.823774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:38.823278    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hh5cg" event={"ID":"b99c1ef1-74b3-4fd8-b8d1-0842c3c92dc8","Type":"ContainerStarted","Data":"70e2618ffc7a60a4e3c9b339f4166fa54ad429c8d76f349774ce6017c26803a2"}
Jul 07 14:25:38.829704 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:38.829646    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:25:38.881412 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:38.881344    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hh5cg" podStartSLOduration=68.338004526 podStartE2EDuration="1m9.881319451s" totalImagesPullingTime="1.543314925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:38.853209186 +0000 UTC m=+70.880717295" watchObservedRunningTime="2026-07-07 14:25:38.881319451 +0000 UTC m=+70.908827562"
Jul 07 14:25:40.366428 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:40.366369    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:40.366428 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:40.366434    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:40.373608 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:40.373558    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:40.836658 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:40.836619    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:25:40.905039 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:40.904997    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b97d9bf8-jgxgw"]
Jul 07 14:25:42.954476 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:42.954440    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vx92d"]
Jul 07 14:25:42.959341 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:42.959317    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:42.961845 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:42.961821    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 14:25:42.962203 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:42.962179    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 14:25:42.962309 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:42.962220    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 14:25:42.962309 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:42.962257    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 14:25:42.962857 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:42.962801    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 14:25:42.962857 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:42.962805    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p2mqk\""
Jul 07 14:25:42.963045 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:42.963004    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 14:25:43.010384 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.010356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-wtmp\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.010384 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.010398    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-textfile\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.010613 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.010430    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-sys\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.010613 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.010470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-root\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.010613 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.010588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-metrics-client-ca\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.010769 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.010624    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-tls\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.010769 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.010651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdx4w\" (UniqueName: \"kubernetes.io/projected/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-kube-api-access-rdx4w\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.010769 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.010716    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.010769 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.010759    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.111765 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.111722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.111998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.111797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-wtmp\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.111998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.111835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-textfile\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.111998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.111878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-sys\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.111998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.111903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-root\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.111998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.111927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-metrics-client-ca\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.111998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.111953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-tls\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.112327 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.111998    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-wtmp\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.112327 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.112261    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-textfile\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.112327 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.112001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdx4w\" (UniqueName: \"kubernetes.io/projected/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-kube-api-access-rdx4w\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.112477 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.112336    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-sys\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.112477 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.112356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.112477 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.112378    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-root\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.112477 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:43.112471    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 14:25:43.112677 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.112474    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.112677 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:43.112528    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-tls podName:6b988da9-1bae-4ecb-ac03-c82f5944eaa3 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:43.612510589 +0000 UTC m=+75.640018677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-tls") pod "node-exporter-vx92d" (UID: "6b988da9-1bae-4ecb-ac03-c82f5944eaa3") : secret "node-exporter-tls" not found
Jul 07 14:25:43.112880 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.112860    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-metrics-client-ca\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.115007 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.114982    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.121637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.121615    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdx4w\" (UniqueName: \"kubernetes.io/projected/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-kube-api-access-rdx4w\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.616213 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:43.616175    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-tls\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:43.616391 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:43.616358    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 14:25:43.616447 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:25:43.616440    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-tls podName:6b988da9-1bae-4ecb-ac03-c82f5944eaa3 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:44.616423465 +0000 UTC m=+76.643931553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-tls") pod "node-exporter-vx92d" (UID: "6b988da9-1bae-4ecb-ac03-c82f5944eaa3") : secret "node-exporter-tls" not found
Jul 07 14:25:44.627154 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:44.627107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-tls\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:44.629923 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:44.629896    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b988da9-1bae-4ecb-ac03-c82f5944eaa3-node-exporter-tls\") pod \"node-exporter-vx92d\" (UID: \"6b988da9-1bae-4ecb-ac03-c82f5944eaa3\") " pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:44.770364 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:44.770325    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vx92d"
Jul 07 14:25:47.316872 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.316840    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66b447b58-q2nmq"]
Jul 07 14:25:47.387438 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.387404    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66b447b58-q2nmq"]
Jul 07 14:25:47.387635 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.387553    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.391561 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.391540    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 07 14:25:47.391710 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.391542    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 07 14:25:47.399626 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.399599    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-cbjpb\""
Jul 07 14:25:47.417014 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.416984    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-14p9qlcol7v48\""
Jul 07 14:25:47.417221 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.417166    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 14:25:47.418664 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.418643    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 07 14:25:47.456559 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.456502    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-audit-log\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.456742 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.456590    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-secret-metrics-server-tls\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.456742 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.456622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2gvl\" (UniqueName: \"kubernetes.io/projected/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-kube-api-access-c2gvl\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.456742 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.456652    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-secret-metrics-server-client-certs\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.456742 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.456680    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.456925 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.456773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-client-ca-bundle\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.456925 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.456804    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-metrics-server-audit-profiles\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.557981 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.557918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-client-ca-bundle\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.557981 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.557987    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-metrics-server-audit-profiles\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.558331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.558041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-audit-log\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.558331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.558103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-secret-metrics-server-tls\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.558331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.558131    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2gvl\" (UniqueName: \"kubernetes.io/projected/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-kube-api-access-c2gvl\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.558331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.558166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-secret-metrics-server-client-certs\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.558331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.558195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.558741 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.558710    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-audit-log\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.559299 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.559249    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.559432 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.559357    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-metrics-server-audit-profiles\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.561381 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.561335    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-client-ca-bundle\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.561476 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.561392    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-secret-metrics-server-tls\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.561526 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.561490    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-secret-metrics-server-client-certs\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.570296 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.570208    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2gvl\" (UniqueName: \"kubernetes.io/projected/b85fcd7c-a9b5-403c-b4bf-0ceee89b995d-kube-api-access-c2gvl\") pod \"metrics-server-66b447b58-q2nmq\" (UID: \"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d\") " pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.649420 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.649370    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"]
Jul 07 14:25:47.691996 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.691949    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ddb4cbd44-fnmw7"]
Jul 07 14:25:47.692178 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.692104    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"
Jul 07 14:25:47.695387 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.695359    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-shkhp\""
Jul 07 14:25:47.695955 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.695926    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 14:25:47.699670 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.699634    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:25:47.705316 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.705291    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"]
Jul 07 14:25:47.705485 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.705333    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ddb4cbd44-fnmw7"]
Jul 07 14:25:47.705485 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.705424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.860114 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.860042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmpgt\" (UniqueName: \"kubernetes.io/projected/f74ac3c4-5d83-4b46-9fad-65b5dcdb4057-kube-api-access-jmpgt\") pod \"monitoring-plugin-d5dcff7cf-6f4nd\" (UID: \"f74ac3c4-5d83-4b46-9fad-65b5dcdb4057\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"
Jul 07 14:25:47.860114 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.860109    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-oauth-config\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.860364 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.860136    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-serving-cert\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.860364 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.860160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-console-config\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.860364 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.860246    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-service-ca\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.860364 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.860311    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-oauth-serving-cert\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.860364 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.860340    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpr7f\" (UniqueName: \"kubernetes.io/projected/5cbb180e-cbb0-49dc-841c-15de81809d11-kube-api-access-tpr7f\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.860558 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.860386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-trusted-ca-bundle\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.860558 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.860435    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f74ac3c4-5d83-4b46-9fad-65b5dcdb4057-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-6f4nd\" (UID: \"f74ac3c4-5d83-4b46-9fad-65b5dcdb4057\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"
Jul 07 14:25:47.961644 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.961610    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmpgt\" (UniqueName: \"kubernetes.io/projected/f74ac3c4-5d83-4b46-9fad-65b5dcdb4057-kube-api-access-jmpgt\") pod \"monitoring-plugin-d5dcff7cf-6f4nd\" (UID: \"f74ac3c4-5d83-4b46-9fad-65b5dcdb4057\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"
Jul 07 14:25:47.961644 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.961648    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-oauth-config\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.961905 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.961677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-serving-cert\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.961905 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.961703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-console-config\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.961905 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.961749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-service-ca\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.961905 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.961796    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-oauth-serving-cert\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.961905 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.961825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpr7f\" (UniqueName: \"kubernetes.io/projected/5cbb180e-cbb0-49dc-841c-15de81809d11-kube-api-access-tpr7f\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.961905 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.961856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-trusted-ca-bundle\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.962241 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.961931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f74ac3c4-5d83-4b46-9fad-65b5dcdb4057-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-6f4nd\" (UID: \"f74ac3c4-5d83-4b46-9fad-65b5dcdb4057\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"
Jul 07 14:25:47.962941 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.962905    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-console-config\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.963131 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.963099    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-oauth-serving-cert\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.963539 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.963493    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-trusted-ca-bundle\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.963762 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.963726    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-service-ca\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.964574 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.964551    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-oauth-config\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.964848 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.964815    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f74ac3c4-5d83-4b46-9fad-65b5dcdb4057-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-6f4nd\" (UID: \"f74ac3c4-5d83-4b46-9fad-65b5dcdb4057\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"
Jul 07 14:25:47.964925 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.964820    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-serving-cert\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.973767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.973733    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpr7f\" (UniqueName: \"kubernetes.io/projected/5cbb180e-cbb0-49dc-841c-15de81809d11-kube-api-access-tpr7f\") pod \"console-ddb4cbd44-fnmw7\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") " pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:47.973897 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:47.973880    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmpgt\" (UniqueName: \"kubernetes.io/projected/f74ac3c4-5d83-4b46-9fad-65b5dcdb4057-kube-api-access-jmpgt\") pod \"monitoring-plugin-d5dcff7cf-6f4nd\" (UID: \"f74ac3c4-5d83-4b46-9fad-65b5dcdb4057\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"
Jul 07 14:25:48.004319 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:48.004279    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"
Jul 07 14:25:48.016476 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:48.016433    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:48.830125 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:48.830092    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vvsck"
Jul 07 14:25:50.748357 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:50.748226    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f995d989d-6skxq"
Jul 07 14:25:51.630406 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.630379    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"]
Jul 07 14:25:51.634462 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:51.634391    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74ac3c4_5d83_4b46_9fad_65b5dcdb4057.slice/crio-85fcdf8ff52b88ea2834b8e46cf69767c875eaa3e0a53dfcc72179e4ad2e31c7 WatchSource:0}: Error finding container 85fcdf8ff52b88ea2834b8e46cf69767c875eaa3e0a53dfcc72179e4ad2e31c7: Status 404 returned error can't find the container with id 85fcdf8ff52b88ea2834b8e46cf69767c875eaa3e0a53dfcc72179e4ad2e31c7
Jul 07 14:25:51.851896 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.851728    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66b447b58-q2nmq"]
Jul 07 14:25:51.854266 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.854236    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ddb4cbd44-fnmw7"]
Jul 07 14:25:51.855158 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:51.855124    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85fcd7c_a9b5_403c_b4bf_0ceee89b995d.slice/crio-9f869fb91122397ab2a6b5d6b7208d12f1920a9240cc4144ca7ee2a57b0f6ef3 WatchSource:0}: Error finding container 9f869fb91122397ab2a6b5d6b7208d12f1920a9240cc4144ca7ee2a57b0f6ef3: Status 404 returned error can't find the container with id 9f869fb91122397ab2a6b5d6b7208d12f1920a9240cc4144ca7ee2a57b0f6ef3
Jul 07 14:25:51.857587 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:25:51.857563    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbb180e_cbb0_49dc_841c_15de81809d11.slice/crio-2eb8328f736bc9b86637fc379b6fff371d4e5d415e5ed472daaf76f0e46765d8 WatchSource:0}: Error finding container 2eb8328f736bc9b86637fc379b6fff371d4e5d415e5ed472daaf76f0e46765d8: Status 404 returned error can't find the container with id 2eb8328f736bc9b86637fc379b6fff371d4e5d415e5ed472daaf76f0e46765d8
Jul 07 14:25:51.878647 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.878609    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hwrbj" event={"ID":"4b62ed01-d6a2-41a9-8725-5da7f402e07c","Type":"ContainerStarted","Data":"116093c3df418a3efd43abac1f1cf459ef6185036d73244e1519a7e1d70a75da"}
Jul 07 14:25:51.880520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.880473    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddb4cbd44-fnmw7" event={"ID":"5cbb180e-cbb0-49dc-841c-15de81809d11","Type":"ContainerStarted","Data":"2eb8328f736bc9b86637fc379b6fff371d4e5d415e5ed472daaf76f0e46765d8"}
Jul 07 14:25:51.882080 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.882052    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd" event={"ID":"f74ac3c4-5d83-4b46-9fad-65b5dcdb4057","Type":"ContainerStarted","Data":"85fcdf8ff52b88ea2834b8e46cf69767c875eaa3e0a53dfcc72179e4ad2e31c7"}
Jul 07 14:25:51.885359 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.885326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvdln" event={"ID":"30a0365e-e775-4d29-81d4-a86a2ece5931","Type":"ContainerStarted","Data":"d28ec11200c31c4e14596cd0e0422698f85b3db1e5a14d4ab78de8a8402aa23f"}
Jul 07 14:25:51.889427 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.889394    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-vdmrz" event={"ID":"3b709fff-2821-4969-8132-611f41fc4de2","Type":"ContainerStarted","Data":"a4625f8cdbf4618c1c1eb9b90cbf2c424ce005abbf54011914f520cad6796cc7"}
Jul 07 14:25:51.889538 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.889508    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-vdmrz"
Jul 07 14:25:51.894850 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.894017    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-vdmrz"
Jul 07 14:25:51.897716 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.897694    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vlzfg" event={"ID":"12ffe0f4-f24b-4751-abd8-6996416bb666","Type":"ContainerStarted","Data":"e9c926680a405ea4cd55233f26345d65d321198e10e19257d433063d78faf172"}
Jul 07 14:25:51.898007 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.897991    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:25:51.899174 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.899130    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hwrbj" podStartSLOduration=68.3461723 podStartE2EDuration="1m22.899113148s" totalImagesPullingTime="14.552940848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:51.898725194 +0000 UTC m=+83.926233303" watchObservedRunningTime="2026-07-07 14:25:51.899113148 +0000 UTC m=+83.926621243"
Jul 07 14:25:51.900117 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.900078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vx92d" event={"ID":"6b988da9-1bae-4ecb-ac03-c82f5944eaa3","Type":"ContainerStarted","Data":"6ae0c207ccd85433e284936bc59c3f78429f6ca21bdc72ae1962aafd420517f2"}
Jul 07 14:25:51.902019 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.901997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66b447b58-q2nmq" event={"ID":"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d","Type":"ContainerStarted","Data":"9f869fb91122397ab2a6b5d6b7208d12f1920a9240cc4144ca7ee2a57b0f6ef3"}
Jul 07 14:25:51.917605 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.917552    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-vdmrz" podStartSLOduration=1.110289627 podStartE2EDuration="23.917532145s" totalImagesPullingTime="22.807242518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:51.9160345 +0000 UTC m=+83.943542609" watchObservedRunningTime="2026-07-07 14:25:51.917532145 +0000 UTC m=+83.945040253"
Jul 07 14:25:51.939259 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.939030    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vlzfg" podStartSLOduration=68.423707126 podStartE2EDuration="1m22.939008163s" totalImagesPullingTime="14.515301037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:51.938286141 +0000 UTC m=+83.965794250" watchObservedRunningTime="2026-07-07 14:25:51.939008163 +0000 UTC m=+83.966516271"
Jul 07 14:25:51.959776 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:51.959581    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gvdln" podStartSLOduration=1.423773856 podStartE2EDuration="23.959559839s" totalImagesPullingTime="22.535785983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:25:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:51.958048367 +0000 UTC m=+83.985556490" watchObservedRunningTime="2026-07-07 14:25:51.959559839 +0000 UTC m=+83.987067949"
Jul 07 14:25:52.910534 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:52.910426    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddb4cbd44-fnmw7" event={"ID":"5cbb180e-cbb0-49dc-841c-15de81809d11","Type":"ContainerStarted","Data":"d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0"}
Jul 07 14:25:52.931302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:52.931243    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ddb4cbd44-fnmw7" podStartSLOduration=5.931219812 podStartE2EDuration="5.931219812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:52.931178193 +0000 UTC m=+84.958686301" watchObservedRunningTime="2026-07-07 14:25:52.931219812 +0000 UTC m=+84.958727921"
Jul 07 14:25:54.921307 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:54.921268    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vx92d" event={"ID":"6b988da9-1bae-4ecb-ac03-c82f5944eaa3","Type":"ContainerStarted","Data":"769de72a4928ad14a6e8b72868746e42b0b56721930553c03fd11c1dd656237d"}
Jul 07 14:25:54.923582 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:54.923542    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66b447b58-q2nmq" event={"ID":"b85fcd7c-a9b5-403c-b4bf-0ceee89b995d","Type":"ContainerStarted","Data":"7bbf2b486ab258e4015e22966babdfa859a2d26ed806a2da09cfaba908fe75b6"}
Jul 07 14:25:54.925774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:54.925727    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd" event={"ID":"f74ac3c4-5d83-4b46-9fad-65b5dcdb4057","Type":"ContainerStarted","Data":"7af8089483ba131e50458086651e2c9f376b853db96c8dfc63aec50a5754d9d0"}
Jul 07 14:25:54.926137 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:54.926117    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"
Jul 07 14:25:54.936280 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:54.936234    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd"
Jul 07 14:25:54.982481 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:54.982404    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-6f4nd" podStartSLOduration=4.91131338 podStartE2EDuration="7.982382915s" totalImagesPullingTime="3.071069535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:54.982262273 +0000 UTC m=+87.009770381" watchObservedRunningTime="2026-07-07 14:25:54.982382915 +0000 UTC m=+87.009891023"
Jul 07 14:25:55.006275 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:55.006188    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66b447b58-q2nmq" podStartSLOduration=5.152890409 podStartE2EDuration="8.006163651s" totalImagesPullingTime="2.853273242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:55.005232721 +0000 UTC m=+87.032740830" watchObservedRunningTime="2026-07-07 14:25:55.006163651 +0000 UTC m=+87.033671760"
Jul 07 14:25:55.932992 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:55.932930    2583 generic.go:356] "Generic (PLEG): container finished" podID="6b988da9-1bae-4ecb-ac03-c82f5944eaa3" containerID="769de72a4928ad14a6e8b72868746e42b0b56721930553c03fd11c1dd656237d" exitCode=0
Jul 07 14:25:55.933551 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:55.933044    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vx92d" event={"ID":"6b988da9-1bae-4ecb-ac03-c82f5944eaa3","Type":"ContainerDied","Data":"769de72a4928ad14a6e8b72868746e42b0b56721930553c03fd11c1dd656237d"}
Jul 07 14:25:56.940451 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:56.940406    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vx92d" event={"ID":"6b988da9-1bae-4ecb-ac03-c82f5944eaa3","Type":"ContainerStarted","Data":"a1f34c2ca2b1ecb49361c1f788dedf7af1de3dc4ded073d5b5a8e66d99642695"}
Jul 07 14:25:56.940919 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:56.940478    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vx92d" event={"ID":"6b988da9-1bae-4ecb-ac03-c82f5944eaa3","Type":"ContainerStarted","Data":"1d0ba7344b4980e49a41dd198c55d35870e2e09d58e64b65f1a68ebdd4c9582b"}
Jul 07 14:25:56.964698 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:56.964643    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vx92d" podStartSLOduration=11.584726123 podStartE2EDuration="14.964626021s" totalImagesPullingTime="3.261891432s" totalInitContainerRuntime="118.008466ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:56.962812439 +0000 UTC m=+88.990320549" watchObservedRunningTime="2026-07-07 14:25:56.964626021 +0000 UTC m=+88.992134129"
Jul 07 14:25:58.016832 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:58.016747    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:58.017713 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:58.016931    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:58.023197 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:58.023170    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:58.955331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:58.955301    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:25:59.015216 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:25:59.015182    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785d885946-msjq9"]
Jul 07 14:26:06.858304 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:06.858261    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54b97d9bf8-jgxgw" podUID="5b60c7e5-41e8-429e-be46-a07b389a3358" containerName="console" containerID="cri-o://6ce8c4f1d57f5538bc1d7528892c133b09b0d1dd40635c98d151d7a12a39a80e" gracePeriod=15
Jul 07 14:26:06.986741 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:06.986707    2583 generic.go:356] "Generic (PLEG): container finished" podID="5b60c7e5-41e8-429e-be46-a07b389a3358" containerID="6ce8c4f1d57f5538bc1d7528892c133b09b0d1dd40635c98d151d7a12a39a80e" exitCode=0
Jul 07 14:26:06.986915 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:06.986773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b97d9bf8-jgxgw" event={"ID":"5b60c7e5-41e8-429e-be46-a07b389a3358","Type":"ContainerDied","Data":"6ce8c4f1d57f5538bc1d7528892c133b09b0d1dd40635c98d151d7a12a39a80e"}
Jul 07 14:26:07.151141 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.151105    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:26:07.230398 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.230357    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-console-config\") pod \"5b60c7e5-41e8-429e-be46-a07b389a3358\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") "
Jul 07 14:26:07.230398 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.230406    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-oauth-serving-cert\") pod \"5b60c7e5-41e8-429e-be46-a07b389a3358\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") "
Jul 07 14:26:07.230644 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.230439    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-oauth-config\") pod \"5b60c7e5-41e8-429e-be46-a07b389a3358\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") "
Jul 07 14:26:07.230644 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.230504    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-serving-cert\") pod \"5b60c7e5-41e8-429e-be46-a07b389a3358\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") "
Jul 07 14:26:07.230644 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.230538    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnb9j\" (UniqueName: \"kubernetes.io/projected/5b60c7e5-41e8-429e-be46-a07b389a3358-kube-api-access-nnb9j\") pod \"5b60c7e5-41e8-429e-be46-a07b389a3358\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") "
Jul 07 14:26:07.230644 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.230572    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-service-ca\") pod \"5b60c7e5-41e8-429e-be46-a07b389a3358\" (UID: \"5b60c7e5-41e8-429e-be46-a07b389a3358\") "
Jul 07 14:26:07.230891 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.230853    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-console-config" (OuterVolumeSpecName: "console-config") pod "5b60c7e5-41e8-429e-be46-a07b389a3358" (UID: "5b60c7e5-41e8-429e-be46-a07b389a3358"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:26:07.231040 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.230924    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5b60c7e5-41e8-429e-be46-a07b389a3358" (UID: "5b60c7e5-41e8-429e-be46-a07b389a3358"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:26:07.231130 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.231090    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-service-ca" (OuterVolumeSpecName: "service-ca") pod "5b60c7e5-41e8-429e-be46-a07b389a3358" (UID: "5b60c7e5-41e8-429e-be46-a07b389a3358"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:26:07.233263 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.233237    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5b60c7e5-41e8-429e-be46-a07b389a3358" (UID: "5b60c7e5-41e8-429e-be46-a07b389a3358"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:26:07.233368 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.233291    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b60c7e5-41e8-429e-be46-a07b389a3358-kube-api-access-nnb9j" (OuterVolumeSpecName: "kube-api-access-nnb9j") pod "5b60c7e5-41e8-429e-be46-a07b389a3358" (UID: "5b60c7e5-41e8-429e-be46-a07b389a3358"). InnerVolumeSpecName "kube-api-access-nnb9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:26:07.233368 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.233306    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5b60c7e5-41e8-429e-be46-a07b389a3358" (UID: "5b60c7e5-41e8-429e-be46-a07b389a3358"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:26:07.332033 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.331993    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-service-ca\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:07.332033 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.332026    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-console-config\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:07.332033 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.332036    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b60c7e5-41e8-429e-be46-a07b389a3358-oauth-serving-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:07.332033 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.332046    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-oauth-config\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:07.332297 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.332055    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b60c7e5-41e8-429e-be46-a07b389a3358-console-serving-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:07.332297 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.332063    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnb9j\" (UniqueName: \"kubernetes.io/projected/5b60c7e5-41e8-429e-be46-a07b389a3358-kube-api-access-nnb9j\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:07.700623 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.700584    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:26:07.700807 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.700667    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:26:07.994729 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.994643    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b97d9bf8-jgxgw" event={"ID":"5b60c7e5-41e8-429e-be46-a07b389a3358","Type":"ContainerDied","Data":"db59b1a0cd162855ea362ae73973c1350dc186615bb9bece1917636d1bf33244"}
Jul 07 14:26:07.994729 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.994661    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b97d9bf8-jgxgw"
Jul 07 14:26:07.994729 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:07.994701    2583 scope.go:117] "RemoveContainer" containerID="6ce8c4f1d57f5538bc1d7528892c133b09b0d1dd40635c98d151d7a12a39a80e"
Jul 07 14:26:08.019499 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:08.019468    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b97d9bf8-jgxgw"]
Jul 07 14:26:08.030496 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:08.030466    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54b97d9bf8-jgxgw"]
Jul 07 14:26:08.467930 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:08.467893    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b60c7e5-41e8-429e-be46-a07b389a3358" path="/var/lib/kubelet/pods/5b60c7e5-41e8-429e-be46-a07b389a3358/volumes"
Jul 07 14:26:22.912886 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:22.912856    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vlzfg"
Jul 07 14:26:24.041155 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.041110    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-785d885946-msjq9" podUID="f956db00-b20d-46b3-9a46-ad4c01bef57a" containerName="console" containerID="cri-o://592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949" gracePeriod=15
Jul 07 14:26:24.322332 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.322254    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:26:24.355255 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.355224    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-oauth-config\") pod \"f956db00-b20d-46b3-9a46-ad4c01bef57a\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") "
Jul 07 14:26:24.355255 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.355259    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x22f6\" (UniqueName: \"kubernetes.io/projected/f956db00-b20d-46b3-9a46-ad4c01bef57a-kube-api-access-x22f6\") pod \"f956db00-b20d-46b3-9a46-ad4c01bef57a\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") "
Jul 07 14:26:24.355503 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.355285    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-service-ca\") pod \"f956db00-b20d-46b3-9a46-ad4c01bef57a\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") "
Jul 07 14:26:24.355503 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.355315    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-trusted-ca-bundle\") pod \"f956db00-b20d-46b3-9a46-ad4c01bef57a\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") "
Jul 07 14:26:24.355503 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.355379    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-serving-cert\") pod \"f956db00-b20d-46b3-9a46-ad4c01bef57a\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") "
Jul 07 14:26:24.355503 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.355406    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-oauth-serving-cert\") pod \"f956db00-b20d-46b3-9a46-ad4c01bef57a\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") "
Jul 07 14:26:24.355761 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.355709    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-config\") pod \"f956db00-b20d-46b3-9a46-ad4c01bef57a\" (UID: \"f956db00-b20d-46b3-9a46-ad4c01bef57a\") "
Jul 07 14:26:24.355833 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.355762    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-service-ca" (OuterVolumeSpecName: "service-ca") pod "f956db00-b20d-46b3-9a46-ad4c01bef57a" (UID: "f956db00-b20d-46b3-9a46-ad4c01bef57a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:26:24.355833 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.355799    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f956db00-b20d-46b3-9a46-ad4c01bef57a" (UID: "f956db00-b20d-46b3-9a46-ad4c01bef57a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:26:24.355833 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.355821    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f956db00-b20d-46b3-9a46-ad4c01bef57a" (UID: "f956db00-b20d-46b3-9a46-ad4c01bef57a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:26:24.356029 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.356013    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-oauth-serving-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:24.356087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.356033    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-service-ca\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:24.356087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.356048    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-trusted-ca-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:24.356220 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.356196    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-config" (OuterVolumeSpecName: "console-config") pod "f956db00-b20d-46b3-9a46-ad4c01bef57a" (UID: "f956db00-b20d-46b3-9a46-ad4c01bef57a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:26:24.357637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.357610    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f956db00-b20d-46b3-9a46-ad4c01bef57a-kube-api-access-x22f6" (OuterVolumeSpecName: "kube-api-access-x22f6") pod "f956db00-b20d-46b3-9a46-ad4c01bef57a" (UID: "f956db00-b20d-46b3-9a46-ad4c01bef57a"). InnerVolumeSpecName "kube-api-access-x22f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:26:24.357757 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.357646    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f956db00-b20d-46b3-9a46-ad4c01bef57a" (UID: "f956db00-b20d-46b3-9a46-ad4c01bef57a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:26:24.357757 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.357701    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f956db00-b20d-46b3-9a46-ad4c01bef57a" (UID: "f956db00-b20d-46b3-9a46-ad4c01bef57a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:26:24.457134 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.457094    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-serving-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:24.457134 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.457126    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-config\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:24.457134 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.457135    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f956db00-b20d-46b3-9a46-ad4c01bef57a-console-oauth-config\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:24.457134 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:24.457144    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x22f6\" (UniqueName: \"kubernetes.io/projected/f956db00-b20d-46b3-9a46-ad4c01bef57a-kube-api-access-x22f6\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:26:25.053870 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:25.053831    2583 generic.go:356] "Generic (PLEG): container finished" podID="f956db00-b20d-46b3-9a46-ad4c01bef57a" containerID="592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949" exitCode=0
Jul 07 14:26:25.054384 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:25.053885    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785d885946-msjq9" event={"ID":"f956db00-b20d-46b3-9a46-ad4c01bef57a","Type":"ContainerDied","Data":"592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949"}
Jul 07 14:26:25.054384 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:25.053896    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785d885946-msjq9"
Jul 07 14:26:25.054384 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:25.053924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785d885946-msjq9" event={"ID":"f956db00-b20d-46b3-9a46-ad4c01bef57a","Type":"ContainerDied","Data":"e9be5e51f25224d4bb456d2cd924223ba04dd70f47f3b3ccee0018f64681fb05"}
Jul 07 14:26:25.054384 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:25.053944    2583 scope.go:117] "RemoveContainer" containerID="592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949"
Jul 07 14:26:25.062175 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:25.062066    2583 scope.go:117] "RemoveContainer" containerID="592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949"
Jul 07 14:26:25.062404 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:26:25.062375    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949\": container with ID starting with 592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949 not found: ID does not exist" containerID="592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949"
Jul 07 14:26:25.062478 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:25.062419    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949"} err="failed to get container status \"592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949\": rpc error: code = NotFound desc = could not find container \"592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949\": container with ID starting with 592ddefa34aa59cdace2b7dc7bb7c4befbb3258a7e32550569837a1b88db3949 not found: ID does not exist"
Jul 07 14:26:25.073515 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:25.073489    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785d885946-msjq9"]
Jul 07 14:26:25.079737 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:25.079712    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-785d885946-msjq9"]
Jul 07 14:26:26.466552 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:26.466513    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f956db00-b20d-46b3-9a46-ad4c01bef57a" path="/var/lib/kubelet/pods/f956db00-b20d-46b3-9a46-ad4c01bef57a/volumes"
Jul 07 14:26:27.705064 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:27.705032    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:26:27.708913 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:26:27.708888    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66b447b58-q2nmq"
Jul 07 14:27:07.440891 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.440854    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8d85ddb8-7p99p"]
Jul 07 14:27:07.441374 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.441114    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f956db00-b20d-46b3-9a46-ad4c01bef57a" containerName="console"
Jul 07 14:27:07.441374 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.441126    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f956db00-b20d-46b3-9a46-ad4c01bef57a" containerName="console"
Jul 07 14:27:07.441374 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.441136    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b60c7e5-41e8-429e-be46-a07b389a3358" containerName="console"
Jul 07 14:27:07.441374 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.441142    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b60c7e5-41e8-429e-be46-a07b389a3358" containerName="console"
Jul 07 14:27:07.441374 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.441187    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f956db00-b20d-46b3-9a46-ad4c01bef57a" containerName="console"
Jul 07 14:27:07.441374 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.441195    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b60c7e5-41e8-429e-be46-a07b389a3358" containerName="console"
Jul 07 14:27:07.443700 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.443684    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.446095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.446071    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 07 14:27:07.446221 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.446136    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 07 14:27:07.446221 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.446210    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4szmm\""
Jul 07 14:27:07.446331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.446272    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 07 14:27:07.446447 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.446431    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 07 14:27:07.446998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.446985    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 07 14:27:07.451068 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.451047    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 07 14:27:07.458408 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.458389    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8d85ddb8-7p99p"]
Jul 07 14:27:07.588817 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.588773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzk9b\" (UniqueName: \"kubernetes.io/projected/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-kube-api-access-qzk9b\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.589016 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.588839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-metrics-client-ca\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.589016 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.588863    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-federate-client-tls\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.589016 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.588888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.589016 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.588986    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-secret-telemeter-client\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.589161 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.589025    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-telemeter-client-tls\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.589161 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.589094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.589161 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.589135    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-serving-certs-ca-bundle\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.689502 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.689456    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-secret-telemeter-client\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.689502 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.689499    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-telemeter-client-tls\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.689727 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.689529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.689727 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.689660    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-serving-certs-ca-bundle\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.689800 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.689726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzk9b\" (UniqueName: \"kubernetes.io/projected/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-kube-api-access-qzk9b\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.689800 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.689765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-metrics-client-ca\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.689800 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.689788    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-federate-client-tls\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.689938 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.689814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.690381 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.690348    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-serving-certs-ca-bundle\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.690565 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.690504    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-metrics-client-ca\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.690692 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.690638    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.692157 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.692107    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-secret-telemeter-client\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.692293 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.692271    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.692364 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.692284    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-telemeter-client-tls\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.692599 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.692580    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-federate-client-tls\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.700050 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.700031    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzk9b\" (UniqueName: \"kubernetes.io/projected/b89d8e94-8a86-4e0b-b725-1d35f967f1bb-kube-api-access-qzk9b\") pod \"telemeter-client-8d85ddb8-7p99p\" (UID: \"b89d8e94-8a86-4e0b-b725-1d35f967f1bb\") " pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.753465 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.753435    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p"
Jul 07 14:27:07.894588 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:07.894511    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8d85ddb8-7p99p"]
Jul 07 14:27:07.898416 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:27:07.898381    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89d8e94_8a86_4e0b_b725_1d35f967f1bb.slice/crio-f27985d6d3b4b3531293366f04b1da51447033f2857f57f196751d870e4b75be WatchSource:0}: Error finding container f27985d6d3b4b3531293366f04b1da51447033f2857f57f196751d870e4b75be: Status 404 returned error can't find the container with id f27985d6d3b4b3531293366f04b1da51447033f2857f57f196751d870e4b75be
Jul 07 14:27:08.204626 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:08.204590    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p" event={"ID":"b89d8e94-8a86-4e0b-b725-1d35f967f1bb","Type":"ContainerStarted","Data":"f27985d6d3b4b3531293366f04b1da51447033f2857f57f196751d870e4b75be"}
Jul 07 14:27:11.217667 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:11.217620    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p" event={"ID":"b89d8e94-8a86-4e0b-b725-1d35f967f1bb","Type":"ContainerStarted","Data":"8f9e3a6604d55554036b39140d41bfd8b6251071bb7909ba398794166e847f06"}
Jul 07 14:27:12.222859 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.222823    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p" event={"ID":"b89d8e94-8a86-4e0b-b725-1d35f967f1bb","Type":"ContainerStarted","Data":"faca546f7290c628679effef6fd793391393888268b554e912e352176406d14f"}
Jul 07 14:27:12.223258 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.222882    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p" event={"ID":"b89d8e94-8a86-4e0b-b725-1d35f967f1bb","Type":"ContainerStarted","Data":"781539d8c7913be48392060f33ca4f443fec069bf660b7588958a312cbba6606"}
Jul 07 14:27:12.255252 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.255108    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8d85ddb8-7p99p" podStartSLOduration=1.46618702 podStartE2EDuration="5.255091995s" totalImagesPullingTime="3.788904975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:27:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:27:12.253576224 +0000 UTC m=+164.281084333" watchObservedRunningTime="2026-07-07 14:27:12.255091995 +0000 UTC m=+164.282600103"
Jul 07 14:27:12.908197 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.908164    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68cc997749-cpm5r"]
Jul 07 14:27:12.910279 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.910258    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:12.922606 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.922582    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68cc997749-cpm5r"]
Jul 07 14:27:12.937237 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.937208    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-serving-cert\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:12.937347 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.937247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-oauth-config\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:12.937347 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.937272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-trusted-ca-bundle\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:12.937454 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.937356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-config\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:12.937454 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.937390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8nkm\" (UniqueName: \"kubernetes.io/projected/4cca82dd-1734-45b1-a1a1-e7d94f596560-kube-api-access-r8nkm\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:12.937454 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.937421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-service-ca\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:12.937572 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:12.937452    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-oauth-serving-cert\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.037808 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.037769    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-service-ca\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.037808 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.037810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-oauth-serving-cert\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.038099 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.037866    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-serving-cert\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.038099 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.037887    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-oauth-config\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.038099 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.037912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-trusted-ca-bundle\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.038099 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.038002    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-config\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.038099 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.038032    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8nkm\" (UniqueName: \"kubernetes.io/projected/4cca82dd-1734-45b1-a1a1-e7d94f596560-kube-api-access-r8nkm\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.038651 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.038620    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-oauth-serving-cert\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.038749 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.038649    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-service-ca\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.038749 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.038725    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-config\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.038849 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.038831    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-trusted-ca-bundle\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.040332 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.040301    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-oauth-config\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.040514 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.040496    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-serving-cert\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.047759 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.047737    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8nkm\" (UniqueName: \"kubernetes.io/projected/4cca82dd-1734-45b1-a1a1-e7d94f596560-kube-api-access-r8nkm\") pod \"console-68cc997749-cpm5r\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") " pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.218892 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.218857    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:13.348014 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:13.347985    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68cc997749-cpm5r"]
Jul 07 14:27:13.351637 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:27:13.351607    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cca82dd_1734_45b1_a1a1_e7d94f596560.slice/crio-5158e469d37614b7151892ef3325ced4b67971e697d2fa3e492eebf9bb5dd2c2 WatchSource:0}: Error finding container 5158e469d37614b7151892ef3325ced4b67971e697d2fa3e492eebf9bb5dd2c2: Status 404 returned error can't find the container with id 5158e469d37614b7151892ef3325ced4b67971e697d2fa3e492eebf9bb5dd2c2
Jul 07 14:27:14.233695 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:14.233650    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cc997749-cpm5r" event={"ID":"4cca82dd-1734-45b1-a1a1-e7d94f596560","Type":"ContainerStarted","Data":"f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119"}
Jul 07 14:27:14.233870 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:14.233708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cc997749-cpm5r" event={"ID":"4cca82dd-1734-45b1-a1a1-e7d94f596560","Type":"ContainerStarted","Data":"5158e469d37614b7151892ef3325ced4b67971e697d2fa3e492eebf9bb5dd2c2"}
Jul 07 14:27:14.256919 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:14.256872    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68cc997749-cpm5r" podStartSLOduration=2.256857398 podStartE2EDuration="2.256857398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:27:14.255819413 +0000 UTC m=+166.283327522" watchObservedRunningTime="2026-07-07 14:27:14.256857398 +0000 UTC m=+166.284365506"
Jul 07 14:27:23.220128 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.220021    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:23.220128 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.220091    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:23.224976 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.224936    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:23.268322 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.268291    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:23.324290 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.324253    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ddb4cbd44-fnmw7"]
Jul 07 14:27:23.453077 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.453045    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-664648765c-qmq6s"]
Jul 07 14:27:23.456610 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.456594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.471848 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.471776    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664648765c-qmq6s"]
Jul 07 14:27:23.513782 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.513746    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-config\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.513950 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.513789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-oauth-serving-cert\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.513950 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.513837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mln9\" (UniqueName: \"kubernetes.io/projected/eb323866-088e-40a3-b2c5-a2f9b3a276c7-kube-api-access-8mln9\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.513950 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.513889    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-service-ca\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.513950 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.513928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-oauth-config\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.513950 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.513948    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-serving-cert\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.514136 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.513999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-trusted-ca-bundle\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.614381 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.614333    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-trusted-ca-bundle\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.614381 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.614388    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-config\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.614608 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.614427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-oauth-serving-cert\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.614608 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.614459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mln9\" (UniqueName: \"kubernetes.io/projected/eb323866-088e-40a3-b2c5-a2f9b3a276c7-kube-api-access-8mln9\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.614608 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.614519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-service-ca\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.614608 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.614575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-oauth-config\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.614608 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.614603    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-serving-cert\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.615357 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.615331    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-oauth-serving-cert\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.615357 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.615342    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-config\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.615512 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.615482    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-trusted-ca-bundle\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.615512 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.615490    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-service-ca\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.617107 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.617090    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-serving-cert\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.617220 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.617205    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-oauth-config\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.624757 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.624733    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mln9\" (UniqueName: \"kubernetes.io/projected/eb323866-088e-40a3-b2c5-a2f9b3a276c7-kube-api-access-8mln9\") pod \"console-664648765c-qmq6s\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") " pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.766217 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.766126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:23.897596 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:23.897565    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664648765c-qmq6s"]
Jul 07 14:27:23.900532 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:27:23.900508    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb323866_088e_40a3_b2c5_a2f9b3a276c7.slice/crio-0f2890485212ff65c9d8301c8cdf9859a3a077485f64e667c512ee6733b6ce96 WatchSource:0}: Error finding container 0f2890485212ff65c9d8301c8cdf9859a3a077485f64e667c512ee6733b6ce96: Status 404 returned error can't find the container with id 0f2890485212ff65c9d8301c8cdf9859a3a077485f64e667c512ee6733b6ce96
Jul 07 14:27:24.269743 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:24.269705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664648765c-qmq6s" event={"ID":"eb323866-088e-40a3-b2c5-a2f9b3a276c7","Type":"ContainerStarted","Data":"5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69"}
Jul 07 14:27:24.270166 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:24.269760    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664648765c-qmq6s" event={"ID":"eb323866-088e-40a3-b2c5-a2f9b3a276c7","Type":"ContainerStarted","Data":"0f2890485212ff65c9d8301c8cdf9859a3a077485f64e667c512ee6733b6ce96"}
Jul 07 14:27:24.293198 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:24.293141    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-664648765c-qmq6s" podStartSLOduration=1.29312444 podStartE2EDuration="1.29312444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:27:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:27:24.291896833 +0000 UTC m=+176.319404942" watchObservedRunningTime="2026-07-07 14:27:24.29312444 +0000 UTC m=+176.320632548"
Jul 07 14:27:33.767092 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:33.767046    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:33.767479 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:33.767132    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:33.772106 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:33.772082    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:34.309721 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:34.309694    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:27:34.365203 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:34.365164    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68cc997749-cpm5r"]
Jul 07 14:27:48.344513 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.344447    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-ddb4cbd44-fnmw7" podUID="5cbb180e-cbb0-49dc-841c-15de81809d11" containerName="console" containerID="cri-o://d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0" gracePeriod=15
Jul 07 14:27:48.598631 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.598568    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:27:48.728588 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.728554    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-trusted-ca-bundle\") pod \"5cbb180e-cbb0-49dc-841c-15de81809d11\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") "
Jul 07 14:27:48.728588 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.728592    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-serving-cert\") pod \"5cbb180e-cbb0-49dc-841c-15de81809d11\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") "
Jul 07 14:27:48.728804 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.728626    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-service-ca\") pod \"5cbb180e-cbb0-49dc-841c-15de81809d11\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") "
Jul 07 14:27:48.728804 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.728748    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-oauth-config\") pod \"5cbb180e-cbb0-49dc-841c-15de81809d11\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") "
Jul 07 14:27:48.728909 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.728802    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-console-config\") pod \"5cbb180e-cbb0-49dc-841c-15de81809d11\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") "
Jul 07 14:27:48.728909 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.728837    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-oauth-serving-cert\") pod \"5cbb180e-cbb0-49dc-841c-15de81809d11\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") "
Jul 07 14:27:48.728909 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.728883    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpr7f\" (UniqueName: \"kubernetes.io/projected/5cbb180e-cbb0-49dc-841c-15de81809d11-kube-api-access-tpr7f\") pod \"5cbb180e-cbb0-49dc-841c-15de81809d11\" (UID: \"5cbb180e-cbb0-49dc-841c-15de81809d11\") "
Jul 07 14:27:48.729080 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.729024    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-service-ca" (OuterVolumeSpecName: "service-ca") pod "5cbb180e-cbb0-49dc-841c-15de81809d11" (UID: "5cbb180e-cbb0-49dc-841c-15de81809d11"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:27:48.729169 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.729038    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5cbb180e-cbb0-49dc-841c-15de81809d11" (UID: "5cbb180e-cbb0-49dc-841c-15de81809d11"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:27:48.729332 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.729314    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-trusted-ca-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:48.729401 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.729327    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-console-config" (OuterVolumeSpecName: "console-config") pod "5cbb180e-cbb0-49dc-841c-15de81809d11" (UID: "5cbb180e-cbb0-49dc-841c-15de81809d11"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:27:48.729401 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.729337    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-service-ca\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:48.729401 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.729350    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5cbb180e-cbb0-49dc-841c-15de81809d11" (UID: "5cbb180e-cbb0-49dc-841c-15de81809d11"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:27:48.730928 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.730896    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5cbb180e-cbb0-49dc-841c-15de81809d11" (UID: "5cbb180e-cbb0-49dc-841c-15de81809d11"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:27:48.731110 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.731086    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5cbb180e-cbb0-49dc-841c-15de81809d11" (UID: "5cbb180e-cbb0-49dc-841c-15de81809d11"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:27:48.731242 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.731223    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cbb180e-cbb0-49dc-841c-15de81809d11-kube-api-access-tpr7f" (OuterVolumeSpecName: "kube-api-access-tpr7f") pod "5cbb180e-cbb0-49dc-841c-15de81809d11" (UID: "5cbb180e-cbb0-49dc-841c-15de81809d11"). InnerVolumeSpecName "kube-api-access-tpr7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:27:48.830117 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.830075    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-serving-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:48.830117 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.830106    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cbb180e-cbb0-49dc-841c-15de81809d11-console-oauth-config\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:48.830117 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.830120    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-console-config\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:48.830362 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.830133    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cbb180e-cbb0-49dc-841c-15de81809d11-oauth-serving-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:48.830362 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:48.830145    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpr7f\" (UniqueName: \"kubernetes.io/projected/5cbb180e-cbb0-49dc-841c-15de81809d11-kube-api-access-tpr7f\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:49.357366 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:49.357326    2583 generic.go:356] "Generic (PLEG): container finished" podID="5cbb180e-cbb0-49dc-841c-15de81809d11" containerID="d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0" exitCode=0
Jul 07 14:27:49.357366 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:49.357369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddb4cbd44-fnmw7" event={"ID":"5cbb180e-cbb0-49dc-841c-15de81809d11","Type":"ContainerDied","Data":"d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0"}
Jul 07 14:27:49.357907 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:49.357388    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddb4cbd44-fnmw7"
Jul 07 14:27:49.357907 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:49.357441    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddb4cbd44-fnmw7" event={"ID":"5cbb180e-cbb0-49dc-841c-15de81809d11","Type":"ContainerDied","Data":"2eb8328f736bc9b86637fc379b6fff371d4e5d415e5ed472daaf76f0e46765d8"}
Jul 07 14:27:49.357907 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:49.357464    2583 scope.go:117] "RemoveContainer" containerID="d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0"
Jul 07 14:27:49.365802 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:49.365782    2583 scope.go:117] "RemoveContainer" containerID="d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0"
Jul 07 14:27:49.366094 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:27:49.366072    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0\": container with ID starting with d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0 not found: ID does not exist" containerID="d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0"
Jul 07 14:27:49.366169 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:49.366107    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0"} err="failed to get container status \"d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0\": rpc error: code = NotFound desc = could not find container \"d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0\": container with ID starting with d266490b78a9785b25184ca599536703f4890924722752051916f7b62d3020f0 not found: ID does not exist"
Jul 07 14:27:49.381649 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:49.381608    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ddb4cbd44-fnmw7"]
Jul 07 14:27:49.389218 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:49.389190    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ddb4cbd44-fnmw7"]
Jul 07 14:27:50.467234 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:50.467202    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cbb180e-cbb0-49dc-841c-15de81809d11" path="/var/lib/kubelet/pods/5cbb180e-cbb0-49dc-841c-15de81809d11/volumes"
Jul 07 14:27:59.392263 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.392186    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68cc997749-cpm5r" podUID="4cca82dd-1734-45b1-a1a1-e7d94f596560" containerName="console" containerID="cri-o://f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119" gracePeriod=15
Jul 07 14:27:59.633315 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.633293    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:27:59.714486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.714452    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-trusted-ca-bundle\") pod \"4cca82dd-1734-45b1-a1a1-e7d94f596560\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") "
Jul 07 14:27:59.714676 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.714499    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-serving-cert\") pod \"4cca82dd-1734-45b1-a1a1-e7d94f596560\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") "
Jul 07 14:27:59.714676 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.714520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-service-ca\") pod \"4cca82dd-1734-45b1-a1a1-e7d94f596560\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") "
Jul 07 14:27:59.714676 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.714537    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-oauth-serving-cert\") pod \"4cca82dd-1734-45b1-a1a1-e7d94f596560\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") "
Jul 07 14:27:59.714676 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.714559    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-config\") pod \"4cca82dd-1734-45b1-a1a1-e7d94f596560\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") "
Jul 07 14:27:59.714676 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.714591    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-oauth-config\") pod \"4cca82dd-1734-45b1-a1a1-e7d94f596560\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") "
Jul 07 14:27:59.714676 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.714618    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8nkm\" (UniqueName: \"kubernetes.io/projected/4cca82dd-1734-45b1-a1a1-e7d94f596560-kube-api-access-r8nkm\") pod \"4cca82dd-1734-45b1-a1a1-e7d94f596560\" (UID: \"4cca82dd-1734-45b1-a1a1-e7d94f596560\") "
Jul 07 14:27:59.715098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.715065    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-service-ca" (OuterVolumeSpecName: "service-ca") pod "4cca82dd-1734-45b1-a1a1-e7d94f596560" (UID: "4cca82dd-1734-45b1-a1a1-e7d94f596560"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:27:59.715171 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.715070    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4cca82dd-1734-45b1-a1a1-e7d94f596560" (UID: "4cca82dd-1734-45b1-a1a1-e7d94f596560"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:27:59.715171 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.715102    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4cca82dd-1734-45b1-a1a1-e7d94f596560" (UID: "4cca82dd-1734-45b1-a1a1-e7d94f596560"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:27:59.715171 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.715135    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-config" (OuterVolumeSpecName: "console-config") pod "4cca82dd-1734-45b1-a1a1-e7d94f596560" (UID: "4cca82dd-1734-45b1-a1a1-e7d94f596560"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:27:59.716794 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.716775    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4cca82dd-1734-45b1-a1a1-e7d94f596560" (UID: "4cca82dd-1734-45b1-a1a1-e7d94f596560"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:27:59.716794 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.716783    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cca82dd-1734-45b1-a1a1-e7d94f596560-kube-api-access-r8nkm" (OuterVolumeSpecName: "kube-api-access-r8nkm") pod "4cca82dd-1734-45b1-a1a1-e7d94f596560" (UID: "4cca82dd-1734-45b1-a1a1-e7d94f596560"). InnerVolumeSpecName "kube-api-access-r8nkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:27:59.716898 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.716842    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4cca82dd-1734-45b1-a1a1-e7d94f596560" (UID: "4cca82dd-1734-45b1-a1a1-e7d94f596560"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:27:59.815578 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.815525    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-trusted-ca-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:59.815578 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.815572    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-serving-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:59.815578 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.815584    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-service-ca\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:59.815578 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.815594    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-oauth-serving-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:59.815845 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.815603    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-config\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:59.815845 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.815612    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cca82dd-1734-45b1-a1a1-e7d94f596560-console-oauth-config\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:27:59.815845 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:27:59.815620    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8nkm\" (UniqueName: \"kubernetes.io/projected/4cca82dd-1734-45b1-a1a1-e7d94f596560-kube-api-access-r8nkm\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:28:00.400272 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:00.400229    2583 generic.go:356] "Generic (PLEG): container finished" podID="4cca82dd-1734-45b1-a1a1-e7d94f596560" containerID="f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119" exitCode=0
Jul 07 14:28:00.400704 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:00.400288    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cc997749-cpm5r"
Jul 07 14:28:00.400704 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:00.400320    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cc997749-cpm5r" event={"ID":"4cca82dd-1734-45b1-a1a1-e7d94f596560","Type":"ContainerDied","Data":"f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119"}
Jul 07 14:28:00.400704 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:00.400376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cc997749-cpm5r" event={"ID":"4cca82dd-1734-45b1-a1a1-e7d94f596560","Type":"ContainerDied","Data":"5158e469d37614b7151892ef3325ced4b67971e697d2fa3e492eebf9bb5dd2c2"}
Jul 07 14:28:00.400704 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:00.400404    2583 scope.go:117] "RemoveContainer" containerID="f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119"
Jul 07 14:28:00.408840 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:00.408822    2583 scope.go:117] "RemoveContainer" containerID="f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119"
Jul 07 14:28:00.409112 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:28:00.409092    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119\": container with ID starting with f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119 not found: ID does not exist" containerID="f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119"
Jul 07 14:28:00.409174 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:00.409119    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119"} err="failed to get container status \"f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119\": rpc error: code = NotFound desc = could not find container \"f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119\": container with ID starting with f6f0c954fbb08f7f56bbe6c8433f451e3d5dba8edc840c8b63f0e28dd8660119 not found: ID does not exist"
Jul 07 14:28:00.422779 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:00.422746    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68cc997749-cpm5r"]
Jul 07 14:28:00.428007 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:00.427983    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68cc997749-cpm5r"]
Jul 07 14:28:00.467442 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:00.467411    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cca82dd-1734-45b1-a1a1-e7d94f596560" path="/var/lib/kubelet/pods/4cca82dd-1734-45b1-a1a1-e7d94f596560/volumes"
Jul 07 14:28:37.478512 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.478473    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"]
Jul 07 14:28:37.479078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.478834    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cca82dd-1734-45b1-a1a1-e7d94f596560" containerName="console"
Jul 07 14:28:37.479078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.478853    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cca82dd-1734-45b1-a1a1-e7d94f596560" containerName="console"
Jul 07 14:28:37.479078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.478866    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cbb180e-cbb0-49dc-841c-15de81809d11" containerName="console"
Jul 07 14:28:37.479078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.478873    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cbb180e-cbb0-49dc-841c-15de81809d11" containerName="console"
Jul 07 14:28:37.479078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.478952    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cca82dd-1734-45b1-a1a1-e7d94f596560" containerName="console"
Jul 07 14:28:37.479078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.478983    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cbb180e-cbb0-49dc-841c-15de81809d11" containerName="console"
Jul 07 14:28:37.483195 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.483172    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.485734 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.485708    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 14:28:37.485984 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.485950    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-px8v2\""
Jul 07 14:28:37.486590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.486576    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 14:28:37.495336 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.495312    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"]
Jul 07 14:28:37.570505 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.570459    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q28v9\" (UniqueName: \"kubernetes.io/projected/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-kube-api-access-q28v9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.570505 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.570503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.570731 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.570572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.671904 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.671850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q28v9\" (UniqueName: \"kubernetes.io/projected/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-kube-api-access-q28v9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.671904 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.671893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.672160 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.671915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.672387 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.672363    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.672387 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.672379    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.682328 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.682288    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q28v9\" (UniqueName: \"kubernetes.io/projected/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-kube-api-access-q28v9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.792068 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.791951    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:37.924660 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:37.924628    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"]
Jul 07 14:28:37.927945 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:28:37.927921    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3492ff46_3f8b_4d5a_9f29_5e140ff5c48b.slice/crio-b55d4ce851846eadddb3b1cb20848b9c10c1310b47bfa8079be71f6d577a92b6 WatchSource:0}: Error finding container b55d4ce851846eadddb3b1cb20848b9c10c1310b47bfa8079be71f6d577a92b6: Status 404 returned error can't find the container with id b55d4ce851846eadddb3b1cb20848b9c10c1310b47bfa8079be71f6d577a92b6
Jul 07 14:28:38.538888 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:38.538854    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj" event={"ID":"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b","Type":"ContainerStarted","Data":"b55d4ce851846eadddb3b1cb20848b9c10c1310b47bfa8079be71f6d577a92b6"}
Jul 07 14:28:46.570456 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:46.570423    2583 generic.go:356] "Generic (PLEG): container finished" podID="3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" containerID="f862c0fd6fabc9d70bc4981880156feec280914b1bf59f677d5243b58146970b" exitCode=0
Jul 07 14:28:46.570860 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:46.570463    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj" event={"ID":"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b","Type":"ContainerDied","Data":"f862c0fd6fabc9d70bc4981880156feec280914b1bf59f677d5243b58146970b"}
Jul 07 14:28:49.583070 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:49.583032    2583 generic.go:356] "Generic (PLEG): container finished" podID="3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" containerID="f324769d6d630e3d17eaf8b8bdf00288104735fa4aa9a0e6a0916b7580e6d121" exitCode=0
Jul 07 14:28:49.583444 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:49.583077    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj" event={"ID":"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b","Type":"ContainerDied","Data":"f324769d6d630e3d17eaf8b8bdf00288104735fa4aa9a0e6a0916b7580e6d121"}
Jul 07 14:28:58.619711 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:58.619674    2583 generic.go:356] "Generic (PLEG): container finished" podID="3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" containerID="45698c58bf3f26d029ba2311a84bb3b09632f5097e9afcf0d4f814c3c707721c" exitCode=0
Jul 07 14:28:58.620126 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:58.619750    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj" event={"ID":"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b","Type":"ContainerDied","Data":"45698c58bf3f26d029ba2311a84bb3b09632f5097e9afcf0d4f814c3c707721c"}
Jul 07 14:28:59.745774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:59.745749    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:28:59.863406 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:59.863371    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q28v9\" (UniqueName: \"kubernetes.io/projected/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-kube-api-access-q28v9\") pod \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") "
Jul 07 14:28:59.863603 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:59.863430    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-util\") pod \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") "
Jul 07 14:28:59.863603 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:59.863453    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-bundle\") pod \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\" (UID: \"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b\") "
Jul 07 14:28:59.864099 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:59.864073    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-bundle" (OuterVolumeSpecName: "bundle") pod "3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" (UID: "3492ff46-3f8b-4d5a-9f29-5e140ff5c48b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:28:59.865610 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:59.865583    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-kube-api-access-q28v9" (OuterVolumeSpecName: "kube-api-access-q28v9") pod "3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" (UID: "3492ff46-3f8b-4d5a-9f29-5e140ff5c48b"). InnerVolumeSpecName "kube-api-access-q28v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:28:59.867313 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:59.867293    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-util" (OuterVolumeSpecName: "util") pod "3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" (UID: "3492ff46-3f8b-4d5a-9f29-5e140ff5c48b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:28:59.964747 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:59.964714    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q28v9\" (UniqueName: \"kubernetes.io/projected/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-kube-api-access-q28v9\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:28:59.964747 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:59.964745    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-util\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:28:59.964942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:28:59.964757    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3492ff46-3f8b-4d5a-9f29-5e140ff5c48b-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:29:00.628438 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:00.628406    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj" event={"ID":"3492ff46-3f8b-4d5a-9f29-5e140ff5c48b","Type":"ContainerDied","Data":"b55d4ce851846eadddb3b1cb20848b9c10c1310b47bfa8079be71f6d577a92b6"}
Jul 07 14:29:00.628438 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:00.628441    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nfjmj"
Jul 07 14:29:00.628635 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:00.628452    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b55d4ce851846eadddb3b1cb20848b9c10c1310b47bfa8079be71f6d577a92b6"
Jul 07 14:29:05.513657 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.513619    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"]
Jul 07 14:29:05.514085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.513876    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" containerName="extract"
Jul 07 14:29:05.514085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.513887    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" containerName="extract"
Jul 07 14:29:05.514085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.513903    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" containerName="util"
Jul 07 14:29:05.514085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.513908    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" containerName="util"
Jul 07 14:29:05.514085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.513915    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" containerName="pull"
Jul 07 14:29:05.514085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.513919    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" containerName="pull"
Jul 07 14:29:05.514085 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.513972    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3492ff46-3f8b-4d5a-9f29-5e140ff5c48b" containerName="extract"
Jul 07 14:29:05.517684 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.517663    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"
Jul 07 14:29:05.522041 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.522007    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 14:29:05.522196 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.522084    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:29:05.522196 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.522095    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-b6pln\""
Jul 07 14:29:05.535526 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.535501    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"]
Jul 07 14:29:05.607543 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.607505    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkrl8\" (UniqueName: \"kubernetes.io/projected/213bbffd-c0dd-469f-9380-01e58f6d7550-kube-api-access-qkrl8\") pod \"cert-manager-operator-controller-manager-55c444bf86-nvcps\" (UID: \"213bbffd-c0dd-469f-9380-01e58f6d7550\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"
Jul 07 14:29:05.607724 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.607556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/213bbffd-c0dd-469f-9380-01e58f6d7550-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nvcps\" (UID: \"213bbffd-c0dd-469f-9380-01e58f6d7550\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"
Jul 07 14:29:05.708306 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.708268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkrl8\" (UniqueName: \"kubernetes.io/projected/213bbffd-c0dd-469f-9380-01e58f6d7550-kube-api-access-qkrl8\") pod \"cert-manager-operator-controller-manager-55c444bf86-nvcps\" (UID: \"213bbffd-c0dd-469f-9380-01e58f6d7550\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"
Jul 07 14:29:05.708474 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.708325    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/213bbffd-c0dd-469f-9380-01e58f6d7550-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nvcps\" (UID: \"213bbffd-c0dd-469f-9380-01e58f6d7550\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"
Jul 07 14:29:05.708772 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.708753    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/213bbffd-c0dd-469f-9380-01e58f6d7550-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nvcps\" (UID: \"213bbffd-c0dd-469f-9380-01e58f6d7550\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"
Jul 07 14:29:05.719024 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.718994    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkrl8\" (UniqueName: \"kubernetes.io/projected/213bbffd-c0dd-469f-9380-01e58f6d7550-kube-api-access-qkrl8\") pod \"cert-manager-operator-controller-manager-55c444bf86-nvcps\" (UID: \"213bbffd-c0dd-469f-9380-01e58f6d7550\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"
Jul 07 14:29:05.826530 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.826434    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"
Jul 07 14:29:05.969385 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:05.969338    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps"]
Jul 07 14:29:05.974345 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:29:05.974314    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod213bbffd_c0dd_469f_9380_01e58f6d7550.slice/crio-6817cac3d991332eb880aeb67bdc5eec8c31b2dd81b5f977e911736d17b2fedc WatchSource:0}: Error finding container 6817cac3d991332eb880aeb67bdc5eec8c31b2dd81b5f977e911736d17b2fedc: Status 404 returned error can't find the container with id 6817cac3d991332eb880aeb67bdc5eec8c31b2dd81b5f977e911736d17b2fedc
Jul 07 14:29:06.651996 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:06.651948    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps" event={"ID":"213bbffd-c0dd-469f-9380-01e58f6d7550","Type":"ContainerStarted","Data":"6817cac3d991332eb880aeb67bdc5eec8c31b2dd81b5f977e911736d17b2fedc"}
Jul 07 14:29:07.659277 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:07.659242    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps" event={"ID":"213bbffd-c0dd-469f-9380-01e58f6d7550","Type":"ContainerStarted","Data":"d26dc180857f0fb44af498fbf3eddf06746d13970fe83568fd3b57665677f3d5"}
Jul 07 14:29:07.686324 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:07.686267    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nvcps" podStartSLOduration=1.200116074 podStartE2EDuration="2.686249835s" totalImagesPullingTime="1.486133761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:29:07.685900668 +0000 UTC m=+279.713408778" watchObservedRunningTime="2026-07-07 14:29:07.686249835 +0000 UTC m=+279.713757942"
Jul 07 14:29:08.758012 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:08.757978    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"]
Jul 07 14:29:08.760130 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:08.760114    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:08.762487 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:08.762460    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 14:29:08.762487 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:08.762479    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-px8v2\""
Jul 07 14:29:08.763318 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:08.763304    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 14:29:08.771017 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:08.770990    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"]
Jul 07 14:29:08.937821 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:08.937784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:08.937821 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:08.937836    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5cct\" (UniqueName: \"kubernetes.io/projected/3c334f82-9381-43e2-8803-a39374ce1c96-kube-api-access-r5cct\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:08.938081 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:08.937920    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:09.039466 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.039382    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:09.039466 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.039438    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5cct\" (UniqueName: \"kubernetes.io/projected/3c334f82-9381-43e2-8803-a39374ce1c96-kube-api-access-r5cct\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:09.039639 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.039476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:09.039845 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.039818    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:09.039931 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.039843    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:09.052579 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.052546    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5cct\" (UniqueName: \"kubernetes.io/projected/3c334f82-9381-43e2-8803-a39374ce1c96-kube-api-access-r5cct\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:09.069602 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.069565    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:09.204161 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.204134    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"]
Jul 07 14:29:09.206346 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:29:09.206319    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c334f82_9381_43e2_8803_a39374ce1c96.slice/crio-981cd6442ea9c671238a715388d3abed8b9a3087b961c148988836408c053c93 WatchSource:0}: Error finding container 981cd6442ea9c671238a715388d3abed8b9a3087b961c148988836408c053c93: Status 404 returned error can't find the container with id 981cd6442ea9c671238a715388d3abed8b9a3087b961c148988836408c053c93
Jul 07 14:29:09.669137 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.669042    2583 generic.go:356] "Generic (PLEG): container finished" podID="3c334f82-9381-43e2-8803-a39374ce1c96" containerID="442789affd465fc90c43200dffd77a879f26a665e88a8de363f4d9d6e3cd1b8e" exitCode=0
Jul 07 14:29:09.669286 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.669132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86" event={"ID":"3c334f82-9381-43e2-8803-a39374ce1c96","Type":"ContainerDied","Data":"442789affd465fc90c43200dffd77a879f26a665e88a8de363f4d9d6e3cd1b8e"}
Jul 07 14:29:09.669286 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:09.669188    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86" event={"ID":"3c334f82-9381-43e2-8803-a39374ce1c96","Type":"ContainerStarted","Data":"981cd6442ea9c671238a715388d3abed8b9a3087b961c148988836408c053c93"}
Jul 07 14:29:11.122551 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.122519    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"]
Jul 07 14:29:11.128298 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.128272    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"
Jul 07 14:29:11.131575 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.131548    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 14:29:11.131709 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.131606    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 14:29:11.139407 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.139375    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"]
Jul 07 14:29:11.258281 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.258240    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mfj2\" (UniqueName: \"kubernetes.io/projected/e1face7d-114d-479c-9e43-4ab3d01d1cf8-kube-api-access-7mfj2\") pod \"cert-manager-cainjector-559cdd8c87-mnc5t\" (UID: \"e1face7d-114d-479c-9e43-4ab3d01d1cf8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"
Jul 07 14:29:11.258475 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.258317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1face7d-114d-479c-9e43-4ab3d01d1cf8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mnc5t\" (UID: \"e1face7d-114d-479c-9e43-4ab3d01d1cf8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"
Jul 07 14:29:11.359761 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.359724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mfj2\" (UniqueName: \"kubernetes.io/projected/e1face7d-114d-479c-9e43-4ab3d01d1cf8-kube-api-access-7mfj2\") pod \"cert-manager-cainjector-559cdd8c87-mnc5t\" (UID: \"e1face7d-114d-479c-9e43-4ab3d01d1cf8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"
Jul 07 14:29:11.359937 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.359789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1face7d-114d-479c-9e43-4ab3d01d1cf8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mnc5t\" (UID: \"e1face7d-114d-479c-9e43-4ab3d01d1cf8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"
Jul 07 14:29:11.374688 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.374612    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1face7d-114d-479c-9e43-4ab3d01d1cf8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mnc5t\" (UID: \"e1face7d-114d-479c-9e43-4ab3d01d1cf8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"
Jul 07 14:29:11.374688 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.374662    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mfj2\" (UniqueName: \"kubernetes.io/projected/e1face7d-114d-479c-9e43-4ab3d01d1cf8-kube-api-access-7mfj2\") pod \"cert-manager-cainjector-559cdd8c87-mnc5t\" (UID: \"e1face7d-114d-479c-9e43-4ab3d01d1cf8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"
Jul 07 14:29:11.448554 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.448511    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"
Jul 07 14:29:11.734978 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.734928    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t"]
Jul 07 14:29:11.737449 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:29:11.737414    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1face7d_114d_479c_9e43_4ab3d01d1cf8.slice/crio-7b39a269e19b07372b9e6f12079f4767ab56304144632da8c8bd62a2f0c7c071 WatchSource:0}: Error finding container 7b39a269e19b07372b9e6f12079f4767ab56304144632da8c8bd62a2f0c7c071: Status 404 returned error can't find the container with id 7b39a269e19b07372b9e6f12079f4767ab56304144632da8c8bd62a2f0c7c071
Jul 07 14:29:11.882496 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.882467    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c6zlx"]
Jul 07 14:29:11.884409 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.884365    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx"
Jul 07 14:29:11.887317 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.887296    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qms5j\""
Jul 07 14:29:11.909113 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:11.909089    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c6zlx"]
Jul 07 14:29:12.065646 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.065610    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b9d521a-d030-4a08-aed5-d8137f6f4919-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c6zlx\" (UID: \"0b9d521a-d030-4a08-aed5-d8137f6f4919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx"
Jul 07 14:29:12.065823 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.065687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svxch\" (UniqueName: \"kubernetes.io/projected/0b9d521a-d030-4a08-aed5-d8137f6f4919-kube-api-access-svxch\") pod \"cert-manager-webhook-6486ffd997-c6zlx\" (UID: \"0b9d521a-d030-4a08-aed5-d8137f6f4919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx"
Jul 07 14:29:12.166935 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.166850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svxch\" (UniqueName: \"kubernetes.io/projected/0b9d521a-d030-4a08-aed5-d8137f6f4919-kube-api-access-svxch\") pod \"cert-manager-webhook-6486ffd997-c6zlx\" (UID: \"0b9d521a-d030-4a08-aed5-d8137f6f4919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx"
Jul 07 14:29:12.166935 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.166921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b9d521a-d030-4a08-aed5-d8137f6f4919-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c6zlx\" (UID: \"0b9d521a-d030-4a08-aed5-d8137f6f4919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx"
Jul 07 14:29:12.177917 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.177890    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b9d521a-d030-4a08-aed5-d8137f6f4919-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c6zlx\" (UID: \"0b9d521a-d030-4a08-aed5-d8137f6f4919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx"
Jul 07 14:29:12.178057 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.177924    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svxch\" (UniqueName: \"kubernetes.io/projected/0b9d521a-d030-4a08-aed5-d8137f6f4919-kube-api-access-svxch\") pod \"cert-manager-webhook-6486ffd997-c6zlx\" (UID: \"0b9d521a-d030-4a08-aed5-d8137f6f4919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx"
Jul 07 14:29:12.193342 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.193320    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx"
Jul 07 14:29:12.328787 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.328756    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c6zlx"]
Jul 07 14:29:12.331919 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:29:12.331891    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b9d521a_d030_4a08_aed5_d8137f6f4919.slice/crio-b1832b491c79e252abbc1a79eca1cc4861046f55112ee7d46fdbc1a47877bf20 WatchSource:0}: Error finding container b1832b491c79e252abbc1a79eca1cc4861046f55112ee7d46fdbc1a47877bf20: Status 404 returned error can't find the container with id b1832b491c79e252abbc1a79eca1cc4861046f55112ee7d46fdbc1a47877bf20
Jul 07 14:29:12.690048 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.690001    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t" event={"ID":"e1face7d-114d-479c-9e43-4ab3d01d1cf8","Type":"ContainerStarted","Data":"7b39a269e19b07372b9e6f12079f4767ab56304144632da8c8bd62a2f0c7c071"}
Jul 07 14:29:12.692029 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.692001    2583 generic.go:356] "Generic (PLEG): container finished" podID="3c334f82-9381-43e2-8803-a39374ce1c96" containerID="b6a9b55be56aa6d010255238a40f7e9274de7613446fd11f83205be0219c16e3" exitCode=0
Jul 07 14:29:12.692150 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.692097    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86" event={"ID":"3c334f82-9381-43e2-8803-a39374ce1c96","Type":"ContainerDied","Data":"b6a9b55be56aa6d010255238a40f7e9274de7613446fd11f83205be0219c16e3"}
Jul 07 14:29:12.693405 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:12.693370    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx" event={"ID":"0b9d521a-d030-4a08-aed5-d8137f6f4919","Type":"ContainerStarted","Data":"b1832b491c79e252abbc1a79eca1cc4861046f55112ee7d46fdbc1a47877bf20"}
Jul 07 14:29:13.702570 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:13.702534    2583 generic.go:356] "Generic (PLEG): container finished" podID="3c334f82-9381-43e2-8803-a39374ce1c96" containerID="f7e66a5c63c1d1bab11b747f76a476ea879603e94feff5a984cbdfd15f74ef0e" exitCode=0
Jul 07 14:29:13.703050 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:13.702604    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86" event={"ID":"3c334f82-9381-43e2-8803-a39374ce1c96","Type":"ContainerDied","Data":"f7e66a5c63c1d1bab11b747f76a476ea879603e94feff5a984cbdfd15f74ef0e"}
Jul 07 14:29:14.708775 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.708739    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx" event={"ID":"0b9d521a-d030-4a08-aed5-d8137f6f4919","Type":"ContainerStarted","Data":"6b79d6dc6ba2914a90a791fcd2d1326ff7b4a24117484474947cc97ed89453d8"}
Jul 07 14:29:14.709278 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.708845    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx"
Jul 07 14:29:14.710304 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.710275    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t" event={"ID":"e1face7d-114d-479c-9e43-4ab3d01d1cf8","Type":"ContainerStarted","Data":"31950a23a935d763b87ed252f7137f76dd140748f234cbedef2afeb87a2f0bbe"}
Jul 07 14:29:14.730919 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.730868    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx" podStartSLOduration=1.688063894 podStartE2EDuration="3.730847447s" totalImagesPullingTime="2.042783553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:29:14.730314629 +0000 UTC m=+286.757822738" watchObservedRunningTime="2026-07-07 14:29:14.730847447 +0000 UTC m=+286.758355556"
Jul 07 14:29:14.748693 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.748638    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mnc5t" podStartSLOduration=1.117334965 podStartE2EDuration="3.748621123s" totalImagesPullingTime="2.631286158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:29:14.74742067 +0000 UTC m=+286.774928779" watchObservedRunningTime="2026-07-07 14:29:14.748621123 +0000 UTC m=+286.776129230"
Jul 07 14:29:14.850279 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.850251    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:14.890547 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.890516    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5cct\" (UniqueName: \"kubernetes.io/projected/3c334f82-9381-43e2-8803-a39374ce1c96-kube-api-access-r5cct\") pod \"3c334f82-9381-43e2-8803-a39374ce1c96\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") "
Jul 07 14:29:14.890729 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.890561    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-bundle\") pod \"3c334f82-9381-43e2-8803-a39374ce1c96\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") "
Jul 07 14:29:14.890729 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.890614    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-util\") pod \"3c334f82-9381-43e2-8803-a39374ce1c96\" (UID: \"3c334f82-9381-43e2-8803-a39374ce1c96\") "
Jul 07 14:29:14.891049 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.891026    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-bundle" (OuterVolumeSpecName: "bundle") pod "3c334f82-9381-43e2-8803-a39374ce1c96" (UID: "3c334f82-9381-43e2-8803-a39374ce1c96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:29:14.892713 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.892684    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c334f82-9381-43e2-8803-a39374ce1c96-kube-api-access-r5cct" (OuterVolumeSpecName: "kube-api-access-r5cct") pod "3c334f82-9381-43e2-8803-a39374ce1c96" (UID: "3c334f82-9381-43e2-8803-a39374ce1c96"). InnerVolumeSpecName "kube-api-access-r5cct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:29:14.895182 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.895160    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-util" (OuterVolumeSpecName: "util") pod "3c334f82-9381-43e2-8803-a39374ce1c96" (UID: "3c334f82-9381-43e2-8803-a39374ce1c96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:29:14.991303 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.991201    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-util\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:29:14.991303 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.991245    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5cct\" (UniqueName: \"kubernetes.io/projected/3c334f82-9381-43e2-8803-a39374ce1c96-kube-api-access-r5cct\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:29:14.991303 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:14.991255    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c334f82-9381-43e2-8803-a39374ce1c96-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:29:15.715954 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:15.715923    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86"
Jul 07 14:29:15.716359 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:15.715976    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvfg86" event={"ID":"3c334f82-9381-43e2-8803-a39374ce1c96","Type":"ContainerDied","Data":"981cd6442ea9c671238a715388d3abed8b9a3087b961c148988836408c053c93"}
Jul 07 14:29:15.716359 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:15.716025    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="981cd6442ea9c671238a715388d3abed8b9a3087b961c148988836408c053c93"
Jul 07 14:29:20.718518 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:20.718482    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c6zlx"
Jul 07 14:29:28.334066 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:28.334031    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:29:28.334535 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:28.334353    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:29:28.342953 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:28.342928    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 14:29:29.218494 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.218452    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"]
Jul 07 14:29:29.220637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.218836    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c334f82-9381-43e2-8803-a39374ce1c96" containerName="pull"
Jul 07 14:29:29.220637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.218851    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c334f82-9381-43e2-8803-a39374ce1c96" containerName="pull"
Jul 07 14:29:29.220637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.218863    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c334f82-9381-43e2-8803-a39374ce1c96" containerName="extract"
Jul 07 14:29:29.220637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.218871    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c334f82-9381-43e2-8803-a39374ce1c96" containerName="extract"
Jul 07 14:29:29.220637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.218887    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c334f82-9381-43e2-8803-a39374ce1c96" containerName="util"
Jul 07 14:29:29.220637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.218895    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c334f82-9381-43e2-8803-a39374ce1c96" containerName="util"
Jul 07 14:29:29.220637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.218991    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c334f82-9381-43e2-8803-a39374ce1c96" containerName="extract"
Jul 07 14:29:29.222161 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.222145    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.224819 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.224798    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 14:29:29.225749 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.225726    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 14:29:29.225852 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.225810    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-px8v2\""
Jul 07 14:29:29.231770 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.231746    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"]
Jul 07 14:29:29.298796 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.298763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpcgz\" (UniqueName: \"kubernetes.io/projected/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-kube-api-access-mpcgz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.299000 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.298802    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.299000 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.298883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.399655 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.399620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpcgz\" (UniqueName: \"kubernetes.io/projected/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-kube-api-access-mpcgz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.399655 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.399656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.400110 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.399703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.400110 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.400054    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.400177 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.400117    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.409569 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.409547    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpcgz\" (UniqueName: \"kubernetes.io/projected/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-kube-api-access-mpcgz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.531980 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.531854    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:29.665887 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.665844    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"]
Jul 07 14:29:29.668795 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:29:29.668767    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cd9fb9_2aee_4438_9c16_2190a2ce0183.slice/crio-3258bc4b0c4576a5a4934dab32b2dfcdfcaeeafe788757444545edeff3f0e6ed WatchSource:0}: Error finding container 3258bc4b0c4576a5a4934dab32b2dfcdfcaeeafe788757444545edeff3f0e6ed: Status 404 returned error can't find the container with id 3258bc4b0c4576a5a4934dab32b2dfcdfcaeeafe788757444545edeff3f0e6ed
Jul 07 14:29:29.775665 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.775630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499" event={"ID":"e1cd9fb9-2aee-4438-9c16-2190a2ce0183","Type":"ContainerStarted","Data":"6c132f28f67f747a55960371437001357eba0e85db417b5860d9af1197bef83a"}
Jul 07 14:29:29.775811 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.775689    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499" event={"ID":"e1cd9fb9-2aee-4438-9c16-2190a2ce0183","Type":"ContainerStarted","Data":"3258bc4b0c4576a5a4934dab32b2dfcdfcaeeafe788757444545edeff3f0e6ed"}
Jul 07 14:29:29.776218 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:29.776193    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:29:30.781494 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:30.781458    2583 generic.go:356] "Generic (PLEG): container finished" podID="e1cd9fb9-2aee-4438-9c16-2190a2ce0183" containerID="6c132f28f67f747a55960371437001357eba0e85db417b5860d9af1197bef83a" exitCode=0
Jul 07 14:29:30.781494 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:30.781488    2583 generic.go:356] "Generic (PLEG): container finished" podID="e1cd9fb9-2aee-4438-9c16-2190a2ce0183" containerID="2c45cffa3193d30965018d623f52c303e6eb067cf45409e1632c9d571f8f1f5c" exitCode=0
Jul 07 14:29:30.782019 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:30.781520    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499" event={"ID":"e1cd9fb9-2aee-4438-9c16-2190a2ce0183","Type":"ContainerDied","Data":"6c132f28f67f747a55960371437001357eba0e85db417b5860d9af1197bef83a"}
Jul 07 14:29:30.782019 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:30.781561    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499" event={"ID":"e1cd9fb9-2aee-4438-9c16-2190a2ce0183","Type":"ContainerDied","Data":"2c45cffa3193d30965018d623f52c303e6eb067cf45409e1632c9d571f8f1f5c"}
Jul 07 14:29:31.788066 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:31.788027    2583 generic.go:356] "Generic (PLEG): container finished" podID="e1cd9fb9-2aee-4438-9c16-2190a2ce0183" containerID="e1ddf345a647725b7056af23aebf3f78515bc2f1a856b018043a1d23cdfb4d26" exitCode=0
Jul 07 14:29:31.788478 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:31.788118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499" event={"ID":"e1cd9fb9-2aee-4438-9c16-2190a2ce0183","Type":"ContainerDied","Data":"e1ddf345a647725b7056af23aebf3f78515bc2f1a856b018043a1d23cdfb4d26"}
Jul 07 14:29:32.936686 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:32.936654    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:33.030006 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.029940    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-bundle\") pod \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") "
Jul 07 14:29:33.030181 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.030023    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpcgz\" (UniqueName: \"kubernetes.io/projected/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-kube-api-access-mpcgz\") pod \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") "
Jul 07 14:29:33.030181 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.030061    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-util\") pod \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\" (UID: \"e1cd9fb9-2aee-4438-9c16-2190a2ce0183\") "
Jul 07 14:29:33.030687 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.030654    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-bundle" (OuterVolumeSpecName: "bundle") pod "e1cd9fb9-2aee-4438-9c16-2190a2ce0183" (UID: "e1cd9fb9-2aee-4438-9c16-2190a2ce0183"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:29:33.032160 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.032126    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-kube-api-access-mpcgz" (OuterVolumeSpecName: "kube-api-access-mpcgz") pod "e1cd9fb9-2aee-4438-9c16-2190a2ce0183" (UID: "e1cd9fb9-2aee-4438-9c16-2190a2ce0183"). InnerVolumeSpecName "kube-api-access-mpcgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:29:33.036183 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.036039    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-util" (OuterVolumeSpecName: "util") pod "e1cd9fb9-2aee-4438-9c16-2190a2ce0183" (UID: "e1cd9fb9-2aee-4438-9c16-2190a2ce0183"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:29:33.130685 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.130595    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:29:33.130685 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.130626    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpcgz\" (UniqueName: \"kubernetes.io/projected/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-kube-api-access-mpcgz\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:29:33.130685 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.130637    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1cd9fb9-2aee-4438-9c16-2190a2ce0183-util\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:29:33.799060 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.799017    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499" event={"ID":"e1cd9fb9-2aee-4438-9c16-2190a2ce0183","Type":"ContainerDied","Data":"3258bc4b0c4576a5a4934dab32b2dfcdfcaeeafe788757444545edeff3f0e6ed"}
Jul 07 14:29:33.799235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.799066    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb8499"
Jul 07 14:29:33.799235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:33.799077    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3258bc4b0c4576a5a4934dab32b2dfcdfcaeeafe788757444545edeff3f0e6ed"
Jul 07 14:29:44.723739 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.723704    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"]
Jul 07 14:29:44.724239 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.723999    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1cd9fb9-2aee-4438-9c16-2190a2ce0183" containerName="pull"
Jul 07 14:29:44.724239 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.724011    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1cd9fb9-2aee-4438-9c16-2190a2ce0183" containerName="pull"
Jul 07 14:29:44.724239 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.724019    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1cd9fb9-2aee-4438-9c16-2190a2ce0183" containerName="util"
Jul 07 14:29:44.724239 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.724024    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1cd9fb9-2aee-4438-9c16-2190a2ce0183" containerName="util"
Jul 07 14:29:44.724239 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.724039    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1cd9fb9-2aee-4438-9c16-2190a2ce0183" containerName="extract"
Jul 07 14:29:44.724239 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.724047    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1cd9fb9-2aee-4438-9c16-2190a2ce0183" containerName="extract"
Jul 07 14:29:44.724239 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.724110    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1cd9fb9-2aee-4438-9c16-2190a2ce0183" containerName="extract"
Jul 07 14:29:44.766817 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.766776    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"]
Jul 07 14:29:44.767001 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.766904    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.769714 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.769684    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 14:29:44.769865 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.769695    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 14:29:44.769865 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.769746    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 14:29:44.769865 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.769758    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v7xjz\""
Jul 07 14:29:44.769865 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.769758    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 14:29:44.832332 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.832291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6385807e-73af-454c-948f-3758fc23f853-manifests\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.832332 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.832339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6385807e-73af-454c-948f-3758fc23f853-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.832570 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.832428    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6385807e-73af-454c-948f-3758fc23f853-tmp\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.832570 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.832449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6385807e-73af-454c-948f-3758fc23f853-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.832570 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.832523    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djtmk\" (UniqueName: \"kubernetes.io/projected/6385807e-73af-454c-948f-3758fc23f853-kube-api-access-djtmk\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.933169 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.933136    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6385807e-73af-454c-948f-3758fc23f853-manifests\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.933367 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.933186    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6385807e-73af-454c-948f-3758fc23f853-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.933367 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.933233    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6385807e-73af-454c-948f-3758fc23f853-tmp\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.933367 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.933255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6385807e-73af-454c-948f-3758fc23f853-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.933367 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.933301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djtmk\" (UniqueName: \"kubernetes.io/projected/6385807e-73af-454c-948f-3758fc23f853-kube-api-access-djtmk\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.933573 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.933505    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6385807e-73af-454c-948f-3758fc23f853-manifests\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.935618 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.935586    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6385807e-73af-454c-948f-3758fc23f853-tmp\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.935739 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.935652    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6385807e-73af-454c-948f-3758fc23f853-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.935785 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.935741    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6385807e-73af-454c-948f-3758fc23f853-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:44.946694 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:44.946659    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djtmk\" (UniqueName: \"kubernetes.io/projected/6385807e-73af-454c-948f-3758fc23f853-kube-api-access-djtmk\") pod \"opendatahub-operator-controller-manager-6f546bc4-rgxhw\" (UID: \"6385807e-73af-454c-948f-3758fc23f853\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:45.077409 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:45.077317    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:45.238293 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:45.238257    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"]
Jul 07 14:29:45.241362 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:29:45.241336    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6385807e_73af_454c_948f_3758fc23f853.slice/crio-cc13724de9ecdb5c2cc2699eefa1c4ab8e3d35d14dc5f28a496fd59b5b2e14da WatchSource:0}: Error finding container cc13724de9ecdb5c2cc2699eefa1c4ab8e3d35d14dc5f28a496fd59b5b2e14da: Status 404 returned error can't find the container with id cc13724de9ecdb5c2cc2699eefa1c4ab8e3d35d14dc5f28a496fd59b5b2e14da
Jul 07 14:29:45.851230 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:45.851193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw" event={"ID":"6385807e-73af-454c-948f-3758fc23f853","Type":"ContainerStarted","Data":"cc13724de9ecdb5c2cc2699eefa1c4ab8e3d35d14dc5f28a496fd59b5b2e14da"}
Jul 07 14:29:48.867927 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:48.867882    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw" event={"ID":"6385807e-73af-454c-948f-3758fc23f853","Type":"ContainerStarted","Data":"47162422d0a52c63f744388705384dcb9e80d17944b73e47788d76f70f419b47"}
Jul 07 14:29:49.874118 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:49.874081    2583 generic.go:356] "Generic (PLEG): container finished" podID="6385807e-73af-454c-948f-3758fc23f853" containerID="47162422d0a52c63f744388705384dcb9e80d17944b73e47788d76f70f419b47" exitCode=0
Jul 07 14:29:49.874505 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:49.874176    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw" event={"ID":"6385807e-73af-454c-948f-3758fc23f853","Type":"ContainerDied","Data":"47162422d0a52c63f744388705384dcb9e80d17944b73e47788d76f70f419b47"}
Jul 07 14:29:50.880045 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:50.880009    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw" event={"ID":"6385807e-73af-454c-948f-3758fc23f853","Type":"ContainerStarted","Data":"33f931615ca78f2d631fab30df8bd96e1f658809d5176a3687cbbe597e94da5f"}
Jul 07 14:29:50.880466 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:50.880131    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:29:50.905470 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:29:50.905419    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw" podStartSLOduration=2.436636962 podStartE2EDuration="6.905400402s" totalImagesPullingTime="3.411546973s" totalInitContainerRuntime="1.057216467s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:29:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:29:50.903768899 +0000 UTC m=+322.931277007" watchObservedRunningTime="2026-07-07 14:29:50.905400402 +0000 UTC m=+322.932908557"
Jul 07 14:30:01.886739 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:01.886700    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-rgxhw"
Jul 07 14:30:03.182009 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.181955    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"]
Jul 07 14:30:03.189259 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.189226    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.192442 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.192402    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 14:30:03.192598 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.192539    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 14:30:03.192598 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.192555    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 14:30:03.192705 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.192539    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:30:03.192705 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.192551    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 14:30:03.192705 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.192647    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vz5x5\""
Jul 07 14:30:03.200136 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.200111    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"]
Jul 07 14:30:03.286042 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.286000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt6b9\" (UniqueName: \"kubernetes.io/projected/72766a8d-c1a3-4835-b787-5fd8fe4e9011-kube-api-access-nt6b9\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.286220 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.286088    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/72766a8d-c1a3-4835-b787-5fd8fe4e9011-manager-config\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.286220 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.286115    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/72766a8d-c1a3-4835-b787-5fd8fe4e9011-metrics-cert\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.286220 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.286147    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72766a8d-c1a3-4835-b787-5fd8fe4e9011-cert\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.387361 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.387310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/72766a8d-c1a3-4835-b787-5fd8fe4e9011-manager-config\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.387361 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.387362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/72766a8d-c1a3-4835-b787-5fd8fe4e9011-metrics-cert\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.387607 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.387391    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72766a8d-c1a3-4835-b787-5fd8fe4e9011-cert\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.387607 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.387423    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt6b9\" (UniqueName: \"kubernetes.io/projected/72766a8d-c1a3-4835-b787-5fd8fe4e9011-kube-api-access-nt6b9\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.388035 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.388018    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/72766a8d-c1a3-4835-b787-5fd8fe4e9011-manager-config\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.389926 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.389903    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72766a8d-c1a3-4835-b787-5fd8fe4e9011-cert\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.390020 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.389955    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/72766a8d-c1a3-4835-b787-5fd8fe4e9011-metrics-cert\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.401617 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.401589    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt6b9\" (UniqueName: \"kubernetes.io/projected/72766a8d-c1a3-4835-b787-5fd8fe4e9011-kube-api-access-nt6b9\") pod \"lws-controller-manager-5b9884d45d-jm2sq\" (UID: \"72766a8d-c1a3-4835-b787-5fd8fe4e9011\") " pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.499390 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.499351    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:03.637028 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.636988    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"]
Jul 07 14:30:03.648072 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:30:03.648041    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72766a8d_c1a3_4835_b787_5fd8fe4e9011.slice/crio-ac280237065a6e0b9cf0d99cb68031f4b2aded19d5c137400cf95c76a21e61a2 WatchSource:0}: Error finding container ac280237065a6e0b9cf0d99cb68031f4b2aded19d5c137400cf95c76a21e61a2: Status 404 returned error can't find the container with id ac280237065a6e0b9cf0d99cb68031f4b2aded19d5c137400cf95c76a21e61a2
Jul 07 14:30:03.935207 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:03.935120    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq" event={"ID":"72766a8d-c1a3-4835-b787-5fd8fe4e9011","Type":"ContainerStarted","Data":"ac280237065a6e0b9cf0d99cb68031f4b2aded19d5c137400cf95c76a21e61a2"}
Jul 07 14:30:06.951252 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:06.951218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq" event={"ID":"72766a8d-c1a3-4835-b787-5fd8fe4e9011","Type":"ContainerStarted","Data":"21c4d5f5f1042d4cf179fd6c2ec79173560bc09c21263bb16bc9da58c5fd7084"}
Jul 07 14:30:06.951659 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:06.951350    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:06.978999 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:06.978924    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq" podStartSLOduration=1.013188149 podStartE2EDuration="3.97890671s" totalImagesPullingTime="2.965718561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:06.976286681 +0000 UTC m=+339.003794799" watchObservedRunningTime="2026-07-07 14:30:06.97890671 +0000 UTC m=+339.006414818"
Jul 07 14:30:14.658521 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.658488    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"]
Jul 07 14:30:14.661907 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.661886    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.664947 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.664904    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 14:30:14.665158 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.665141    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cq6w4\""
Jul 07 14:30:14.665429 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.665410    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 14:30:14.665429 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.665420    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:30:14.668771 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.668747    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 14:30:14.669123 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.669103    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 14:30:14.669265 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.669135    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 14:30:14.678289 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.678260    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"]
Jul 07 14:30:14.681582 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.681554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/632935bd-c9ef-449c-8b37-c62899a312e7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.681709 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.681587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/632935bd-c9ef-449c-8b37-c62899a312e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.681709 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.681606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/632935bd-c9ef-449c-8b37-c62899a312e7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.681709 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.681624    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/632935bd-c9ef-449c-8b37-c62899a312e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.681709 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.681687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/632935bd-c9ef-449c-8b37-c62899a312e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.681922 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.681731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/632935bd-c9ef-449c-8b37-c62899a312e7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.681922 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.681765    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7jdn\" (UniqueName: \"kubernetes.io/projected/632935bd-c9ef-449c-8b37-c62899a312e7-kube-api-access-v7jdn\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.782245 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.782196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/632935bd-c9ef-449c-8b37-c62899a312e7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.782245 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.782247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/632935bd-c9ef-449c-8b37-c62899a312e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.782508 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.782272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/632935bd-c9ef-449c-8b37-c62899a312e7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.782508 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.782292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/632935bd-c9ef-449c-8b37-c62899a312e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.782508 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.782314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/632935bd-c9ef-449c-8b37-c62899a312e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.782508 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.782351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/632935bd-c9ef-449c-8b37-c62899a312e7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.782508 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.782386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7jdn\" (UniqueName: \"kubernetes.io/projected/632935bd-c9ef-449c-8b37-c62899a312e7-kube-api-access-v7jdn\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.783158 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.783132    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/632935bd-c9ef-449c-8b37-c62899a312e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.784732 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.784702    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/632935bd-c9ef-449c-8b37-c62899a312e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.784732 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.784720    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/632935bd-c9ef-449c-8b37-c62899a312e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.785006 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.784988    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/632935bd-c9ef-449c-8b37-c62899a312e7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.785076 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.785003    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/632935bd-c9ef-449c-8b37-c62899a312e7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.793309 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.793280    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7jdn\" (UniqueName: \"kubernetes.io/projected/632935bd-c9ef-449c-8b37-c62899a312e7-kube-api-access-v7jdn\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.793625 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.793609    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/632935bd-c9ef-449c-8b37-c62899a312e7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p798p\" (UID: \"632935bd-c9ef-449c-8b37-c62899a312e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:14.971361 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:14.971330    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:15.125913 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:15.125881    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"]
Jul 07 14:30:15.126126 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:30:15.126102    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632935bd_c9ef_449c_8b37_c62899a312e7.slice/crio-eeb993c96900d800640f3fe4ebe580180ade7eee0f98c12ae848b0d091841ea5 WatchSource:0}: Error finding container eeb993c96900d800640f3fe4ebe580180ade7eee0f98c12ae848b0d091841ea5: Status 404 returned error can't find the container with id eeb993c96900d800640f3fe4ebe580180ade7eee0f98c12ae848b0d091841ea5
Jul 07 14:30:15.994829 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:15.994785    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p" event={"ID":"632935bd-c9ef-449c-8b37-c62899a312e7","Type":"ContainerStarted","Data":"eeb993c96900d800640f3fe4ebe580180ade7eee0f98c12ae848b0d091841ea5"}
Jul 07 14:30:17.467227 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:17.467184    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:30:17.467518 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:17.467262    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:30:17.931872 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:17.931792    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"]
Jul 07 14:30:17.935164 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:17.935147    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:17.941452 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:17.941422    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-g2ppf\""
Jul 07 14:30:17.953686 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:17.953653    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"]
Jul 07 14:30:17.957406 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:17.957382    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b9884d45d-jm2sq"
Jul 07 14:30:18.007952 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.007916    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p" event={"ID":"632935bd-c9ef-449c-8b37-c62899a312e7","Type":"ContainerStarted","Data":"b9ab8ee819dd4d3c1e1f22166e6f73b9e7d7e5fdabeea89f425e2931d6c2f639"}
Jul 07 14:30:18.008192 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.008145    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:18.010175 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.010145    2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-p798p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 14:30:18.010288 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.010210    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p" podUID="632935bd-c9ef-449c-8b37-c62899a312e7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 14:30:18.010544 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.010518    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.010672 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.010586    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.010672 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.010618    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlxkz\" (UniqueName: \"kubernetes.io/projected/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-kube-api-access-dlxkz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.010672 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.010668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.011087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.010728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.011087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.010839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.011087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.010878    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.011087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.010934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.011087 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.011010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.111993 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.111933    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.111993 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.111995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.112296 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.112028    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.112296 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.112065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.112296 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.112114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.112524 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.112440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.112650 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.112624    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.112731 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.112646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlxkz\" (UniqueName: \"kubernetes.io/projected/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-kube-api-access-dlxkz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.112731 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.112520    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.112731 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.112701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.112880 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.112751    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.113019 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.112988    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.113397 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.113372    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.113397 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.113385    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.118356 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.118326    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.118524 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.118504    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.122387 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.122359    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.123185 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.123161    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlxkz\" (UniqueName: \"kubernetes.io/projected/dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a-kube-api-access-dlxkz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4k78gf\" (UID: \"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.250478 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.250443    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:18.399475 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.399233    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p" podStartSLOduration=2.06032337 podStartE2EDuration="4.399209752s" totalImagesPullingTime="2.338886382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:18.04038956 +0000 UTC m=+350.067897659" watchObservedRunningTime="2026-07-07 14:30:18.399209752 +0000 UTC m=+350.426717861"
Jul 07 14:30:18.399954 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:18.399894    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"]
Jul 07 14:30:18.402083 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:30:18.402055    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcaaeaf7_abcf_4376_9f8a_1ac4d5e9705a.slice/crio-00278f6de42e3ad2f8fb0ca3763011b7a93ca986f9315c7828eee8bf10ddf176 WatchSource:0}: Error finding container 00278f6de42e3ad2f8fb0ca3763011b7a93ca986f9315c7828eee8bf10ddf176: Status 404 returned error can't find the container with id 00278f6de42e3ad2f8fb0ca3763011b7a93ca986f9315c7828eee8bf10ddf176
Jul 07 14:30:19.013679 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:19.013633    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf" event={"ID":"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a","Type":"ContainerStarted","Data":"00278f6de42e3ad2f8fb0ca3763011b7a93ca986f9315c7828eee8bf10ddf176"}
Jul 07 14:30:19.014605 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:19.014586    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p798p"
Jul 07 14:30:21.447624 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:21.447579    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:30:21.447914 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:21.447659    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:30:21.447914 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:21.447689    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:30:22.029787 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:22.029740    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf" event={"ID":"dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a","Type":"ContainerStarted","Data":"49e618dc91766cd63c018223301b1e1f412719fc9f8b3d7b467b43b340187532"}
Jul 07 14:30:22.059782 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:22.059690    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf" podStartSLOduration=2.016455718 podStartE2EDuration="5.059665374s" totalImagesPullingTime="3.043209656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:22.055561347 +0000 UTC m=+354.083069455" watchObservedRunningTime="2026-07-07 14:30:22.059665374 +0000 UTC m=+354.087173483"
Jul 07 14:30:22.250830 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:22.250792    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:22.256225 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:22.256199    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:23.034170 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:23.034141    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:30:23.035235 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:30:23.035218    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4k78gf"
Jul 07 14:31:21.962017 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:21.961979    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"]
Jul 07 14:31:21.967527 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:21.967484    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:21.971062 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:21.971039    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 14:31:21.971998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:21.971978    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 14:31:21.972122 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:21.972004    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4x5zn\""
Jul 07 14:31:21.976286 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:21.976264    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"]
Jul 07 14:31:22.090744 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.090688    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:22.090931 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.090759    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:22.090931 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.090788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9djmk\" (UniqueName: \"kubernetes.io/projected/8df17cb8-1c2f-4576-a826-d395796b6739-kube-api-access-9djmk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:22.192226 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.192173    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:22.192359 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.192237    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:22.192359 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.192256    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9djmk\" (UniqueName: \"kubernetes.io/projected/8df17cb8-1c2f-4576-a826-d395796b6739-kube-api-access-9djmk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:22.192688 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.192668    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:22.192725 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.192669    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:22.206907 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.206860    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9djmk\" (UniqueName: \"kubernetes.io/projected/8df17cb8-1c2f-4576-a826-d395796b6739-kube-api-access-9djmk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:22.277830 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.277747    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:22.364483 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.364445    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"]
Jul 07 14:31:22.370878 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.370851    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.382762 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.382738    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"]
Jul 07 14:31:22.413218 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.413196    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"]
Jul 07 14:31:22.415755 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:31:22.415722    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df17cb8_1c2f_4576_a826_d395796b6739.slice/crio-01428fac6360f12344559d4e7dfa846b202f826fde526174a0f547b1784d0b01 WatchSource:0}: Error finding container 01428fac6360f12344559d4e7dfa846b202f826fde526174a0f547b1784d0b01: Status 404 returned error can't find the container with id 01428fac6360f12344559d4e7dfa846b202f826fde526174a0f547b1784d0b01
Jul 07 14:31:22.494638 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.494609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vthsz\" (UniqueName: \"kubernetes.io/projected/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-kube-api-access-vthsz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.494792 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.494683    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.494792 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.494725    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.595279 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.595191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.595279 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.595237    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.595471 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.595287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vthsz\" (UniqueName: \"kubernetes.io/projected/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-kube-api-access-vthsz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.595672 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.595648    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.595713 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.595657    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.607613 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.607588    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vthsz\" (UniqueName: \"kubernetes.io/projected/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-kube-api-access-vthsz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.682338 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.682304    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:22.765234 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.765113    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"]
Jul 07 14:31:22.769074 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.769053    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:22.778242 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.778214    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"]
Jul 07 14:31:22.827650 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.827583    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"]
Jul 07 14:31:22.830256 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:31:22.830228    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode578bbce_33c7_49ab_bbf5_84ba6acdd56d.slice/crio-c386a90db852734442d23fec8a293ec7fd2e96a72846bcf51280c7c3878b6b32 WatchSource:0}: Error finding container c386a90db852734442d23fec8a293ec7fd2e96a72846bcf51280c7c3878b6b32: Status 404 returned error can't find the container with id c386a90db852734442d23fec8a293ec7fd2e96a72846bcf51280c7c3878b6b32
Jul 07 14:31:22.898773 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.898748    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw8wf\" (UniqueName: \"kubernetes.io/projected/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-kube-api-access-zw8wf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:22.898882 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.898803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:22.898882 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:22.898832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:23.000208 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.000170    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw8wf\" (UniqueName: \"kubernetes.io/projected/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-kube-api-access-zw8wf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:23.000645 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.000230    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:23.000645 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.000259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:23.000645 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.000589    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:23.000776 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.000666    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:23.010876 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.010845    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw8wf\" (UniqueName: \"kubernetes.io/projected/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-kube-api-access-zw8wf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:23.079910 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.079868    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:23.168284 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.168253    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"]
Jul 07 14:31:23.172043 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.172020    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.186461 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.186428    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"]
Jul 07 14:31:23.219474 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.219423    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"]
Jul 07 14:31:23.222611 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:31:23.222575    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0f8002_f23d_4bd7_96c6_0b5f74a3ea1a.slice/crio-45a2de7a2041f5211e361dfa14ec68100cb63273d8190b113d8497d4b109c76e WatchSource:0}: Error finding container 45a2de7a2041f5211e361dfa14ec68100cb63273d8190b113d8497d4b109c76e: Status 404 returned error can't find the container with id 45a2de7a2041f5211e361dfa14ec68100cb63273d8190b113d8497d4b109c76e
Jul 07 14:31:23.297366 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.297329    2583 generic.go:356] "Generic (PLEG): container finished" podID="e578bbce-33c7-49ab-bbf5-84ba6acdd56d" containerID="1a17a7193c73f1b63fc319c438199a04ed464b35b99acaa92098af8501791681" exitCode=0
Jul 07 14:31:23.297503 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.297464    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv" event={"ID":"e578bbce-33c7-49ab-bbf5-84ba6acdd56d","Type":"ContainerDied","Data":"1a17a7193c73f1b63fc319c438199a04ed464b35b99acaa92098af8501791681"}
Jul 07 14:31:23.297563 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.297516    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv" event={"ID":"e578bbce-33c7-49ab-bbf5-84ba6acdd56d","Type":"ContainerStarted","Data":"c386a90db852734442d23fec8a293ec7fd2e96a72846bcf51280c7c3878b6b32"}
Jul 07 14:31:23.299225 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.299196    2583 generic.go:356] "Generic (PLEG): container finished" podID="8df17cb8-1c2f-4576-a826-d395796b6739" containerID="2a9b776c135cb9b9435ba4f754297c2d820c4f4099278ed0c56d43dc9a4ee701" exitCode=0
Jul 07 14:31:23.299363 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.299318    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68" event={"ID":"8df17cb8-1c2f-4576-a826-d395796b6739","Type":"ContainerDied","Data":"2a9b776c135cb9b9435ba4f754297c2d820c4f4099278ed0c56d43dc9a4ee701"}
Jul 07 14:31:23.299363 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.299351    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68" event={"ID":"8df17cb8-1c2f-4576-a826-d395796b6739","Type":"ContainerStarted","Data":"01428fac6360f12344559d4e7dfa846b202f826fde526174a0f547b1784d0b01"}
Jul 07 14:31:23.301061 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.301032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc" event={"ID":"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a","Type":"ContainerStarted","Data":"2e393fd17833a2587ef1448af90b2fe926aa960f184053678667198973faa975"}
Jul 07 14:31:23.301129 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.301074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc" event={"ID":"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a","Type":"ContainerStarted","Data":"45a2de7a2041f5211e361dfa14ec68100cb63273d8190b113d8497d4b109c76e"}
Jul 07 14:31:23.302701 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.302679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.302795 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.302719    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.302857 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.302843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzg4p\" (UniqueName: \"kubernetes.io/projected/b79e467f-bdcf-4821-8310-788215191cd8-kube-api-access-tzg4p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.404186 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.404083    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzg4p\" (UniqueName: \"kubernetes.io/projected/b79e467f-bdcf-4821-8310-788215191cd8-kube-api-access-tzg4p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.404573 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.404275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.404573 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.404335    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.404742 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.404714    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.404808 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.404722    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.413657 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.413629    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzg4p\" (UniqueName: \"kubernetes.io/projected/b79e467f-bdcf-4821-8310-788215191cd8-kube-api-access-tzg4p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.484917 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.484886    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:23.616120 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:23.616095    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"]
Jul 07 14:31:23.617914 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:31:23.617892    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79e467f_bdcf_4821_8310_788215191cd8.slice/crio-1fef58ca6e6f49afe36625b1d99a90d11ec6ae320108ca3a4806bd2906e506cb WatchSource:0}: Error finding container 1fef58ca6e6f49afe36625b1d99a90d11ec6ae320108ca3a4806bd2906e506cb: Status 404 returned error can't find the container with id 1fef58ca6e6f49afe36625b1d99a90d11ec6ae320108ca3a4806bd2906e506cb
Jul 07 14:31:24.308003 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:24.307951    2583 generic.go:356] "Generic (PLEG): container finished" podID="8df17cb8-1c2f-4576-a826-d395796b6739" containerID="36641303b22032fc093e72fdbed15f4b93cf4dc641e150c99b569a08373d41ae" exitCode=0
Jul 07 14:31:24.308461 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:24.308001    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68" event={"ID":"8df17cb8-1c2f-4576-a826-d395796b6739","Type":"ContainerDied","Data":"36641303b22032fc093e72fdbed15f4b93cf4dc641e150c99b569a08373d41ae"}
Jul 07 14:31:24.309624 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:24.309600    2583 generic.go:356] "Generic (PLEG): container finished" podID="7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" containerID="2e393fd17833a2587ef1448af90b2fe926aa960f184053678667198973faa975" exitCode=0
Jul 07 14:31:24.309722 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:24.309679    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc" event={"ID":"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a","Type":"ContainerDied","Data":"2e393fd17833a2587ef1448af90b2fe926aa960f184053678667198973faa975"}
Jul 07 14:31:24.311240 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:24.311212    2583 generic.go:356] "Generic (PLEG): container finished" podID="b79e467f-bdcf-4821-8310-788215191cd8" containerID="7e1cddad8c3b94cc652fbbde7ebd976d7d3cc1eefd722dcf1c2a0dbc08817375" exitCode=0
Jul 07 14:31:24.311326 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:24.311253    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc" event={"ID":"b79e467f-bdcf-4821-8310-788215191cd8","Type":"ContainerDied","Data":"7e1cddad8c3b94cc652fbbde7ebd976d7d3cc1eefd722dcf1c2a0dbc08817375"}
Jul 07 14:31:24.311326 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:24.311288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc" event={"ID":"b79e467f-bdcf-4821-8310-788215191cd8","Type":"ContainerStarted","Data":"1fef58ca6e6f49afe36625b1d99a90d11ec6ae320108ca3a4806bd2906e506cb"}
Jul 07 14:31:25.319164 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:25.319135    2583 generic.go:356] "Generic (PLEG): container finished" podID="e578bbce-33c7-49ab-bbf5-84ba6acdd56d" containerID="be3644ee6ad256559c87f98a114dd5dabbf80a9ce8ec1f6a42f77cdc80defa07" exitCode=0
Jul 07 14:31:25.319501 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:25.319229    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv" event={"ID":"e578bbce-33c7-49ab-bbf5-84ba6acdd56d","Type":"ContainerDied","Data":"be3644ee6ad256559c87f98a114dd5dabbf80a9ce8ec1f6a42f77cdc80defa07"}
Jul 07 14:31:25.321634 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:25.321609    2583 generic.go:356] "Generic (PLEG): container finished" podID="8df17cb8-1c2f-4576-a826-d395796b6739" containerID="b8fd27f8216c8109e1b2a2e09b1d3b1b5a1652c9713d8fb94583ff7afca846f8" exitCode=0
Jul 07 14:31:25.321730 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:25.321694    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68" event={"ID":"8df17cb8-1c2f-4576-a826-d395796b6739","Type":"ContainerDied","Data":"b8fd27f8216c8109e1b2a2e09b1d3b1b5a1652c9713d8fb94583ff7afca846f8"}
Jul 07 14:31:26.328005 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.327946    2583 generic.go:356] "Generic (PLEG): container finished" podID="e578bbce-33c7-49ab-bbf5-84ba6acdd56d" containerID="a4960beb83b436dc5027f5c140875f467bb44f5f669470e0a3bd4355882a1bbf" exitCode=0
Jul 07 14:31:26.328005 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.327995    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv" event={"ID":"e578bbce-33c7-49ab-bbf5-84ba6acdd56d","Type":"ContainerDied","Data":"a4960beb83b436dc5027f5c140875f467bb44f5f669470e0a3bd4355882a1bbf"}
Jul 07 14:31:26.329822 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.329798    2583 generic.go:356] "Generic (PLEG): container finished" podID="b79e467f-bdcf-4821-8310-788215191cd8" containerID="e29e3bc078cdfd38bb99a40f8c57e55fdae6d02c8dbecb99dd10ef345e23f4ea" exitCode=0
Jul 07 14:31:26.329985 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.329879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc" event={"ID":"b79e467f-bdcf-4821-8310-788215191cd8","Type":"ContainerDied","Data":"e29e3bc078cdfd38bb99a40f8c57e55fdae6d02c8dbecb99dd10ef345e23f4ea"}
Jul 07 14:31:26.331730 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.331710    2583 generic.go:356] "Generic (PLEG): container finished" podID="7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" containerID="130e4905b4e0394b00012238b21186848394fbf2a794dd581175ed0432fdc198" exitCode=0
Jul 07 14:31:26.331813 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.331776    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc" event={"ID":"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a","Type":"ContainerDied","Data":"130e4905b4e0394b00012238b21186848394fbf2a794dd581175ed0432fdc198"}
Jul 07 14:31:26.485987 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.485891    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:26.631125 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.631027    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-util\") pod \"8df17cb8-1c2f-4576-a826-d395796b6739\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") "
Jul 07 14:31:26.631125 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.631111    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-bundle\") pod \"8df17cb8-1c2f-4576-a826-d395796b6739\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") "
Jul 07 14:31:26.631364 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.631152    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9djmk\" (UniqueName: \"kubernetes.io/projected/8df17cb8-1c2f-4576-a826-d395796b6739-kube-api-access-9djmk\") pod \"8df17cb8-1c2f-4576-a826-d395796b6739\" (UID: \"8df17cb8-1c2f-4576-a826-d395796b6739\") "
Jul 07 14:31:26.631658 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.631629    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-bundle" (OuterVolumeSpecName: "bundle") pod "8df17cb8-1c2f-4576-a826-d395796b6739" (UID: "8df17cb8-1c2f-4576-a826-d395796b6739"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:26.633513 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.633490    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df17cb8-1c2f-4576-a826-d395796b6739-kube-api-access-9djmk" (OuterVolumeSpecName: "kube-api-access-9djmk") pod "8df17cb8-1c2f-4576-a826-d395796b6739" (UID: "8df17cb8-1c2f-4576-a826-d395796b6739"). InnerVolumeSpecName "kube-api-access-9djmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:31:26.636548 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.636523    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-util" (OuterVolumeSpecName: "util") pod "8df17cb8-1c2f-4576-a826-d395796b6739" (UID: "8df17cb8-1c2f-4576-a826-d395796b6739"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:26.732439 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.732397    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-util\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:26.732439 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.732430    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8df17cb8-1c2f-4576-a826-d395796b6739-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:26.732439 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:26.732440    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9djmk\" (UniqueName: \"kubernetes.io/projected/8df17cb8-1c2f-4576-a826-d395796b6739-kube-api-access-9djmk\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:27.338058 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.338028    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68"
Jul 07 14:31:27.338058 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.338039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68" event={"ID":"8df17cb8-1c2f-4576-a826-d395796b6739","Type":"ContainerDied","Data":"01428fac6360f12344559d4e7dfa846b202f826fde526174a0f547b1784d0b01"}
Jul 07 14:31:27.338518 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.338097    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01428fac6360f12344559d4e7dfa846b202f826fde526174a0f547b1784d0b01"
Jul 07 14:31:27.340356 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.340318    2583 generic.go:356] "Generic (PLEG): container finished" podID="7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" containerID="ba82664df5fa74bbb1921b602c8bdd2ea36168808021e2ee9c836962812ab011" exitCode=0
Jul 07 14:31:27.340482 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.340367    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc" event={"ID":"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a","Type":"ContainerDied","Data":"ba82664df5fa74bbb1921b602c8bdd2ea36168808021e2ee9c836962812ab011"}
Jul 07 14:31:27.342613 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.342589    2583 generic.go:356] "Generic (PLEG): container finished" podID="b79e467f-bdcf-4821-8310-788215191cd8" containerID="d32946d5415641a8ae07cb6af857a106f9da17cb599b025d920e4ad547096f2e" exitCode=0
Jul 07 14:31:27.342710 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.342664    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc" event={"ID":"b79e467f-bdcf-4821-8310-788215191cd8","Type":"ContainerDied","Data":"d32946d5415641a8ae07cb6af857a106f9da17cb599b025d920e4ad547096f2e"}
Jul 07 14:31:27.475816 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.475791    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:27.639809 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.639733    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vthsz\" (UniqueName: \"kubernetes.io/projected/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-kube-api-access-vthsz\") pod \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") "
Jul 07 14:31:27.639809 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.639785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-util\") pod \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") "
Jul 07 14:31:27.639809 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.639809    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-bundle\") pod \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\" (UID: \"e578bbce-33c7-49ab-bbf5-84ba6acdd56d\") "
Jul 07 14:31:27.640414 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.640383    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-bundle" (OuterVolumeSpecName: "bundle") pod "e578bbce-33c7-49ab-bbf5-84ba6acdd56d" (UID: "e578bbce-33c7-49ab-bbf5-84ba6acdd56d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:27.641804 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.641774    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-kube-api-access-vthsz" (OuterVolumeSpecName: "kube-api-access-vthsz") pod "e578bbce-33c7-49ab-bbf5-84ba6acdd56d" (UID: "e578bbce-33c7-49ab-bbf5-84ba6acdd56d"). InnerVolumeSpecName "kube-api-access-vthsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:31:27.645097 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.645072    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-util" (OuterVolumeSpecName: "util") pod "e578bbce-33c7-49ab-bbf5-84ba6acdd56d" (UID: "e578bbce-33c7-49ab-bbf5-84ba6acdd56d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:27.741257 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.741201    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vthsz\" (UniqueName: \"kubernetes.io/projected/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-kube-api-access-vthsz\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:27.741257 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.741249    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-util\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:27.741257 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:27.741261    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e578bbce-33c7-49ab-bbf5-84ba6acdd56d-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:28.348798 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.348769    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv"
Jul 07 14:31:28.349202 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.348791    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv" event={"ID":"e578bbce-33c7-49ab-bbf5-84ba6acdd56d","Type":"ContainerDied","Data":"c386a90db852734442d23fec8a293ec7fd2e96a72846bcf51280c7c3878b6b32"}
Jul 07 14:31:28.349202 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.348850    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c386a90db852734442d23fec8a293ec7fd2e96a72846bcf51280c7c3878b6b32"
Jul 07 14:31:28.512406 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.512380    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:28.514936 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.514911    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:28.650281 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.650205    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzg4p\" (UniqueName: \"kubernetes.io/projected/b79e467f-bdcf-4821-8310-788215191cd8-kube-api-access-tzg4p\") pod \"b79e467f-bdcf-4821-8310-788215191cd8\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") "
Jul 07 14:31:28.650431 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.650289    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-bundle\") pod \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") "
Jul 07 14:31:28.650431 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.650333    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-bundle\") pod \"b79e467f-bdcf-4821-8310-788215191cd8\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") "
Jul 07 14:31:28.650431 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.650355    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw8wf\" (UniqueName: \"kubernetes.io/projected/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-kube-api-access-zw8wf\") pod \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") "
Jul 07 14:31:28.650431 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.650383    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-util\") pod \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\" (UID: \"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a\") "
Jul 07 14:31:28.650431 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.650400    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-util\") pod \"b79e467f-bdcf-4821-8310-788215191cd8\" (UID: \"b79e467f-bdcf-4821-8310-788215191cd8\") "
Jul 07 14:31:28.650893 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.650863    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-bundle" (OuterVolumeSpecName: "bundle") pod "b79e467f-bdcf-4821-8310-788215191cd8" (UID: "b79e467f-bdcf-4821-8310-788215191cd8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:28.650893 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.650883    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-bundle" (OuterVolumeSpecName: "bundle") pod "7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" (UID: "7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:28.652453 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.652422    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-kube-api-access-zw8wf" (OuterVolumeSpecName: "kube-api-access-zw8wf") pod "7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" (UID: "7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a"). InnerVolumeSpecName "kube-api-access-zw8wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:31:28.652646 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.652631    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b79e467f-bdcf-4821-8310-788215191cd8-kube-api-access-tzg4p" (OuterVolumeSpecName: "kube-api-access-tzg4p") pod "b79e467f-bdcf-4821-8310-788215191cd8" (UID: "b79e467f-bdcf-4821-8310-788215191cd8"). InnerVolumeSpecName "kube-api-access-tzg4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:31:28.655893 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.655865    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-util" (OuterVolumeSpecName: "util") pod "b79e467f-bdcf-4821-8310-788215191cd8" (UID: "b79e467f-bdcf-4821-8310-788215191cd8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:28.656712 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.656692    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-util" (OuterVolumeSpecName: "util") pod "7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" (UID: "7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:28.751328 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.751279    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:28.751328 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.751323    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw8wf\" (UniqueName: \"kubernetes.io/projected/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-kube-api-access-zw8wf\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:28.751328 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.751335    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-util\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:28.751328 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.751343    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79e467f-bdcf-4821-8310-788215191cd8-util\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:28.751328 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.751351    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzg4p\" (UniqueName: \"kubernetes.io/projected/b79e467f-bdcf-4821-8310-788215191cd8-kube-api-access-tzg4p\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:28.751635 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:28.751360    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:31:29.355400 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:29.355372    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc"
Jul 07 14:31:29.355834 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:29.355401    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc" event={"ID":"7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a","Type":"ContainerDied","Data":"45a2de7a2041f5211e361dfa14ec68100cb63273d8190b113d8497d4b109c76e"}
Jul 07 14:31:29.355834 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:29.355452    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45a2de7a2041f5211e361dfa14ec68100cb63273d8190b113d8497d4b109c76e"
Jul 07 14:31:29.357361 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:29.357342    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc"
Jul 07 14:31:29.357471 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:29.357341    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc" event={"ID":"b79e467f-bdcf-4821-8310-788215191cd8","Type":"ContainerDied","Data":"1fef58ca6e6f49afe36625b1d99a90d11ec6ae320108ca3a4806bd2906e506cb"}
Jul 07 14:31:29.357471 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:31:29.357445    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fef58ca6e6f49afe36625b1d99a90d11ec6ae320108ca3a4806bd2906e506cb"
Jul 07 14:32:55.366569 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366530    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"]
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366839    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e578bbce-33c7-49ab-bbf5-84ba6acdd56d" containerName="util"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366851    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e578bbce-33c7-49ab-bbf5-84ba6acdd56d" containerName="util"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366860    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" containerName="util"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366865    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" containerName="util"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366874    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79e467f-bdcf-4821-8310-788215191cd8" containerName="util"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366883    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79e467f-bdcf-4821-8310-788215191cd8" containerName="util"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366893    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e578bbce-33c7-49ab-bbf5-84ba6acdd56d" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366898    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e578bbce-33c7-49ab-bbf5-84ba6acdd56d" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366910    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df17cb8-1c2f-4576-a826-d395796b6739" containerName="pull"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366915    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df17cb8-1c2f-4576-a826-d395796b6739" containerName="pull"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366922    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79e467f-bdcf-4821-8310-788215191cd8" containerName="pull"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366927    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79e467f-bdcf-4821-8310-788215191cd8" containerName="pull"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366934    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79e467f-bdcf-4821-8310-788215191cd8" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366939    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79e467f-bdcf-4821-8310-788215191cd8" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366947    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e578bbce-33c7-49ab-bbf5-84ba6acdd56d" containerName="pull"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366953    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e578bbce-33c7-49ab-bbf5-84ba6acdd56d" containerName="pull"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366979    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df17cb8-1c2f-4576-a826-d395796b6739" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366986    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df17cb8-1c2f-4576-a826-d395796b6739" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366991    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.366996    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.367004    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df17cb8-1c2f-4576-a826-d395796b6739" containerName="util"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.367010    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df17cb8-1c2f-4576-a826-d395796b6739" containerName="util"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.367017    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" containerName="pull"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.367022    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" containerName="pull"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.367074    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b79e467f-bdcf-4821-8310-788215191cd8" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.367083    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8df17cb8-1c2f-4576-a826-d395796b6739" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.367087    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a" containerName="extract"
Jul 07 14:32:55.367098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.367093    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e578bbce-33c7-49ab-bbf5-84ba6acdd56d" containerName="extract"
Jul 07 14:32:55.370002 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.369985    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.372308 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.372277    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-slvcz\""
Jul 07 14:32:55.383223 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.383199    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"]
Jul 07 14:32:55.532104 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.532065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.532104 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.532109    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.532351 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.532173    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.532351 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.532213    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.532351 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.532242    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.532351 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.532265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.532351 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.532322    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm8vq\" (UniqueName: \"kubernetes.io/projected/5a35aa32-5c14-44ff-943e-a618a794d82f-kube-api-access-lm8vq\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.532515 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.532361    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a35aa32-5c14-44ff-943e-a618a794d82f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.532515 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.532391    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.633442 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a35aa32-5c14-44ff-943e-a618a794d82f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.633442 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.633442 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633426    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.633767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633449    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.633767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633477    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.633767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.633767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.633767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.633767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm8vq\" (UniqueName: \"kubernetes.io/projected/5a35aa32-5c14-44ff-943e-a618a794d82f-kube-api-access-lm8vq\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.634107 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633892    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.634107 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.633941    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.634107 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.634049    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.634237 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.634217    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.634281 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.634232    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a35aa32-5c14-44ff-943e-a618a794d82f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.635769 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.635738    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.636027 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.636007    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.645610 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.645584    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a35aa32-5c14-44ff-943e-a618a794d82f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.645698 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.645653    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm8vq\" (UniqueName: \"kubernetes.io/projected/5a35aa32-5c14-44ff-943e-a618a794d82f-kube-api-access-lm8vq\") pod \"maas-default-gateway-openshift-default-56654dcf7-swksf\" (UID: \"5a35aa32-5c14-44ff-943e-a618a794d82f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.679707 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.679652    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:55.827544 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.827518    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"]
Jul 07 14:32:55.829573 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:32:55.829547    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a35aa32_5c14_44ff_943e_a618a794d82f.slice/crio-2883f9a57fab567da8420da2aa839a0a7a0bbacd1d498498a66f25fb30ad1b80 WatchSource:0}: Error finding container 2883f9a57fab567da8420da2aa839a0a7a0bbacd1d498498a66f25fb30ad1b80: Status 404 returned error can't find the container with id 2883f9a57fab567da8420da2aa839a0a7a0bbacd1d498498a66f25fb30ad1b80
Jul 07 14:32:55.831647 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.831609    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:32:55.831748 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.831676    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:32:55.831748 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:55.831733    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:32:56.781654 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:56.781605    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf" event={"ID":"5a35aa32-5c14-44ff-943e-a618a794d82f","Type":"ContainerStarted","Data":"2c2717cace0fe2f7d387346d46f51988da139943e5b42bac76e65381355d94c7"}
Jul 07 14:32:56.782192 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:56.781715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf" event={"ID":"5a35aa32-5c14-44ff-943e-a618a794d82f","Type":"ContainerStarted","Data":"2883f9a57fab567da8420da2aa839a0a7a0bbacd1d498498a66f25fb30ad1b80"}
Jul 07 14:32:56.807250 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:56.807188    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf" podStartSLOduration=1.807170057 podStartE2EDuration="1.807170057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:56.806243488 +0000 UTC m=+508.833751596" watchObservedRunningTime="2026-07-07 14:32:56.807170057 +0000 UTC m=+508.834678165"
Jul 07 14:32:57.680766 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:57.680733    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:57.685377 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:57.685349    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:57.788093 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:57.788060    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:57.789036 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:57.789015    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:32:59.072460 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.072413    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-l9lcr"]
Jul 07 14:32:59.075895 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.075872    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-l9lcr"
Jul 07 14:32:59.080434 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.080413    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 14:32:59.080855 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.080840    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4x47t\""
Jul 07 14:32:59.080902 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.080864    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 14:32:59.084495 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.084475    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-l9lcr"]
Jul 07 14:32:59.162596 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.162556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtbvt\" (UniqueName: \"kubernetes.io/projected/2c3dc694-cc67-4551-9ae1-e4d278f4002e-kube-api-access-dtbvt\") pod \"authorino-75d556bd77-l9lcr\" (UID: \"2c3dc694-cc67-4551-9ae1-e4d278f4002e\") " pod="kuadrant-system/authorino-75d556bd77-l9lcr"
Jul 07 14:32:59.264141 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.264096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtbvt\" (UniqueName: \"kubernetes.io/projected/2c3dc694-cc67-4551-9ae1-e4d278f4002e-kube-api-access-dtbvt\") pod \"authorino-75d556bd77-l9lcr\" (UID: \"2c3dc694-cc67-4551-9ae1-e4d278f4002e\") " pod="kuadrant-system/authorino-75d556bd77-l9lcr"
Jul 07 14:32:59.278480 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.278451    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtbvt\" (UniqueName: \"kubernetes.io/projected/2c3dc694-cc67-4551-9ae1-e4d278f4002e-kube-api-access-dtbvt\") pod \"authorino-75d556bd77-l9lcr\" (UID: \"2c3dc694-cc67-4551-9ae1-e4d278f4002e\") " pod="kuadrant-system/authorino-75d556bd77-l9lcr"
Jul 07 14:32:59.385951 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.385855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-l9lcr"
Jul 07 14:32:59.518185 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.518158    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-l9lcr"]
Jul 07 14:32:59.519954 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:32:59.519929    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c3dc694_cc67_4551_9ae1_e4d278f4002e.slice/crio-f8d7b284d89b2a70f4e97d7642c2ca5d4a6b1de387f1f68aacd228341d9aa32c WatchSource:0}: Error finding container f8d7b284d89b2a70f4e97d7642c2ca5d4a6b1de387f1f68aacd228341d9aa32c: Status 404 returned error can't find the container with id f8d7b284d89b2a70f4e97d7642c2ca5d4a6b1de387f1f68aacd228341d9aa32c
Jul 07 14:32:59.798945 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:32:59.798910    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-l9lcr" event={"ID":"2c3dc694-cc67-4551-9ae1-e4d278f4002e","Type":"ContainerStarted","Data":"f8d7b284d89b2a70f4e97d7642c2ca5d4a6b1de387f1f68aacd228341d9aa32c"}
Jul 07 14:33:03.823951 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:03.823909    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-l9lcr" event={"ID":"2c3dc694-cc67-4551-9ae1-e4d278f4002e","Type":"ContainerStarted","Data":"168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901"}
Jul 07 14:33:03.844090 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:03.844033    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-l9lcr" podStartSLOduration=1.290086828 podStartE2EDuration="4.84401523s" totalImagesPullingTime="3.553928402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:03.84183867 +0000 UTC m=+515.869346792" watchObservedRunningTime="2026-07-07 14:33:03.84401523 +0000 UTC m=+515.871523337"
Jul 07 14:33:30.177181 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.177086    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-l9lcr"]
Jul 07 14:33:30.177770 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.177300    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-l9lcr" podUID="2c3dc694-cc67-4551-9ae1-e4d278f4002e" containerName="authorino" containerID="cri-o://168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901" gracePeriod=30
Jul 07 14:33:30.431803 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.431738    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-l9lcr"
Jul 07 14:33:30.539846 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.539808    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtbvt\" (UniqueName: \"kubernetes.io/projected/2c3dc694-cc67-4551-9ae1-e4d278f4002e-kube-api-access-dtbvt\") pod \"2c3dc694-cc67-4551-9ae1-e4d278f4002e\" (UID: \"2c3dc694-cc67-4551-9ae1-e4d278f4002e\") "
Jul 07 14:33:30.541873 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.541843    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3dc694-cc67-4551-9ae1-e4d278f4002e-kube-api-access-dtbvt" (OuterVolumeSpecName: "kube-api-access-dtbvt") pod "2c3dc694-cc67-4551-9ae1-e4d278f4002e" (UID: "2c3dc694-cc67-4551-9ae1-e4d278f4002e"). InnerVolumeSpecName "kube-api-access-dtbvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:33:30.640749 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.640716    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtbvt\" (UniqueName: \"kubernetes.io/projected/2c3dc694-cc67-4551-9ae1-e4d278f4002e-kube-api-access-dtbvt\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:33:30.955345 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.955309    2583 generic.go:356] "Generic (PLEG): container finished" podID="2c3dc694-cc67-4551-9ae1-e4d278f4002e" containerID="168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901" exitCode=0
Jul 07 14:33:30.955542 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.955355    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-l9lcr"
Jul 07 14:33:30.955542 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.955388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-l9lcr" event={"ID":"2c3dc694-cc67-4551-9ae1-e4d278f4002e","Type":"ContainerDied","Data":"168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901"}
Jul 07 14:33:30.955542 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.955429    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-l9lcr" event={"ID":"2c3dc694-cc67-4551-9ae1-e4d278f4002e","Type":"ContainerDied","Data":"f8d7b284d89b2a70f4e97d7642c2ca5d4a6b1de387f1f68aacd228341d9aa32c"}
Jul 07 14:33:30.955542 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.955445    2583 scope.go:117] "RemoveContainer" containerID="168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901"
Jul 07 14:33:30.965581 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.965562    2583 scope.go:117] "RemoveContainer" containerID="168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901"
Jul 07 14:33:30.965874 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:33:30.965851    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901\": container with ID starting with 168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901 not found: ID does not exist" containerID="168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901"
Jul 07 14:33:30.965948 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.965886    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901"} err="failed to get container status \"168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901\": rpc error: code = NotFound desc = could not find container \"168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901\": container with ID starting with 168bb9406e644890e6954a446a9e229c293da1606999fd7a39a4debfef22f901 not found: ID does not exist"
Jul 07 14:33:30.981712 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.981680    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-l9lcr"]
Jul 07 14:33:30.988256 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:30.988231    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-l9lcr"]
Jul 07 14:33:32.468751 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:32.468715    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c3dc694-cc67-4551-9ae1-e4d278f4002e" path="/var/lib/kubelet/pods/2c3dc694-cc67-4551-9ae1-e4d278f4002e/volumes"
Jul 07 14:33:34.995010 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:34.994972    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7ff5967f7d-rjpwh"]
Jul 07 14:33:34.995396 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:34.995323    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3dc694-cc67-4551-9ae1-e4d278f4002e" containerName="authorino"
Jul 07 14:33:34.995396 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:34.995335    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3dc694-cc67-4551-9ae1-e4d278f4002e" containerName="authorino"
Jul 07 14:33:34.995474 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:34.995418    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3dc694-cc67-4551-9ae1-e4d278f4002e" containerName="authorino"
Jul 07 14:33:35.001024 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.001001    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:35.003445 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.003424    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 14:33:35.003548 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.003479    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 14:33:35.003548 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.003484    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-44wmw\""
Jul 07 14:33:35.014620 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.014577    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ff5967f7d-rjpwh"]
Jul 07 14:33:35.083309 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.083270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36dd894f-c265-484c-9d5a-7315ed6df86b-webhook-cert\") pod \"maas-controller-7ff5967f7d-rjpwh\" (UID: \"36dd894f-c265-484c-9d5a-7315ed6df86b\") " pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:35.083484 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.083381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6qtk\" (UniqueName: \"kubernetes.io/projected/36dd894f-c265-484c-9d5a-7315ed6df86b-kube-api-access-x6qtk\") pod \"maas-controller-7ff5967f7d-rjpwh\" (UID: \"36dd894f-c265-484c-9d5a-7315ed6df86b\") " pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:35.183924 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.183888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6qtk\" (UniqueName: \"kubernetes.io/projected/36dd894f-c265-484c-9d5a-7315ed6df86b-kube-api-access-x6qtk\") pod \"maas-controller-7ff5967f7d-rjpwh\" (UID: \"36dd894f-c265-484c-9d5a-7315ed6df86b\") " pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:35.184118 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.184053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36dd894f-c265-484c-9d5a-7315ed6df86b-webhook-cert\") pod \"maas-controller-7ff5967f7d-rjpwh\" (UID: \"36dd894f-c265-484c-9d5a-7315ed6df86b\") " pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:35.186428 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.186405    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36dd894f-c265-484c-9d5a-7315ed6df86b-webhook-cert\") pod \"maas-controller-7ff5967f7d-rjpwh\" (UID: \"36dd894f-c265-484c-9d5a-7315ed6df86b\") " pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:35.197317 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.197288    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6qtk\" (UniqueName: \"kubernetes.io/projected/36dd894f-c265-484c-9d5a-7315ed6df86b-kube-api-access-x6qtk\") pod \"maas-controller-7ff5967f7d-rjpwh\" (UID: \"36dd894f-c265-484c-9d5a-7315ed6df86b\") " pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:35.314514 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.314423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:35.453380 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.453350    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ff5967f7d-rjpwh"]
Jul 07 14:33:35.454881 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:33:35.454848    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36dd894f_c265_484c_9d5a_7315ed6df86b.slice/crio-d9a24d934fe5f32650eabdd9bda04a2f558b8e258f1c9f4f0dac660fc07f745c WatchSource:0}: Error finding container d9a24d934fe5f32650eabdd9bda04a2f558b8e258f1c9f4f0dac660fc07f745c: Status 404 returned error can't find the container with id d9a24d934fe5f32650eabdd9bda04a2f558b8e258f1c9f4f0dac660fc07f745c
Jul 07 14:33:35.983024 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:35.982989    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh" event={"ID":"36dd894f-c265-484c-9d5a-7315ed6df86b","Type":"ContainerStarted","Data":"d9a24d934fe5f32650eabdd9bda04a2f558b8e258f1c9f4f0dac660fc07f745c"}
Jul 07 14:33:37.995283 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:37.995248    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh" event={"ID":"36dd894f-c265-484c-9d5a-7315ed6df86b","Type":"ContainerStarted","Data":"0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445"}
Jul 07 14:33:37.995688 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:37.995308    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:38.022336 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:38.022277    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh" podStartSLOduration=1.6194751520000001 podStartE2EDuration="4.022259625s" totalImagesPullingTime="2.402784473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:38.019742255 +0000 UTC m=+550.047250363" watchObservedRunningTime="2026-07-07 14:33:38.022259625 +0000 UTC m=+550.049767733"
Jul 07 14:33:49.007940 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:49.007899    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:49.241129 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:49.241086    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ff5967f7d-rjpwh"]
Jul 07 14:33:49.241354 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:49.241310    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh" podUID="36dd894f-c265-484c-9d5a-7315ed6df86b" containerName="manager" containerID="cri-o://0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445" gracePeriod=30
Jul 07 14:33:49.490757 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:49.490730    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:49.512812 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:49.512775    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6qtk\" (UniqueName: \"kubernetes.io/projected/36dd894f-c265-484c-9d5a-7315ed6df86b-kube-api-access-x6qtk\") pod \"36dd894f-c265-484c-9d5a-7315ed6df86b\" (UID: \"36dd894f-c265-484c-9d5a-7315ed6df86b\") "
Jul 07 14:33:49.513302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:49.512834    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36dd894f-c265-484c-9d5a-7315ed6df86b-webhook-cert\") pod \"36dd894f-c265-484c-9d5a-7315ed6df86b\" (UID: \"36dd894f-c265-484c-9d5a-7315ed6df86b\") "
Jul 07 14:33:49.515589 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:49.515551    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36dd894f-c265-484c-9d5a-7315ed6df86b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "36dd894f-c265-484c-9d5a-7315ed6df86b" (UID: "36dd894f-c265-484c-9d5a-7315ed6df86b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:33:49.515785 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:49.515760    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36dd894f-c265-484c-9d5a-7315ed6df86b-kube-api-access-x6qtk" (OuterVolumeSpecName: "kube-api-access-x6qtk") pod "36dd894f-c265-484c-9d5a-7315ed6df86b" (UID: "36dd894f-c265-484c-9d5a-7315ed6df86b"). InnerVolumeSpecName "kube-api-access-x6qtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:33:49.614349 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:49.614260    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6qtk\" (UniqueName: \"kubernetes.io/projected/36dd894f-c265-484c-9d5a-7315ed6df86b-kube-api-access-x6qtk\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:33:49.614349 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:49.614295    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36dd894f-c265-484c-9d5a-7315ed6df86b-webhook-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:33:50.057119 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:50.057083    2583 generic.go:356] "Generic (PLEG): container finished" podID="36dd894f-c265-484c-9d5a-7315ed6df86b" containerID="0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445" exitCode=0
Jul 07 14:33:50.057511 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:50.057129    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh"
Jul 07 14:33:50.057511 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:50.057141    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh" event={"ID":"36dd894f-c265-484c-9d5a-7315ed6df86b","Type":"ContainerDied","Data":"0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445"}
Jul 07 14:33:50.057511 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:50.057186    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ff5967f7d-rjpwh" event={"ID":"36dd894f-c265-484c-9d5a-7315ed6df86b","Type":"ContainerDied","Data":"d9a24d934fe5f32650eabdd9bda04a2f558b8e258f1c9f4f0dac660fc07f745c"}
Jul 07 14:33:50.057511 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:50.057211    2583 scope.go:117] "RemoveContainer" containerID="0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445"
Jul 07 14:33:50.068209 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:50.068175    2583 scope.go:117] "RemoveContainer" containerID="0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445"
Jul 07 14:33:50.068725 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:33:50.068701    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445\": container with ID starting with 0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445 not found: ID does not exist" containerID="0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445"
Jul 07 14:33:50.068841 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:50.068732    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445"} err="failed to get container status \"0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445\": rpc error: code = NotFound desc = could not find container \"0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445\": container with ID starting with 0a58c3bb4573f86c9b0f2e4297fcfb0768628bb33331aa90739a94b618f1a445 not found: ID does not exist"
Jul 07 14:33:50.082641 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:50.082606    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ff5967f7d-rjpwh"]
Jul 07 14:33:50.090073 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:50.090041    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7ff5967f7d-rjpwh"]
Jul 07 14:33:50.468369 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:33:50.468331    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36dd894f-c265-484c-9d5a-7315ed6df86b" path="/var/lib/kubelet/pods/36dd894f-c265-484c-9d5a-7315ed6df86b/volumes"
Jul 07 14:34:09.135450 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.135405    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mrld9"]
Jul 07 14:34:09.135978 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.135739    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36dd894f-c265-484c-9d5a-7315ed6df86b" containerName="manager"
Jul 07 14:34:09.135978 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.135751    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="36dd894f-c265-484c-9d5a-7315ed6df86b" containerName="manager"
Jul 07 14:34:09.135978 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.135799    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="36dd894f-c265-484c-9d5a-7315ed6df86b" containerName="manager"
Jul 07 14:34:09.141617 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.141597    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mrld9"
Jul 07 14:34:09.145242 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.145215    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 14:34:09.152774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.152749    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mrld9"]
Jul 07 14:34:09.195571 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.195525    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/944e6024-65da-4e3e-b9f3-f1d3f70a9c72-plugins-config-volume\") pod \"payload-processing-58f86c7798-mrld9\" (UID: \"944e6024-65da-4e3e-b9f3-f1d3f70a9c72\") " pod="openshift-ingress/payload-processing-58f86c7798-mrld9"
Jul 07 14:34:09.195757 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.195647    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qzrb\" (UniqueName: \"kubernetes.io/projected/944e6024-65da-4e3e-b9f3-f1d3f70a9c72-kube-api-access-8qzrb\") pod \"payload-processing-58f86c7798-mrld9\" (UID: \"944e6024-65da-4e3e-b9f3-f1d3f70a9c72\") " pod="openshift-ingress/payload-processing-58f86c7798-mrld9"
Jul 07 14:34:09.296206 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.296161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/944e6024-65da-4e3e-b9f3-f1d3f70a9c72-plugins-config-volume\") pod \"payload-processing-58f86c7798-mrld9\" (UID: \"944e6024-65da-4e3e-b9f3-f1d3f70a9c72\") " pod="openshift-ingress/payload-processing-58f86c7798-mrld9"
Jul 07 14:34:09.296436 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.296227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qzrb\" (UniqueName: \"kubernetes.io/projected/944e6024-65da-4e3e-b9f3-f1d3f70a9c72-kube-api-access-8qzrb\") pod \"payload-processing-58f86c7798-mrld9\" (UID: \"944e6024-65da-4e3e-b9f3-f1d3f70a9c72\") " pod="openshift-ingress/payload-processing-58f86c7798-mrld9"
Jul 07 14:34:09.296998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.296939    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/944e6024-65da-4e3e-b9f3-f1d3f70a9c72-plugins-config-volume\") pod \"payload-processing-58f86c7798-mrld9\" (UID: \"944e6024-65da-4e3e-b9f3-f1d3f70a9c72\") " pod="openshift-ingress/payload-processing-58f86c7798-mrld9"
Jul 07 14:34:09.306526 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.306499    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qzrb\" (UniqueName: \"kubernetes.io/projected/944e6024-65da-4e3e-b9f3-f1d3f70a9c72-kube-api-access-8qzrb\") pod \"payload-processing-58f86c7798-mrld9\" (UID: \"944e6024-65da-4e3e-b9f3-f1d3f70a9c72\") " pod="openshift-ingress/payload-processing-58f86c7798-mrld9"
Jul 07 14:34:09.451646 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.451611    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mrld9"
Jul 07 14:34:09.592882 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:09.592847    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mrld9"]
Jul 07 14:34:09.595995 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:34:09.595954    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944e6024_65da_4e3e_b9f3_f1d3f70a9c72.slice/crio-8c74d07086c919e028fe9b0df07bba936b504250be4d644659ecd8ea315a94b5 WatchSource:0}: Error finding container 8c74d07086c919e028fe9b0df07bba936b504250be4d644659ecd8ea315a94b5: Status 404 returned error can't find the container with id 8c74d07086c919e028fe9b0df07bba936b504250be4d644659ecd8ea315a94b5
Jul 07 14:34:10.163501 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:10.163464    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mrld9" event={"ID":"944e6024-65da-4e3e-b9f3-f1d3f70a9c72","Type":"ContainerStarted","Data":"8c74d07086c919e028fe9b0df07bba936b504250be4d644659ecd8ea315a94b5"}
Jul 07 14:34:12.176569 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:12.176529    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mrld9" event={"ID":"944e6024-65da-4e3e-b9f3-f1d3f70a9c72","Type":"ContainerStarted","Data":"ece8f1172ffec2cc8a13a109dd5efe1879c5919243f8105a34c3cbaa834aeaba"}
Jul 07 14:34:12.177008 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:12.176640    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-mrld9"
Jul 07 14:34:12.194536 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:12.194468    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-mrld9" podStartSLOduration=1.5170077339999999 podStartE2EDuration="3.194446665s" totalImagesPullingTime="1.677438931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:12.194351347 +0000 UTC m=+584.221859456" watchObservedRunningTime="2026-07-07 14:34:12.194446665 +0000 UTC m=+584.221954776"
Jul 07 14:34:18.207215 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:18.207182    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a35aa32-5c14-44ff-943e-a618a794d82f" containerID="2c2717cace0fe2f7d387346d46f51988da139943e5b42bac76e65381355d94c7" exitCode=0
Jul 07 14:34:18.207663 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:18.207258    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf" event={"ID":"5a35aa32-5c14-44ff-943e-a618a794d82f","Type":"ContainerDied","Data":"2c2717cace0fe2f7d387346d46f51988da139943e5b42bac76e65381355d94c7"}
Jul 07 14:34:18.207663 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:18.207628    2583 scope.go:117] "RemoveContainer" containerID="2c2717cace0fe2f7d387346d46f51988da139943e5b42bac76e65381355d94c7"
Jul 07 14:34:18.208803 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:18.208770    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:34:18.208872 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:18.208849    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:34:18.208911 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:18.208890    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:34:19.214793 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:19.214750    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf" event={"ID":"5a35aa32-5c14-44ff-943e-a618a794d82f","Type":"ContainerStarted","Data":"4e87c43115f3839a142c27922664cbb2d98ab3daaa7fefba12793d5dd2c231d6"}
Jul 07 14:34:19.680094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:19.680003    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:34:19.680248 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:19.680226    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-swksf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 14:34:19.680306 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:19.680274    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf" podUID="5a35aa32-5c14-44ff-943e-a618a794d82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 14:34:20.680748 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:20.680699    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-swksf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 14:34:20.681194 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:20.680765    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf" podUID="5a35aa32-5c14-44ff-943e-a618a794d82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 14:34:21.680574 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:21.680530    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-swksf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 14:34:21.680762 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:21.680596    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf" podUID="5a35aa32-5c14-44ff-943e-a618a794d82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 14:34:22.680892 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:22.680850    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-swksf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 14:34:22.681331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:22.680945    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf" podUID="5a35aa32-5c14-44ff-943e-a618a794d82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 14:34:23.183520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:23.183485    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-mrld9"
Jul 07 14:34:23.684852 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:23.684816    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:34:23.685299 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:23.685212    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:34:23.685882 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:23.685867    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-swksf"
Jul 07 14:34:28.373132 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:28.373104    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:34:28.373634 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:28.373343    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:34:31.854059 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:31.854028    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"]
Jul 07 14:34:31.857360 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:31.857343    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:31.861117 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:31.861099    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 14:34:31.862117 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:31.862094    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 14:34:31.862228 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:31.862129    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ms4lq\""
Jul 07 14:34:31.862228 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:31.862214    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 14:34:31.869868 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:31.869839    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"]
Jul 07 14:34:32.008143 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.008102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.008368 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.008162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.008368 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.008239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.008368 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.008297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.008511 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.008377    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.008511 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.008418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9kg8\" (UniqueName: \"kubernetes.io/projected/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-kube-api-access-d9kg8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.109496 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.109394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.109496 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.109444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.109496 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.109470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.109496 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.109497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.109826 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.109537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.109826 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.109570    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kg8\" (UniqueName: \"kubernetes.io/projected/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-kube-api-access-d9kg8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.110017 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.109995    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.110076 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.110034    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.110212 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.110071    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.111943 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.111918    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.112121 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.112101    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.119198 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.119172    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9kg8\" (UniqueName: \"kubernetes.io/projected/bf0b89a6-6b7f-48bb-a892-4ef56171eca6-kube-api-access-d9kg8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26\" (UID: \"bf0b89a6-6b7f-48bb-a892-4ef56171eca6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.168193 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.168155    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:32.313061 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:34:32.313033    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0b89a6_6b7f_48bb_a892_4ef56171eca6.slice/crio-c30a1b02a103186e0617fe72375737af5cf18e27fdd9fd3a3d49becb788fae17 WatchSource:0}: Error finding container c30a1b02a103186e0617fe72375737af5cf18e27fdd9fd3a3d49becb788fae17: Status 404 returned error can't find the container with id c30a1b02a103186e0617fe72375737af5cf18e27fdd9fd3a3d49becb788fae17
Jul 07 14:34:32.313833 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.313800    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"]
Jul 07 14:34:32.314637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:32.314621    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:34:33.303217 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:33.303168    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26" event={"ID":"bf0b89a6-6b7f-48bb-a892-4ef56171eca6","Type":"ContainerStarted","Data":"c30a1b02a103186e0617fe72375737af5cf18e27fdd9fd3a3d49becb788fae17"}
Jul 07 14:34:34.309532 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:34.309487    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26" event={"ID":"bf0b89a6-6b7f-48bb-a892-4ef56171eca6","Type":"ContainerStarted","Data":"59eb8868cf52e058cf7985d61312c3c61b6c8f1b57fdf0c352c92067a11052ad"}
Jul 07 14:34:34.333445 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:34.333388    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26" podStartSLOduration=2.27579998 podStartE2EDuration="3.333369673s" totalImagesPullingTime="1.057569693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:34.331012526 +0000 UTC m=+606.358520635" watchObservedRunningTime="2026-07-07 14:34:34.333369673 +0000 UTC m=+606.360877780"
Jul 07 14:34:42.169381 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:42.169333    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:42.169896 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:42.169423    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:42.181899 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:42.181876    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:42.363321 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:42.363294    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26"
Jul 07 14:34:49.862401 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:49.862356    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"]
Jul 07 14:34:49.867228 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:49.867200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:49.869628 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:49.869602    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 14:34:49.877610 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:49.877583    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"]
Jul 07 14:34:49.968382 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:49.968343    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:49.968598 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:49.968398    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:49.968598 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:49.968419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:49.968598 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:49.968523    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgr77\" (UniqueName: \"kubernetes.io/projected/3873d66d-ae14-4d10-980f-519cd92c05fd-kube-api-access-zgr77\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:49.968598 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:49.968581    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:49.968785 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:49.968609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3873d66d-ae14-4d10-980f-519cd92c05fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.070081 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.069994    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.070081 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.070033    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3873d66d-ae14-4d10-980f-519cd92c05fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.070328 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.070089    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.070328 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.070121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.070328 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.070138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.070328 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.070196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgr77\" (UniqueName: \"kubernetes.io/projected/3873d66d-ae14-4d10-980f-519cd92c05fd-kube-api-access-zgr77\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.070576 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.070554    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.070634 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.070616    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.070689 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.070639    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.072368 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.072348    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3873d66d-ae14-4d10-980f-519cd92c05fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.072755 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.072736    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3873d66d-ae14-4d10-980f-519cd92c05fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.080306 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.080269    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgr77\" (UniqueName: \"kubernetes.io/projected/3873d66d-ae14-4d10-980f-519cd92c05fd-kube-api-access-zgr77\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fggkg\" (UID: \"3873d66d-ae14-4d10-980f-519cd92c05fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.178363 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.178270    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:34:50.316524 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.316495    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"]
Jul 07 14:34:50.318284 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:34:50.318248    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3873d66d_ae14_4d10_980f_519cd92c05fd.slice/crio-045f2e6fbbcc4e42f591dd3a668b30dbfd077158eef4d4e6ea5dfe69c76051da WatchSource:0}: Error finding container 045f2e6fbbcc4e42f591dd3a668b30dbfd077158eef4d4e6ea5dfe69c76051da: Status 404 returned error can't find the container with id 045f2e6fbbcc4e42f591dd3a668b30dbfd077158eef4d4e6ea5dfe69c76051da
Jul 07 14:34:50.392942 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:50.392907    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg" event={"ID":"3873d66d-ae14-4d10-980f-519cd92c05fd","Type":"ContainerStarted","Data":"045f2e6fbbcc4e42f591dd3a668b30dbfd077158eef4d4e6ea5dfe69c76051da"}
Jul 07 14:34:51.400111 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:51.400063    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg" event={"ID":"3873d66d-ae14-4d10-980f-519cd92c05fd","Type":"ContainerStarted","Data":"5bf96a1bd9f70e3b8919242f18c6ad1d4d502278f470acfa861fd3dc6eb8b151"}
Jul 07 14:34:51.423044 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:34:51.422996    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg" podStartSLOduration=2.168824816 podStartE2EDuration="2.42297915s" totalImagesPullingTime="254.154334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:51.420516046 +0000 UTC m=+623.448024154" watchObservedRunningTime="2026-07-07 14:34:51.42297915 +0000 UTC m=+623.450487249"
Jul 07 14:35:00.178884 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:00.178840    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:35:00.179320 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:00.178936    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:35:00.191558 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:00.191532    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:35:00.458081 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:00.458050    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fggkg"
Jul 07 14:35:15.753887 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:15.753845    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"]
Jul 07 14:35:15.761092 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:15.761067    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:15.764435 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:15.764409    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 14:35:15.769040 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:15.769015    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"]
Jul 07 14:35:15.910864 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:15.910822    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:15.911078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:15.910888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:15.911078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:15.910918    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:15.911078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:15.910950    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b52c98e-8595-4503-907e-0287b261943d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:15.911078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:15.911033    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:15.911078 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:15.911055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr72w\" (UniqueName: \"kubernetes.io/projected/6b52c98e-8595-4503-907e-0287b261943d-kube-api-access-vr72w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.012325 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.012225    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.012325 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.012270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr72w\" (UniqueName: \"kubernetes.io/projected/6b52c98e-8595-4503-907e-0287b261943d-kube-api-access-vr72w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.012325 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.012315    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.012700 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.012358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.012700 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.012379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.012700 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.012538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b52c98e-8595-4503-907e-0287b261943d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.012809 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.012754    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.012846 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.012799    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.012882 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.012843    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.014674 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.014646    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b52c98e-8595-4503-907e-0287b261943d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.014988 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.014951    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b52c98e-8595-4503-907e-0287b261943d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.022448 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.022422    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr72w\" (UniqueName: \"kubernetes.io/projected/6b52c98e-8595-4503-907e-0287b261943d-kube-api-access-vr72w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d8gvh\" (UID: \"6b52c98e-8595-4503-907e-0287b261943d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.074057 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.074017    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:16.216445 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.216419    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"]
Jul 07 14:35:16.218650 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:35:16.218620    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b52c98e_8595_4503_907e_0287b261943d.slice/crio-19248102de6ed85604fd91bfe5ac9a3ba1dd0be0a995a196ba8e798745aab0f0 WatchSource:0}: Error finding container 19248102de6ed85604fd91bfe5ac9a3ba1dd0be0a995a196ba8e798745aab0f0: Status 404 returned error can't find the container with id 19248102de6ed85604fd91bfe5ac9a3ba1dd0be0a995a196ba8e798745aab0f0
Jul 07 14:35:16.528217 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.528169    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh" event={"ID":"6b52c98e-8595-4503-907e-0287b261943d","Type":"ContainerStarted","Data":"fc7b33fdb86be2b8eaaf029ea99f2d534be3953b026fcb659c44d4a5993c7c38"}
Jul 07 14:35:16.528412 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.528241    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh" event={"ID":"6b52c98e-8595-4503-907e-0287b261943d","Type":"ContainerStarted","Data":"19248102de6ed85604fd91bfe5ac9a3ba1dd0be0a995a196ba8e798745aab0f0"}
Jul 07 14:35:16.548273 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:16.548222    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh" podStartSLOduration=1.309012625 podStartE2EDuration="1.548204113s" totalImagesPullingTime="239.191488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:35:16.547116888 +0000 UTC m=+648.574624996" watchObservedRunningTime="2026-07-07 14:35:16.548204113 +0000 UTC m=+648.575712221"
Jul 07 14:35:26.074407 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:26.074355    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:26.074877 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:26.074436    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:26.087178 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:26.087154    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:35:26.588304 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:35:26.588261    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d8gvh"
Jul 07 14:37:48.261035 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.260992    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6495c9587b-hct9s"]
Jul 07 14:37:48.264569 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.264549    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6495c9587b-hct9s"
Jul 07 14:37:48.268005 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.267974    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 14:37:48.268142 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.267978    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 14:37:48.268383 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.268367    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-44wmw\""
Jul 07 14:37:48.276830 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.276805    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6495c9587b-hct9s"]
Jul 07 14:37:48.286608 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.286583    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d594c98-af02-450d-afa7-14e13b317a2c-webhook-cert\") pod \"maas-controller-6495c9587b-hct9s\" (UID: \"4d594c98-af02-450d-afa7-14e13b317a2c\") " pod="opendatahub/maas-controller-6495c9587b-hct9s"
Jul 07 14:37:48.286746 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.286613    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5knt\" (UniqueName: \"kubernetes.io/projected/4d594c98-af02-450d-afa7-14e13b317a2c-kube-api-access-q5knt\") pod \"maas-controller-6495c9587b-hct9s\" (UID: \"4d594c98-af02-450d-afa7-14e13b317a2c\") " pod="opendatahub/maas-controller-6495c9587b-hct9s"
Jul 07 14:37:48.387906 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.387868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d594c98-af02-450d-afa7-14e13b317a2c-webhook-cert\") pod \"maas-controller-6495c9587b-hct9s\" (UID: \"4d594c98-af02-450d-afa7-14e13b317a2c\") " pod="opendatahub/maas-controller-6495c9587b-hct9s"
Jul 07 14:37:48.387906 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.387910    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5knt\" (UniqueName: \"kubernetes.io/projected/4d594c98-af02-450d-afa7-14e13b317a2c-kube-api-access-q5knt\") pod \"maas-controller-6495c9587b-hct9s\" (UID: \"4d594c98-af02-450d-afa7-14e13b317a2c\") " pod="opendatahub/maas-controller-6495c9587b-hct9s"
Jul 07 14:37:48.390467 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.390449    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d594c98-af02-450d-afa7-14e13b317a2c-webhook-cert\") pod \"maas-controller-6495c9587b-hct9s\" (UID: \"4d594c98-af02-450d-afa7-14e13b317a2c\") " pod="opendatahub/maas-controller-6495c9587b-hct9s"
Jul 07 14:37:48.398801 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.398776    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5knt\" (UniqueName: \"kubernetes.io/projected/4d594c98-af02-450d-afa7-14e13b317a2c-kube-api-access-q5knt\") pod \"maas-controller-6495c9587b-hct9s\" (UID: \"4d594c98-af02-450d-afa7-14e13b317a2c\") " pod="opendatahub/maas-controller-6495c9587b-hct9s"
Jul 07 14:37:48.575455 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.575361    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6495c9587b-hct9s"
Jul 07 14:37:48.715753 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:48.715724    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6495c9587b-hct9s"]
Jul 07 14:37:48.718265 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:37:48.718232    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d594c98_af02_450d_afa7_14e13b317a2c.slice/crio-3e879a6c7d897df0a4cc58923c6872ca488a402bc10ba9883d0cab3085e765a6 WatchSource:0}: Error finding container 3e879a6c7d897df0a4cc58923c6872ca488a402bc10ba9883d0cab3085e765a6: Status 404 returned error can't find the container with id 3e879a6c7d897df0a4cc58923c6872ca488a402bc10ba9883d0cab3085e765a6
Jul 07 14:37:49.321551 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:49.321513    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6495c9587b-hct9s" event={"ID":"4d594c98-af02-450d-afa7-14e13b317a2c","Type":"ContainerStarted","Data":"3e879a6c7d897df0a4cc58923c6872ca488a402bc10ba9883d0cab3085e765a6"}
Jul 07 14:37:50.328080 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:50.327978    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6495c9587b-hct9s" event={"ID":"4d594c98-af02-450d-afa7-14e13b317a2c","Type":"ContainerStarted","Data":"8440f73505000974f2f414e7716a735434eedc3c4b2a9c35327f0a02f63d316b"}
Jul 07 14:37:50.328080 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:50.328046    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6495c9587b-hct9s"
Jul 07 14:37:50.351229 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:37:50.351178    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6495c9587b-hct9s" podStartSLOduration=1.6683107289999999 podStartE2EDuration="2.35116035s" totalImagesPullingTime="682.849621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:50.349497709 +0000 UTC m=+802.377005817" watchObservedRunningTime="2026-07-07 14:37:50.35116035 +0000 UTC m=+802.378668482"
Jul 07 14:38:01.341766 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:38:01.341734    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6495c9587b-hct9s"
Jul 07 14:39:28.415575 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:39:28.415493    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:39:28.418146 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:39:28.416911    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:42:15.475445 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.475407    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d86b4d767-pts52"]
Jul 07 14:42:15.481302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.481262    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.499295 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.499267    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d86b4d767-pts52"]
Jul 07 14:42:15.603398 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.603362    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-console-config\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.603588 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.603420    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-console-oauth-config\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.603588 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.603437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-oauth-serving-cert\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.603588 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.603523    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9srp\" (UniqueName: \"kubernetes.io/projected/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-kube-api-access-g9srp\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.603588 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.603558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-console-serving-cert\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.603728 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.603590    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-service-ca\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.603728 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.603666    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-trusted-ca-bundle\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.705090 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.705054    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-console-oauth-config\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.705090 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.705091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-oauth-serving-cert\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.705307 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.705115    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9srp\" (UniqueName: \"kubernetes.io/projected/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-kube-api-access-g9srp\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.705307 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.705145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-console-serving-cert\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.705307 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.705184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-service-ca\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.705307 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.705220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-trusted-ca-bundle\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.705307 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.705296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-console-config\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.705936 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.705903    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-oauth-serving-cert\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.706071 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.705944    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-console-config\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.706071 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.706019    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-service-ca\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.706186 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.706094    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-trusted-ca-bundle\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.707709 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.707689    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-console-serving-cert\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.707854 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.707832    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-console-oauth-config\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.715015 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.714989    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9srp\" (UniqueName: \"kubernetes.io/projected/ab3812bc-d26c-4644-bcd4-8369a0e7a1a3-kube-api-access-g9srp\") pod \"console-6d86b4d767-pts52\" (UID: \"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3\") " pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.790937 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.790869    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:15.924798 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:15.924772    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d86b4d767-pts52"]
Jul 07 14:42:15.926688 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:42:15.926653    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3812bc_d26c_4644_bcd4_8369a0e7a1a3.slice/crio-79b661d483b0e45b7c7f52e80d2ceeb1c963693c24b31edbc3346ff77be1779a WatchSource:0}: Error finding container 79b661d483b0e45b7c7f52e80d2ceeb1c963693c24b31edbc3346ff77be1779a: Status 404 returned error can't find the container with id 79b661d483b0e45b7c7f52e80d2ceeb1c963693c24b31edbc3346ff77be1779a
Jul 07 14:42:16.681651 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:16.681617    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d86b4d767-pts52" event={"ID":"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3","Type":"ContainerStarted","Data":"01982b660a00d72f50229b6eedef93e90bf753cd2f792f89285243ed99661209"}
Jul 07 14:42:16.682175 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:16.681665    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d86b4d767-pts52" event={"ID":"ab3812bc-d26c-4644-bcd4-8369a0e7a1a3","Type":"ContainerStarted","Data":"79b661d483b0e45b7c7f52e80d2ceeb1c963693c24b31edbc3346ff77be1779a"}
Jul 07 14:42:16.706196 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:16.706138    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d86b4d767-pts52" podStartSLOduration=1.706123539 podStartE2EDuration="1.706123539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:42:16.703157514 +0000 UTC m=+1068.730665629" watchObservedRunningTime="2026-07-07 14:42:16.706123539 +0000 UTC m=+1068.733631646"
Jul 07 14:42:25.791913 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:25.791808    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:25.791913 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:25.791879    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:25.796782 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:25.796755    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:26.735477 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:26.735449    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d86b4d767-pts52"
Jul 07 14:42:26.793798 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:26.793764    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664648765c-qmq6s"]
Jul 07 14:42:51.815668 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:51.815599    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-664648765c-qmq6s" podUID="eb323866-088e-40a3-b2c5-a2f9b3a276c7" containerName="console" containerID="cri-o://5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69" gracePeriod=15
Jul 07 14:42:52.074124 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.074063    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:42:52.143732 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.143694    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mln9\" (UniqueName: \"kubernetes.io/projected/eb323866-088e-40a3-b2c5-a2f9b3a276c7-kube-api-access-8mln9\") pod \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") "
Jul 07 14:42:52.143732 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.143737    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-config\") pod \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") "
Jul 07 14:42:52.143983 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.143765    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-service-ca\") pod \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") "
Jul 07 14:42:52.143983 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.143795    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-trusted-ca-bundle\") pod \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") "
Jul 07 14:42:52.143983 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.143828    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-oauth-serving-cert\") pod \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") "
Jul 07 14:42:52.144181 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.144032    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-serving-cert\") pod \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") "
Jul 07 14:42:52.144181 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.144127    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-oauth-config\") pod \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\" (UID: \"eb323866-088e-40a3-b2c5-a2f9b3a276c7\") "
Jul 07 14:42:52.144292 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.144224    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-config" (OuterVolumeSpecName: "console-config") pod "eb323866-088e-40a3-b2c5-a2f9b3a276c7" (UID: "eb323866-088e-40a3-b2c5-a2f9b3a276c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:42:52.144292 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.144276    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eb323866-088e-40a3-b2c5-a2f9b3a276c7" (UID: "eb323866-088e-40a3-b2c5-a2f9b3a276c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:42:52.144380 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.144229    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "eb323866-088e-40a3-b2c5-a2f9b3a276c7" (UID: "eb323866-088e-40a3-b2c5-a2f9b3a276c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:42:52.144380 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.144318    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eb323866-088e-40a3-b2c5-a2f9b3a276c7" (UID: "eb323866-088e-40a3-b2c5-a2f9b3a276c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:42:52.144480 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.144464    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-oauth-serving-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:42:52.144543 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.144485    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-config\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:42:52.144543 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.144496    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-service-ca\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:42:52.144543 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.144504    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb323866-088e-40a3-b2c5-a2f9b3a276c7-trusted-ca-bundle\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:42:52.146177 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.146138    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eb323866-088e-40a3-b2c5-a2f9b3a276c7" (UID: "eb323866-088e-40a3-b2c5-a2f9b3a276c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:42:52.146177 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.146159    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eb323866-088e-40a3-b2c5-a2f9b3a276c7" (UID: "eb323866-088e-40a3-b2c5-a2f9b3a276c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:42:52.146319 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.146219    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb323866-088e-40a3-b2c5-a2f9b3a276c7-kube-api-access-8mln9" (OuterVolumeSpecName: "kube-api-access-8mln9") pod "eb323866-088e-40a3-b2c5-a2f9b3a276c7" (UID: "eb323866-088e-40a3-b2c5-a2f9b3a276c7"). InnerVolumeSpecName "kube-api-access-8mln9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:42:52.245165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.245120    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-oauth-config\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:42:52.245165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.245157    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mln9\" (UniqueName: \"kubernetes.io/projected/eb323866-088e-40a3-b2c5-a2f9b3a276c7-kube-api-access-8mln9\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:42:52.245165 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.245170    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb323866-088e-40a3-b2c5-a2f9b3a276c7-console-serving-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:42:52.865113 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.865019    2583 generic.go:356] "Generic (PLEG): container finished" podID="eb323866-088e-40a3-b2c5-a2f9b3a276c7" containerID="5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69" exitCode=0
Jul 07 14:42:52.865113 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.865063    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664648765c-qmq6s"
Jul 07 14:42:52.865113 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.865093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664648765c-qmq6s" event={"ID":"eb323866-088e-40a3-b2c5-a2f9b3a276c7","Type":"ContainerDied","Data":"5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69"}
Jul 07 14:42:52.865638 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.865133    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664648765c-qmq6s" event={"ID":"eb323866-088e-40a3-b2c5-a2f9b3a276c7","Type":"ContainerDied","Data":"0f2890485212ff65c9d8301c8cdf9859a3a077485f64e667c512ee6733b6ce96"}
Jul 07 14:42:52.865638 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.865153    2583 scope.go:117] "RemoveContainer" containerID="5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69"
Jul 07 14:42:52.874075 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.874044    2583 scope.go:117] "RemoveContainer" containerID="5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69"
Jul 07 14:42:52.874375 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:42:52.874351    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69\": container with ID starting with 5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69 not found: ID does not exist" containerID="5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69"
Jul 07 14:42:52.874453 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.874383    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69"} err="failed to get container status \"5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69\": rpc error: code = NotFound desc = could not find container \"5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69\": container with ID starting with 5174c76dc5c61016f7b3761f096061d307a116512632d6fdc7feb7a4d0589b69 not found: ID does not exist"
Jul 07 14:42:52.887917 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.887877    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664648765c-qmq6s"]
Jul 07 14:42:52.890006 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:52.889986    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-664648765c-qmq6s"]
Jul 07 14:42:54.469036 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:42:54.469002    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb323866-088e-40a3-b2c5-a2f9b3a276c7" path="/var/lib/kubelet/pods/eb323866-088e-40a3-b2c5-a2f9b3a276c7/volumes"
Jul 07 14:44:28.450371 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:44:28.450345    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:44:28.452667 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:44:28.451321    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:49:28.482256 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:28.482151    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:49:28.486117 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:28.485582    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:49:55.684493 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.684414    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"]
Jul 07 14:49:55.684856 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.684764    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb323866-088e-40a3-b2c5-a2f9b3a276c7" containerName="console"
Jul 07 14:49:55.684856 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.684775    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb323866-088e-40a3-b2c5-a2f9b3a276c7" containerName="console"
Jul 07 14:49:55.684856 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.684854    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb323866-088e-40a3-b2c5-a2f9b3a276c7" containerName="console"
Jul 07 14:49:55.687736 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.687711    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.690939 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.690916    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-66ff89b8-openshift-default-dockercfg-8mwzz\""
Jul 07 14:49:55.720864 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.720833    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"]
Jul 07 14:49:55.744240 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.744202    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-token\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.744429 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.744250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-certs\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.744429 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.744339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-envoy\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.744429 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.744389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-socket\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.744595 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.744447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-podinfo\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.744595 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.744477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-credential-socket\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.744595 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.744509    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istiod-ca-cert\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.744595 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.744569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmg66\" (UniqueName: \"kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-kube-api-access-wmg66\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.744595 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.744590    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-data\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.845427 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.845395    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-credential-socket\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.845427 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.845429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istiod-ca-cert\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.845698 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.845464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmg66\" (UniqueName: \"kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-kube-api-access-wmg66\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.845698 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.845483    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-data\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.845698 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.845602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-token\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.845698 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.845673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-certs\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.845887 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.845739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-envoy\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.846218 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.846153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-socket\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.846331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.846220    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-credential-socket\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.846331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.846268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-podinfo\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.846528 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.846508    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-data\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.846598 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.846561    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-socket\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.846714 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.846687    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istiod-ca-cert\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.853032 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.849196    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-envoy\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.853032 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.849366    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-podinfo\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.854127 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.854106    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-certs\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.858606 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.858585    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmg66\" (UniqueName: \"kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-kube-api-access-wmg66\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.859897 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.859873    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-token\") pod \"e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") " pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:55.998624 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:55.998584    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:56.139342 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:56.139318    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"]
Jul 07 14:49:56.140721 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:49:56.140686    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6c9ee9_7fd6_48fa_a42b_267e50581bea.slice/crio-7477c52ca59bb2ee9b62116cf24fd084c15af5a08643c0421c9598835768871c WatchSource:0}: Error finding container 7477c52ca59bb2ee9b62116cf24fd084c15af5a08643c0421c9598835768871c: Status 404 returned error can't find the container with id 7477c52ca59bb2ee9b62116cf24fd084c15af5a08643c0421c9598835768871c
Jul 07 14:49:56.142883 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:56.142851    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:49:56.142939 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:56.142917    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:49:56.142998 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:56.142949    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:49:57.052119 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:57.052079    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz" event={"ID":"bf6c9ee9-7fd6-48fa-a42b-267e50581bea","Type":"ContainerStarted","Data":"052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470"}
Jul 07 14:49:57.052549 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:57.052149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz" event={"ID":"bf6c9ee9-7fd6-48fa-a42b-267e50581bea","Type":"ContainerStarted","Data":"7477c52ca59bb2ee9b62116cf24fd084c15af5a08643c0421c9598835768871c"}
Jul 07 14:49:57.088873 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:57.088819    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz" podStartSLOduration=2.088802086 podStartE2EDuration="2.088802086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:49:57.085117326 +0000 UTC m=+1529.112625434" watchObservedRunningTime="2026-07-07 14:49:57.088802086 +0000 UTC m=+1529.116310194"
Jul 07 14:49:57.999573 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:57.999538    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:58.004676 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:58.004643    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:58.057649 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:58.057617    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:49:58.058473 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:49:58.058453    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:50:02.205784 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:02.205753    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"]
Jul 07 14:50:02.206389 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:02.205944    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz" podUID="bf6c9ee9-7fd6-48fa-a42b-267e50581bea" containerName="istio-proxy" containerID="cri-o://052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470" gracePeriod=30
Jul 07 14:50:08.962492 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:08.962464    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:50:09.074048 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.073918    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-token\") pod \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") "
Jul 07 14:50:09.074048 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.073997    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-socket\") pod \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") "
Jul 07 14:50:09.074048 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074020    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-credential-socket\") pod \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") "
Jul 07 14:50:09.074520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074096    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istiod-ca-cert\") pod \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") "
Jul 07 14:50:09.074520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074125    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-certs\") pod \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") "
Jul 07 14:50:09.074520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074188    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmg66\" (UniqueName: \"kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-kube-api-access-wmg66\") pod \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") "
Jul 07 14:50:09.074520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074232    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-data\") pod \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") "
Jul 07 14:50:09.074520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074276    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-podinfo\") pod \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") "
Jul 07 14:50:09.074520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-envoy\") pod \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\" (UID: \"bf6c9ee9-7fd6-48fa-a42b-267e50581bea\") "
Jul 07 14:50:09.074520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074338    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf6c9ee9-7fd6-48fa-a42b-267e50581bea" (UID: "bf6c9ee9-7fd6-48fa-a42b-267e50581bea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:09.074520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074495    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf6c9ee9-7fd6-48fa-a42b-267e50581bea" (UID: "bf6c9ee9-7fd6-48fa-a42b-267e50581bea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:09.074520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074445    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf6c9ee9-7fd6-48fa-a42b-267e50581bea" (UID: "bf6c9ee9-7fd6-48fa-a42b-267e50581bea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:09.075185 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074541    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf6c9ee9-7fd6-48fa-a42b-267e50581bea" (UID: "bf6c9ee9-7fd6-48fa-a42b-267e50581bea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:50:09.075185 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074787    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istiod-ca-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:09.075185 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074807    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-certs\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:09.075185 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074821    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-workload-socket\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:09.075185 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.074836    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-credential-socket\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:09.075454 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.075436    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf6c9ee9-7fd6-48fa-a42b-267e50581bea" (UID: "bf6c9ee9-7fd6-48fa-a42b-267e50581bea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:09.076894 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.076871    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf6c9ee9-7fd6-48fa-a42b-267e50581bea" (UID: "bf6c9ee9-7fd6-48fa-a42b-267e50581bea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:09.077031 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.076988    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf6c9ee9-7fd6-48fa-a42b-267e50581bea" (UID: "bf6c9ee9-7fd6-48fa-a42b-267e50581bea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:50:09.077103 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.077049    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-kube-api-access-wmg66" (OuterVolumeSpecName: "kube-api-access-wmg66") pod "bf6c9ee9-7fd6-48fa-a42b-267e50581bea" (UID: "bf6c9ee9-7fd6-48fa-a42b-267e50581bea"). InnerVolumeSpecName "kube-api-access-wmg66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:50:09.077103 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.077090    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf6c9ee9-7fd6-48fa-a42b-267e50581bea" (UID: "bf6c9ee9-7fd6-48fa-a42b-267e50581bea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:50:09.117060 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.117020    2583 generic.go:356] "Generic (PLEG): container finished" podID="bf6c9ee9-7fd6-48fa-a42b-267e50581bea" containerID="052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470" exitCode=0
Jul 07 14:50:09.117245 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.117076    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"
Jul 07 14:50:09.117245 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.117077    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz" event={"ID":"bf6c9ee9-7fd6-48fa-a42b-267e50581bea","Type":"ContainerDied","Data":"052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470"}
Jul 07 14:50:09.117245 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.117214    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz" event={"ID":"bf6c9ee9-7fd6-48fa-a42b-267e50581bea","Type":"ContainerDied","Data":"7477c52ca59bb2ee9b62116cf24fd084c15af5a08643c0421c9598835768871c"}
Jul 07 14:50:09.117354 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.117249    2583 scope.go:117] "RemoveContainer" containerID="052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470"
Jul 07 14:50:09.129502 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.129482    2583 scope.go:117] "RemoveContainer" containerID="052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470"
Jul 07 14:50:09.129804 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:50:09.129782    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470\": container with ID starting with 052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470 not found: ID does not exist" containerID="052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470"
Jul 07 14:50:09.129856 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.129815    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470"} err="failed to get container status \"052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470\": rpc error: code = NotFound desc = could not find container \"052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470\": container with ID starting with 052a4bbcdaeb31c3d6ec4cf7697e66c2d2394ca56956b96040814b6271d6f470 not found: ID does not exist"
Jul 07 14:50:09.146995 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.146947    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"]
Jul 07 14:50:09.154590 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.154558    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-66ff89b8-openshift-default-798bbf4d7c-tdfzz"]
Jul 07 14:50:09.175377 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.175340    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-data\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:09.175377 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.175371    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-podinfo\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:09.175377 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.175380    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-envoy\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:09.175612 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.175391    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-istio-token\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:09.175612 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:09.175408    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmg66\" (UniqueName: \"kubernetes.io/projected/bf6c9ee9-7fd6-48fa-a42b-267e50581bea-kube-api-access-wmg66\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:10.468901 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:10.468862    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf6c9ee9-7fd6-48fa-a42b-267e50581bea" path="/var/lib/kubelet/pods/bf6c9ee9-7fd6-48fa-a42b-267e50581bea/volumes"
Jul 07 14:50:29.055513 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.055480    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"]
Jul 07 14:50:29.056043 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.056024    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf6c9ee9-7fd6-48fa-a42b-267e50581bea" containerName="istio-proxy"
Jul 07 14:50:29.056095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.056047    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf6c9ee9-7fd6-48fa-a42b-267e50581bea" containerName="istio-proxy"
Jul 07 14:50:29.056164 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.056153    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf6c9ee9-7fd6-48fa-a42b-267e50581bea" containerName="istio-proxy"
Jul 07 14:50:29.058428 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.058411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.062345 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.062322    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a7cc6597-openshift-default-dockercfg-7ww7l\""
Jul 07 14:50:29.070205 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.070181    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0812b7ea-9596-41bb-996e-12702dc5c0cc-istiod-ca-cert\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.070383 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.070358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-certs\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.070774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.070424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-socket\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.070774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.070498    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-credential-socket\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.070774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.070538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-podinfo\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.070774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.070571    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-token\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.070774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.070598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cllnl\" (UniqueName: \"kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-kube-api-access-cllnl\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.070774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.070623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-envoy\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.070774 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.070651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-data\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.072838 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.072820    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"]
Jul 07 14:50:29.171126 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-podinfo\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171287 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-token\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171287 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171256    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cllnl\" (UniqueName: \"kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-kube-api-access-cllnl\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171373 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171293    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-envoy\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171373 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171311    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-data\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171373 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0812b7ea-9596-41bb-996e-12702dc5c0cc-istiod-ca-cert\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171373 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-certs\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171559 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-socket\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171559 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171526    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-credential-socket\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171847 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171793    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-data\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171944 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171858    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-socket\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.171944 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171879    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-credential-socket\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.172067 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.171991    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-certs\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.172104 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.172082    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0812b7ea-9596-41bb-996e-12702dc5c0cc-istiod-ca-cert\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.173905 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.173884    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-envoy\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.174093 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.174079    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-podinfo\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.183449 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.183414    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cllnl\" (UniqueName: \"kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-kube-api-access-cllnl\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.186453 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.186424    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-token\") pod \"e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") " pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.368247 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.368166    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:29.539065 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.539042    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"]
Jul 07 14:50:29.540300 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:50:29.540274    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0812b7ea_9596_41bb_996e_12702dc5c0cc.slice/crio-20710a5b9f3b12dc0b42e342b4efb947c9eddbdb01cd4c38ad81a4fd380da669 WatchSource:0}: Error finding container 20710a5b9f3b12dc0b42e342b4efb947c9eddbdb01cd4c38ad81a4fd380da669: Status 404 returned error can't find the container with id 20710a5b9f3b12dc0b42e342b4efb947c9eddbdb01cd4c38ad81a4fd380da669
Jul 07 14:50:29.542504 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.542471    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:50:29.542565 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.542555    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:50:29.542605 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:29.542583    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:50:30.226690 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:30.226657    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr" event={"ID":"0812b7ea-9596-41bb-996e-12702dc5c0cc","Type":"ContainerStarted","Data":"52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd"}
Jul 07 14:50:30.227184 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:30.226713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr" event={"ID":"0812b7ea-9596-41bb-996e-12702dc5c0cc","Type":"ContainerStarted","Data":"20710a5b9f3b12dc0b42e342b4efb947c9eddbdb01cd4c38ad81a4fd380da669"}
Jul 07 14:50:30.268530 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:30.268465    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr" podStartSLOduration=1.268444691 podStartE2EDuration="1.268444691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:50:30.267989235 +0000 UTC m=+1562.295497344" watchObservedRunningTime="2026-07-07 14:50:30.268444691 +0000 UTC m=+1562.295952799"
Jul 07 14:50:30.368525 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:30.368494    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:30.373249 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:30.373221    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:31.231999 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:31.231966    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:31.233041 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:31.233023    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:34.844831 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:34.844790    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"]
Jul 07 14:50:34.854783 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:34.854714    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr" podUID="0812b7ea-9596-41bb-996e-12702dc5c0cc" containerName="istio-proxy" containerID="cri-o://52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd" gracePeriod=30
Jul 07 14:50:40.598884 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.598855    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:40.695286 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.695256    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cllnl\" (UniqueName: \"kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-kube-api-access-cllnl\") pod \"0812b7ea-9596-41bb-996e-12702dc5c0cc\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") "
Jul 07 14:50:40.695463 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.695308    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-podinfo\") pod \"0812b7ea-9596-41bb-996e-12702dc5c0cc\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") "
Jul 07 14:50:40.695463 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.695332    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-data\") pod \"0812b7ea-9596-41bb-996e-12702dc5c0cc\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") "
Jul 07 14:50:40.695463 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.695372    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-envoy\") pod \"0812b7ea-9596-41bb-996e-12702dc5c0cc\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") "
Jul 07 14:50:40.695463 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.695394    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-certs\") pod \"0812b7ea-9596-41bb-996e-12702dc5c0cc\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") "
Jul 07 14:50:40.695463 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.695460    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0812b7ea-9596-41bb-996e-12702dc5c0cc-istiod-ca-cert\") pod \"0812b7ea-9596-41bb-996e-12702dc5c0cc\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") "
Jul 07 14:50:40.695722 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.695482    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-token\") pod \"0812b7ea-9596-41bb-996e-12702dc5c0cc\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") "
Jul 07 14:50:40.695722 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.695532    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-socket\") pod \"0812b7ea-9596-41bb-996e-12702dc5c0cc\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") "
Jul 07 14:50:40.695722 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.695586    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-credential-socket\") pod \"0812b7ea-9596-41bb-996e-12702dc5c0cc\" (UID: \"0812b7ea-9596-41bb-996e-12702dc5c0cc\") "
Jul 07 14:50:40.697468 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.697440    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-kube-api-access-cllnl" (OuterVolumeSpecName: "kube-api-access-cllnl") pod "0812b7ea-9596-41bb-996e-12702dc5c0cc" (UID: "0812b7ea-9596-41bb-996e-12702dc5c0cc"). InnerVolumeSpecName "kube-api-access-cllnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:50:40.699302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.699242    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0812b7ea-9596-41bb-996e-12702dc5c0cc" (UID: "0812b7ea-9596-41bb-996e-12702dc5c0cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:40.699407 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.699347    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0812b7ea-9596-41bb-996e-12702dc5c0cc" (UID: "0812b7ea-9596-41bb-996e-12702dc5c0cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:40.699407 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.699372    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0812b7ea-9596-41bb-996e-12702dc5c0cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0812b7ea-9596-41bb-996e-12702dc5c0cc" (UID: "0812b7ea-9596-41bb-996e-12702dc5c0cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:50:40.699513 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.699267    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0812b7ea-9596-41bb-996e-12702dc5c0cc" (UID: "0812b7ea-9596-41bb-996e-12702dc5c0cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:40.700097 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.700072    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "0812b7ea-9596-41bb-996e-12702dc5c0cc" (UID: "0812b7ea-9596-41bb-996e-12702dc5c0cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:40.701174 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.701152    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0812b7ea-9596-41bb-996e-12702dc5c0cc" (UID: "0812b7ea-9596-41bb-996e-12702dc5c0cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:50:40.701462 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.701439    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "0812b7ea-9596-41bb-996e-12702dc5c0cc" (UID: "0812b7ea-9596-41bb-996e-12702dc5c0cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:50:40.701517 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.701507    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0812b7ea-9596-41bb-996e-12702dc5c0cc" (UID: "0812b7ea-9596-41bb-996e-12702dc5c0cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:40.796790 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.796760    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0812b7ea-9596-41bb-996e-12702dc5c0cc-istiod-ca-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:40.796790 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.796785    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-token\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:40.796790 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.796794    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-socket\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:40.797026 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.796802    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-credential-socket\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:40.797026 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.796815    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cllnl\" (UniqueName: \"kubernetes.io/projected/0812b7ea-9596-41bb-996e-12702dc5c0cc-kube-api-access-cllnl\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:40.797026 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.796823    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-podinfo\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:40.797026 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.796831    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-data\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:40.797026 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.796839    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-istio-envoy\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:40.797026 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:40.796846    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0812b7ea-9596-41bb-996e-12702dc5c0cc-workload-certs\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:50:41.287504 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:41.287472    2583 generic.go:356] "Generic (PLEG): container finished" podID="0812b7ea-9596-41bb-996e-12702dc5c0cc" containerID="52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd" exitCode=0
Jul 07 14:50:41.287708 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:41.287508    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr" event={"ID":"0812b7ea-9596-41bb-996e-12702dc5c0cc","Type":"ContainerDied","Data":"52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd"}
Jul 07 14:50:41.287708 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:41.287576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr" event={"ID":"0812b7ea-9596-41bb-996e-12702dc5c0cc","Type":"ContainerDied","Data":"20710a5b9f3b12dc0b42e342b4efb947c9eddbdb01cd4c38ad81a4fd380da669"}
Jul 07 14:50:41.287708 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:41.287517    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"
Jul 07 14:50:41.287708 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:41.287610    2583 scope.go:117] "RemoveContainer" containerID="52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd"
Jul 07 14:50:41.297098 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:41.297075    2583 scope.go:117] "RemoveContainer" containerID="52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd"
Jul 07 14:50:41.297450 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:50:41.297421    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd\": container with ID starting with 52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd not found: ID does not exist" containerID="52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd"
Jul 07 14:50:41.297525 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:41.297463    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd"} err="failed to get container status \"52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd\": rpc error: code = NotFound desc = could not find container \"52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd\": container with ID starting with 52dbc361c65b5ee7f07c0d052d10fa69ad285d060446caa867b56d38ac3c6ddd not found: ID does not exist"
Jul 07 14:50:41.321894 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:41.321870    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"]
Jul 07 14:50:41.324984 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:41.324951    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a7cc6597-openshift-default-68595c7dd7-bmttr"]
Jul 07 14:50:42.468183 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:50:42.468149    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0812b7ea-9596-41bb-996e-12702dc5c0cc" path="/var/lib/kubelet/pods/0812b7ea-9596-41bb-996e-12702dc5c0cc/volumes"
Jul 07 14:53:34.165852 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.165817    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"]
Jul 07 14:53:34.166332 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.166178    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0812b7ea-9596-41bb-996e-12702dc5c0cc" containerName="istio-proxy"
Jul 07 14:53:34.166332 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.166192    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0812b7ea-9596-41bb-996e-12702dc5c0cc" containerName="istio-proxy"
Jul 07 14:53:34.166332 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.166265    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0812b7ea-9596-41bb-996e-12702dc5c0cc" containerName="istio-proxy"
Jul 07 14:53:34.169188 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.169170    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.172510 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.172474    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-54eeed17\"/\"e2e-lifecycle-model-54eeed17-kserve-self-signed-certs\""
Jul 07 14:53:34.172510 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.172475    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-54eeed17\"/\"default-dockercfg-p9wm6\""
Jul 07 14:53:34.172686 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.172523    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-54eeed17\"/\"openshift-service-ca.crt\""
Jul 07 14:53:34.172686 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.172525    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-54eeed17\"/\"kube-root-ca.crt\""
Jul 07 14:53:34.181451 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.181422    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"]
Jul 07 14:53:34.204396 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.204374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-dshm\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.204514 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.204426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-model-cache\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.204514 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.204491    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-home\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.204591 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.204548    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba60c4-c3a6-43f2-945a-305f8724e246-tls-certs\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.204591 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.204573    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-tmp-dir\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.204663 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.204593    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhgmh\" (UniqueName: \"kubernetes.io/projected/47ba60c4-c3a6-43f2-945a-305f8724e246-kube-api-access-rhgmh\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.305746 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.305712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba60c4-c3a6-43f2-945a-305f8724e246-tls-certs\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.305746 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.305749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-tmp-dir\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.306030 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.305767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhgmh\" (UniqueName: \"kubernetes.io/projected/47ba60c4-c3a6-43f2-945a-305f8724e246-kube-api-access-rhgmh\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.306030 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.305810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-dshm\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.306030 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.305859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-model-cache\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.306030 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.305887    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-home\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.306266 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.306236    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-tmp-dir\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.306376 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.306351    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-home\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.306467 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.306416    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-model-cache\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.308238 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.308215    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-dshm\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.308366 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.308349    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba60c4-c3a6-43f2-945a-305f8724e246-tls-certs\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.315521 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.315476    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhgmh\" (UniqueName: \"kubernetes.io/projected/47ba60c4-c3a6-43f2-945a-305f8724e246-kube-api-access-rhgmh\") pod \"e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") " pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.479294 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.479261    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:34.623314 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:34.620518    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"]
Jul 07 14:53:35.174067 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:35.174031    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd" event={"ID":"47ba60c4-c3a6-43f2-945a-305f8724e246","Type":"ContainerStarted","Data":"bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f"}
Jul 07 14:53:35.174067 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:35.174073    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd" event={"ID":"47ba60c4-c3a6-43f2-945a-305f8724e246","Type":"ContainerStarted","Data":"f5b663dddeb676b4e294a0eaf75665b3bb899d937a158f285a9e502c4cfd7a29"}
Jul 07 14:53:35.196375 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:35.196325    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd" podStartSLOduration=1.196308773 podStartE2EDuration="1.196308773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:53:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:53:35.195132292 +0000 UTC m=+1747.222640402" watchObservedRunningTime="2026-07-07 14:53:35.196308773 +0000 UTC m=+1747.223816880"
Jul 07 14:53:44.479948 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:44.479913    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:44.480481 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:44.480237    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:44.492462 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:44.492432    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:53:45.236543 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:53:45.236512    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:54:16.768612 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:16.768578    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"]
Jul 07 14:54:28.518113 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:28.518089    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:54:28.524154 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:28.524130    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:54:31.789207 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:31.789139    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd" podUID="47ba60c4-c3a6-43f2-945a-305f8724e246" containerName="main" containerID="cri-o://bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f" gracePeriod=45
Jul 07 14:54:32.045613 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.045543    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:54:32.150478 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.150438    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhgmh\" (UniqueName: \"kubernetes.io/projected/47ba60c4-c3a6-43f2-945a-305f8724e246-kube-api-access-rhgmh\") pod \"47ba60c4-c3a6-43f2-945a-305f8724e246\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") "
Jul 07 14:54:32.150684 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.150505    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-dshm\") pod \"47ba60c4-c3a6-43f2-945a-305f8724e246\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") "
Jul 07 14:54:32.150684 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.150529    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-home\") pod \"47ba60c4-c3a6-43f2-945a-305f8724e246\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") "
Jul 07 14:54:32.150684 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.150577    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba60c4-c3a6-43f2-945a-305f8724e246-tls-certs\") pod \"47ba60c4-c3a6-43f2-945a-305f8724e246\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") "
Jul 07 14:54:32.150684 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.150618    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-model-cache\") pod \"47ba60c4-c3a6-43f2-945a-305f8724e246\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") "
Jul 07 14:54:32.150684 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.150656    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-tmp-dir\") pod \"47ba60c4-c3a6-43f2-945a-305f8724e246\" (UID: \"47ba60c4-c3a6-43f2-945a-305f8724e246\") "
Jul 07 14:54:32.150995 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.150860    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-home" (OuterVolumeSpecName: "home") pod "47ba60c4-c3a6-43f2-945a-305f8724e246" (UID: "47ba60c4-c3a6-43f2-945a-305f8724e246"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:54:32.150995 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.150899    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "47ba60c4-c3a6-43f2-945a-305f8724e246" (UID: "47ba60c4-c3a6-43f2-945a-305f8724e246"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:54:32.150995 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.150910    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-model-cache" (OuterVolumeSpecName: "model-cache") pod "47ba60c4-c3a6-43f2-945a-305f8724e246" (UID: "47ba60c4-c3a6-43f2-945a-305f8724e246"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:54:32.152757 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.152738    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-dshm" (OuterVolumeSpecName: "dshm") pod "47ba60c4-c3a6-43f2-945a-305f8724e246" (UID: "47ba60c4-c3a6-43f2-945a-305f8724e246"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:54:32.153149 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.153125    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ba60c4-c3a6-43f2-945a-305f8724e246-kube-api-access-rhgmh" (OuterVolumeSpecName: "kube-api-access-rhgmh") pod "47ba60c4-c3a6-43f2-945a-305f8724e246" (UID: "47ba60c4-c3a6-43f2-945a-305f8724e246"). InnerVolumeSpecName "kube-api-access-rhgmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:54:32.153209 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.153174    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ba60c4-c3a6-43f2-945a-305f8724e246-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "47ba60c4-c3a6-43f2-945a-305f8724e246" (UID: "47ba60c4-c3a6-43f2-945a-305f8724e246"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:54:32.251473 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.251428    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-dshm\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:54:32.251473 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.251460    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-home\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:54:32.251473 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.251469    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba60c4-c3a6-43f2-945a-305f8724e246-tls-certs\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:54:32.251473 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.251479    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-model-cache\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:54:32.251473 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.251487    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ba60c4-c3a6-43f2-945a-305f8724e246-tmp-dir\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:54:32.251785 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.251496    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhgmh\" (UniqueName: \"kubernetes.io/projected/47ba60c4-c3a6-43f2-945a-305f8724e246-kube-api-access-rhgmh\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:54:32.469287 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.469246    2583 generic.go:356] "Generic (PLEG): container finished" podID="47ba60c4-c3a6-43f2-945a-305f8724e246" containerID="bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f" exitCode=0
Jul 07 14:54:32.469499 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.469297    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd" event={"ID":"47ba60c4-c3a6-43f2-945a-305f8724e246","Type":"ContainerDied","Data":"bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f"}
Jul 07 14:54:32.469499 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.469313    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"
Jul 07 14:54:32.469499 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.469337    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd" event={"ID":"47ba60c4-c3a6-43f2-945a-305f8724e246","Type":"ContainerDied","Data":"f5b663dddeb676b4e294a0eaf75665b3bb899d937a158f285a9e502c4cfd7a29"}
Jul 07 14:54:32.469499 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.469361    2583 scope.go:117] "RemoveContainer" containerID="bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f"
Jul 07 14:54:32.478857 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.478832    2583 scope.go:117] "RemoveContainer" containerID="bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f"
Jul 07 14:54:32.479195 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:54:32.479172    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f\": container with ID starting with bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f not found: ID does not exist" containerID="bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f"
Jul 07 14:54:32.479291 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.479208    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f"} err="failed to get container status \"bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f\": rpc error: code = NotFound desc = could not find container \"bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f\": container with ID starting with bb9fcc9b0fce8a9921b934da6b50cb6402b4a5f0228fb68098bce6f12a0b019f not found: ID does not exist"
Jul 07 14:54:32.497561 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.497529    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"]
Jul 07 14:54:32.502556 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:32.502526    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-54eeed17/e2e-lifecycle-model-54eeed17-kserve-865f87975f-7hzwd"]
Jul 07 14:54:34.468323 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:54:34.468282    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47ba60c4-c3a6-43f2-945a-305f8724e246" path="/var/lib/kubelet/pods/47ba60c4-c3a6-43f2-945a-305f8724e246/volumes"
Jul 07 14:56:06.789352 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.789315    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"]
Jul 07 14:56:06.789829 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.789698    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47ba60c4-c3a6-43f2-945a-305f8724e246" containerName="main"
Jul 07 14:56:06.789829 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.789709    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ba60c4-c3a6-43f2-945a-305f8724e246" containerName="main"
Jul 07 14:56:06.789829 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.789778    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="47ba60c4-c3a6-43f2-945a-305f8724e246" containerName="main"
Jul 07 14:56:06.792616 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.792591    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:06.796395 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.796370    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-cf70a3-openshift-default-dockercfg-jd8l4\""
Jul 07 14:56:06.811637 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.811606    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"]
Jul 07 14:56:06.917196 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.917148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-socket\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:06.917196 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.917191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-data\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:06.917484 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.917219    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-envoy\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:06.917484 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.917320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-certs\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:06.917484 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.917377    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftkbq\" (UniqueName: \"kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-kube-api-access-ftkbq\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:06.917484 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.917414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-credential-socket\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:06.917484 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.917439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istiod-ca-cert\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:06.917685 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.917490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-podinfo\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:06.917685 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:06.917547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-token\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018252 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018197    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-socket\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018252 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018253    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-data\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018542 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018277    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-envoy\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018542 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-certs\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018542 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018353    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftkbq\" (UniqueName: \"kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-kube-api-access-ftkbq\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018542 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018387    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-credential-socket\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018542 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018515    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istiod-ca-cert\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018810 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018591    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-podinfo\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018810 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-token\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018810 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018636    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-socket\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018810 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018783    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-certs\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.018991 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.018948    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-data\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.019105 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.019083    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-credential-socket\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.019248 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.019230    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istiod-ca-cert\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.020884 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.020866    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-envoy\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.021012 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.020995    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-podinfo\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.029490 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.029457    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftkbq\" (UniqueName: \"kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-kube-api-access-ftkbq\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.029639 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.029558    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-token\") pod \"e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") " pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.103753 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.103648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:07.249122 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.249093    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"]
Jul 07 14:56:07.251127 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:56:07.251094    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9833cd_f297_4c4c_a157_3e5bb4b3dd32.slice/crio-9a96817acac3ded5eada8cb8bd52c3a5c6e08f950454923313a4cb1444634977 WatchSource:0}: Error finding container 9a96817acac3ded5eada8cb8bd52c3a5c6e08f950454923313a4cb1444634977: Status 404 returned error can't find the container with id 9a96817acac3ded5eada8cb8bd52c3a5c6e08f950454923313a4cb1444634977
Jul 07 14:56:07.253127 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.253095    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:56:07.253192 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.253162    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:56:07.253230 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.253191    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:56:07.948747 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.948705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" event={"ID":"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32","Type":"ContainerStarted","Data":"12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399"}
Jul 07 14:56:07.949263 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.948763    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" event={"ID":"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32","Type":"ContainerStarted","Data":"9a96817acac3ded5eada8cb8bd52c3a5c6e08f950454923313a4cb1444634977"}
Jul 07 14:56:07.978354 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:07.978291    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" podStartSLOduration=1.9782675570000001 podStartE2EDuration="1.978267557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:56:07.977606588 +0000 UTC m=+1900.005114697" watchObservedRunningTime="2026-07-07 14:56:07.978267557 +0000 UTC m=+1900.005775666"
Jul 07 14:56:08.104499 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:08.104463    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:08.109573 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:08.109544    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:08.953693 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:08.953658    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:08.954785 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:08.954765    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:24.505084 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:24.504174    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": read tcp 10.133.0.2:48134->10.133.0.48:15021: read: connection reset by peer" start-of-body=
Jul 07 14:56:24.505084 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:24.504247    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": read tcp 10.133.0.2:48134->10.133.0.48:15021: read: connection reset by peer"
Jul 07 14:56:25.043386 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:25.043353    2583 generic.go:356] "Generic (PLEG): container finished" podID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerID="12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399" exitCode=0
Jul 07 14:56:25.043577 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:25.043431    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" event={"ID":"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32","Type":"ContainerDied","Data":"12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399"}
Jul 07 14:56:25.043861 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:25.043848    2583 scope.go:117] "RemoveContainer" containerID="12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399"
Jul 07 14:56:25.044891 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:25.044865    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:56:25.044970 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:25.044933    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:56:25.045010 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:25.044993    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:56:26.052460 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:26.052415    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" event={"ID":"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32","Type":"ContainerStarted","Data":"8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7"}
Jul 07 14:56:26.104664 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:26.104619    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:26.104862 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:26.104838    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 14:56:26.104937 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:26.104896    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 14:56:27.104551 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:27.104507    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 14:56:27.105000 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:27.104565    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 14:56:28.104486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:28.104444    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 14:56:28.104670 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:28.104517    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 14:56:29.104512 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:29.104470    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 14:56:29.104700 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:29.104543    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 14:56:30.107747 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:30.107711    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:30.108258 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:30.107985    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:56:30.108650 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:56:30.108633    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:58:31.977969 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:31.977919    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"]
Jul 07 14:58:31.978584 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:31.978172    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy" containerID="cri-o://8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7" gracePeriod=30
Jul 07 14:58:37.231270 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.231241    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:58:37.325333 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325247    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-socket\") pod \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") "
Jul 07 14:58:37.325333 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325283    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-envoy\") pod \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") "
Jul 07 14:58:37.325333 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325333    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-data\") pod \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") "
Jul 07 14:58:37.325626 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325369    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-token\") pod \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") "
Jul 07 14:58:37.325626 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325396    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istiod-ca-cert\") pod \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") "
Jul 07 14:58:37.325626 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325431    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-credential-socket\") pod \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") "
Jul 07 14:58:37.325626 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325459    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-podinfo\") pod \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") "
Jul 07 14:58:37.325626 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325499    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftkbq\" (UniqueName: \"kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-kube-api-access-ftkbq\") pod \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") "
Jul 07 14:58:37.325626 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325541    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-certs\") pod \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\" (UID: \"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32\") "
Jul 07 14:58:37.325626 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325582    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" (UID: "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:58:37.326021 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325772    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" (UID: "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:58:37.326021 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325837    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" (UID: "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:58:37.326021 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325861    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-socket\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:58:37.326021 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325877    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-credential-socket\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:58:37.326021 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.325954    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" (UID: "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:58:37.326337 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.326311    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" (UID: "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:58:37.327661 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.327635    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" (UID: "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:58:37.327767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.327687    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-kube-api-access-ftkbq" (OuterVolumeSpecName: "kube-api-access-ftkbq") pod "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" (UID: "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32"). InnerVolumeSpecName "kube-api-access-ftkbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:58:37.327767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.327707    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" (UID: "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:58:37.327887 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.327866    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" (UID: "5f9833cd-f297-4c4c-a157-3e5bb4b3dd32"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:58:37.427019 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.426980    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-envoy\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:58:37.427019 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.427012    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-data\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:58:37.427019 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.427020    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-token\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:58:37.427019 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.427030    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istiod-ca-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:58:37.427316 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.427039    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-istio-podinfo\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:58:37.427316 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.427047    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftkbq\" (UniqueName: \"kubernetes.io/projected/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-kube-api-access-ftkbq\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:58:37.427316 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.427056    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32-workload-certs\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 14:58:37.737649 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.737604    2583 generic.go:356] "Generic (PLEG): container finished" podID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerID="8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7" exitCode=0
Jul 07 14:58:37.737649 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.737650    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"
Jul 07 14:58:37.737946 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.737713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" event={"ID":"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32","Type":"ContainerDied","Data":"8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7"}
Jul 07 14:58:37.737946 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.737758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj" event={"ID":"5f9833cd-f297-4c4c-a157-3e5bb4b3dd32","Type":"ContainerDied","Data":"9a96817acac3ded5eada8cb8bd52c3a5c6e08f950454923313a4cb1444634977"}
Jul 07 14:58:37.737946 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.737783    2583 scope.go:117] "RemoveContainer" containerID="8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7"
Jul 07 14:58:37.747660 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.747640    2583 scope.go:117] "RemoveContainer" containerID="12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399"
Jul 07 14:58:37.756337 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.756319    2583 scope.go:117] "RemoveContainer" containerID="8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7"
Jul 07 14:58:37.756620 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:58:37.756600    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7\": container with ID starting with 8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7 not found: ID does not exist" containerID="8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7"
Jul 07 14:58:37.756702 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.756629    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7"} err="failed to get container status \"8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7\": rpc error: code = NotFound desc = could not find container \"8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7\": container with ID starting with 8d596cf2220e97336a8b1fb030a1d7fc8d190350ee353ae11605214a3b4657f7 not found: ID does not exist"
Jul 07 14:58:37.756702 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.756648    2583 scope.go:117] "RemoveContainer" containerID="12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399"
Jul 07 14:58:37.756907 ip-10-0-141-139 kubenswrapper[2583]: E0707 14:58:37.756890    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399\": container with ID starting with 12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399 not found: ID does not exist" containerID="12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399"
Jul 07 14:58:37.756947 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.756912    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399"} err="failed to get container status \"12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399\": rpc error: code = NotFound desc = could not find container \"12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399\": container with ID starting with 12e773dbd67211248583e36aae6ba198a63c99405a9330adadfb942852c7a399 not found: ID does not exist"
Jul 07 14:58:37.765804 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.765779    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"]
Jul 07 14:58:37.775470 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:37.775442    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-cf70a3-openshift-default-5fd746db8c-9k7pj"]
Jul 07 14:58:38.468331 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:58:38.468301    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" path="/var/lib/kubelet/pods/5f9833cd-f297-4c4c-a157-3e5bb4b3dd32/volumes"
Jul 07 14:59:12.722980 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.722929    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"]
Jul 07 14:59:12.723432 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.723302    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy"
Jul 07 14:59:12.723432 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.723314    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy"
Jul 07 14:59:12.723432 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.723380    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy"
Jul 07 14:59:12.723432 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.723390    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy"
Jul 07 14:59:12.726520 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.726498    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.729056 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.729031    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-82db1a-openshift-default-dockercfg-h2fww\""
Jul 07 14:59:12.743684 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.743656    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"]
Jul 07 14:59:12.861197 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.861158    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68fbc46c-9c17-4169-a21f-23f735fee716-istiod-ca-cert\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.861197 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.861209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-certs\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.861486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.861250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-credential-socket\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.861486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.861304    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-socket\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.861486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.861343    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68fbc46c-9c17-4169-a21f-23f735fee716-istio-podinfo\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.861486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.861377    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-envoy\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.861486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.861429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-data\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.861486 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.861463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-istio-token\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.861723 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.861528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8qzd\" (UniqueName: \"kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-kube-api-access-m8qzd\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963094 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8qzd\" (UniqueName: \"kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-kube-api-access-m8qzd\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68fbc46c-9c17-4169-a21f-23f735fee716-istiod-ca-cert\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-certs\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-credential-socket\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-socket\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963231    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68fbc46c-9c17-4169-a21f-23f735fee716-istio-podinfo\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-envoy\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963302 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-data\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963685 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963334    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-istio-token\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963685 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963647    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-credential-socket\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963801 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963729    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-socket\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963801 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963742    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-data\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.963874 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.963848    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-certs\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.964041 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.964019    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68fbc46c-9c17-4169-a21f-23f735fee716-istiod-ca-cert\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.965677 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.965657    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-envoy\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.965819 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.965802    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68fbc46c-9c17-4169-a21f-23f735fee716-istio-podinfo\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.972492 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.972458    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-istio-token\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:12.972799 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:12.972773    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8qzd\" (UniqueName: \"kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-kube-api-access-m8qzd\") pod \"e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") " pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:13.036433 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:13.036338    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:13.188559 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:13.188530    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"]
Jul 07 14:59:13.190813 ip-10-0-141-139 kubenswrapper[2583]: W0707 14:59:13.190786    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68fbc46c_9c17_4169_a21f_23f735fee716.slice/crio-002ecb8c02376447e2bfb40d8c515ee2ec0a1a6e8f59d863e4e41478023fd3c5 WatchSource:0}: Error finding container 002ecb8c02376447e2bfb40d8c515ee2ec0a1a6e8f59d863e4e41478023fd3c5: Status 404 returned error can't find the container with id 002ecb8c02376447e2bfb40d8c515ee2ec0a1a6e8f59d863e4e41478023fd3c5
Jul 07 14:59:13.193010 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:13.192953    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:59:13.193095 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:13.193061    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:59:13.193135 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:13.193104    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:59:13.924675 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:13.924640    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" event={"ID":"68fbc46c-9c17-4169-a21f-23f735fee716","Type":"ContainerStarted","Data":"cc6ce5a3b5dc13cef657c602881e47f192e102fb517450a536e5170ad0f17cd6"}
Jul 07 14:59:13.925086 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:13.924694    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" event={"ID":"68fbc46c-9c17-4169-a21f-23f735fee716","Type":"ContainerStarted","Data":"002ecb8c02376447e2bfb40d8c515ee2ec0a1a6e8f59d863e4e41478023fd3c5"}
Jul 07 14:59:13.948159 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:13.948106    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" podStartSLOduration=1.948088367 podStartE2EDuration="1.948088367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:59:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:59:13.947081104 +0000 UTC m=+2085.974589216" watchObservedRunningTime="2026-07-07 14:59:13.948088367 +0000 UTC m=+2085.975596541"
Jul 07 14:59:14.036873 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:14.036839    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:14.041712 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:14.041689    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:14.929905 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:14.929868    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:14.930817 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:14.930800    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:28.581788 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:28.581750    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:59:28.582218 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:28.581854    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 14:59:30.972157 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:30.972112    2583 patch_prober.go:28] interesting pod/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 14:59:30.972546 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:30.972195    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 14:59:32.022899 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:32.022803    2583 generic.go:356] "Generic (PLEG): container finished" podID="68fbc46c-9c17-4169-a21f-23f735fee716" containerID="cc6ce5a3b5dc13cef657c602881e47f192e102fb517450a536e5170ad0f17cd6" exitCode=0
Jul 07 14:59:32.022899 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:32.022882    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" event={"ID":"68fbc46c-9c17-4169-a21f-23f735fee716","Type":"ContainerDied","Data":"cc6ce5a3b5dc13cef657c602881e47f192e102fb517450a536e5170ad0f17cd6"}
Jul 07 14:59:32.023504 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:32.023488    2583 scope.go:117] "RemoveContainer" containerID="cc6ce5a3b5dc13cef657c602881e47f192e102fb517450a536e5170ad0f17cd6"
Jul 07 14:59:32.024599 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:32.024572    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:59:32.024671 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:32.024639    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:59:32.024709 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:32.024669    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 07 14:59:33.033943 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:33.033888    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" event={"ID":"68fbc46c-9c17-4169-a21f-23f735fee716","Type":"ContainerStarted","Data":"e6ac4119ef0b191ab1741756dff1c21ef23f116df7923c650417fc9d02ee31a0"}
Jul 07 14:59:33.037573 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:33.037534    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:33.037767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:33.037662    2583 patch_prober.go:28] interesting pod/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:59:33.037767 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:33.037708    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 14:59:34.037108 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:34.037067    2583 patch_prober.go:28] interesting pod/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:59:34.037679 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:34.037136    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 14:59:35.037403 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:35.037361    2583 patch_prober.go:28] interesting pod/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:59:35.038046 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:35.038009    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 14:59:36.037448 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:36.037405    2583 patch_prober.go:28] interesting pod/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:59:36.038097 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:36.038061    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 14:59:37.040745 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:37.040716    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:37.041247 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:37.041071    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 14:59:37.041800 ip-10-0-141-139 kubenswrapper[2583]: I0707 14:59:37.041781    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 15:00:00.143312 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.143277    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"]
Jul 07 15:00:00.143730 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.143631    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy"
Jul 07 15:00:00.143730 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.143642    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9833cd-f297-4c4c-a157-3e5bb4b3dd32" containerName="istio-proxy"
Jul 07 15:00:00.146819 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.146804    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"
Jul 07 15:00:00.149336 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.149314    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cx6pw\""
Jul 07 15:00:00.155537 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.154998    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"]
Jul 07 15:00:00.302098 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.302059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv5jw\" (UniqueName: \"kubernetes.io/projected/f5a53630-40ae-4259-b4a4-6a2bdf9c6171-kube-api-access-qv5jw\") pod \"maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp\" (UID: \"f5a53630-40ae-4259-b4a4-6a2bdf9c6171\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"
Jul 07 15:00:00.403475 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.403385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv5jw\" (UniqueName: \"kubernetes.io/projected/f5a53630-40ae-4259-b4a4-6a2bdf9c6171-kube-api-access-qv5jw\") pod \"maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp\" (UID: \"f5a53630-40ae-4259-b4a4-6a2bdf9c6171\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"
Jul 07 15:00:00.413133 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.413112    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv5jw\" (UniqueName: \"kubernetes.io/projected/f5a53630-40ae-4259-b4a4-6a2bdf9c6171-kube-api-access-qv5jw\") pod \"maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp\" (UID: \"f5a53630-40ae-4259-b4a4-6a2bdf9c6171\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"
Jul 07 15:00:00.459847 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.459819    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"
Jul 07 15:00:00.613822 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.613799    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"]
Jul 07 15:00:00.615469 ip-10-0-141-139 kubenswrapper[2583]: W0707 15:00:00.615443    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a53630_40ae_4259_b4a4_6a2bdf9c6171.slice/crio-67fd8dec528e1b5cec9509e362a218552f24546290d8e94844a548f522dbe783 WatchSource:0}: Error finding container 67fd8dec528e1b5cec9509e362a218552f24546290d8e94844a548f522dbe783: Status 404 returned error can't find the container with id 67fd8dec528e1b5cec9509e362a218552f24546290d8e94844a548f522dbe783
Jul 07 15:00:00.617426 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:00.617410    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:00:01.185209 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:01.185173    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp" event={"ID":"f5a53630-40ae-4259-b4a4-6a2bdf9c6171","Type":"ContainerStarted","Data":"67fd8dec528e1b5cec9509e362a218552f24546290d8e94844a548f522dbe783"}
Jul 07 15:00:06.216190 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:06.216154    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp" event={"ID":"f5a53630-40ae-4259-b4a4-6a2bdf9c6171","Type":"ContainerStarted","Data":"a2d572858346821d20da4c191f6d2cffd3d58729e4ec7f452b0283c573cec1ac"}
Jul 07 15:00:06.237739 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:06.237686    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp" podStartSLOduration=1.31545093 podStartE2EDuration="6.237670371s" totalImagesPullingTime="4.922219441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:00:06.235538066 +0000 UTC m=+2138.263046176" watchObservedRunningTime="2026-07-07 15:00:06.237670371 +0000 UTC m=+2138.265178482"
Jul 07 15:00:07.222216 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:07.222178    2583 generic.go:356] "Generic (PLEG): container finished" podID="f5a53630-40ae-4259-b4a4-6a2bdf9c6171" containerID="a2d572858346821d20da4c191f6d2cffd3d58729e4ec7f452b0283c573cec1ac" exitCode=0
Jul 07 15:00:07.222620 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:07.222226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp" event={"ID":"f5a53630-40ae-4259-b4a4-6a2bdf9c6171","Type":"ContainerDied","Data":"a2d572858346821d20da4c191f6d2cffd3d58729e4ec7f452b0283c573cec1ac"}
Jul 07 15:00:08.359156 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:08.359134    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"
Jul 07 15:00:08.475625 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:08.475597    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv5jw\" (UniqueName: \"kubernetes.io/projected/f5a53630-40ae-4259-b4a4-6a2bdf9c6171-kube-api-access-qv5jw\") pod \"f5a53630-40ae-4259-b4a4-6a2bdf9c6171\" (UID: \"f5a53630-40ae-4259-b4a4-6a2bdf9c6171\") "
Jul 07 15:00:08.477593 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:08.477563    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5a53630-40ae-4259-b4a4-6a2bdf9c6171-kube-api-access-qv5jw" (OuterVolumeSpecName: "kube-api-access-qv5jw") pod "f5a53630-40ae-4259-b4a4-6a2bdf9c6171" (UID: "f5a53630-40ae-4259-b4a4-6a2bdf9c6171"). InnerVolumeSpecName "kube-api-access-qv5jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:00:08.576860 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:08.576818    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv5jw\" (UniqueName: \"kubernetes.io/projected/f5a53630-40ae-4259-b4a4-6a2bdf9c6171-kube-api-access-qv5jw\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:00:09.234046 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:09.234015    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"
Jul 07 15:00:09.234046 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:09.234034    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp" event={"ID":"f5a53630-40ae-4259-b4a4-6a2bdf9c6171","Type":"ContainerDied","Data":"67fd8dec528e1b5cec9509e362a218552f24546290d8e94844a548f522dbe783"}
Jul 07 15:00:09.234279 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:00:09.234092    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67fd8dec528e1b5cec9509e362a218552f24546290d8e94844a548f522dbe783"
Jul 07 15:02:22.906894 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.906809    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"]
Jul 07 15:02:22.907563 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.907271    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5a53630-40ae-4259-b4a4-6a2bdf9c6171" containerName="cleanup"
Jul 07 15:02:22.907563 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.907287    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a53630-40ae-4259-b4a4-6a2bdf9c6171" containerName="cleanup"
Jul 07 15:02:22.907563 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.907378    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5a53630-40ae-4259-b4a4-6a2bdf9c6171" containerName="cleanup"
Jul 07 15:02:22.910285 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.910268    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:22.914498 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.914475    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-82db1a\"/\"sub-test-model-82db1a-kserve-self-signed-certs\""
Jul 07 15:02:22.914624 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.914533    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-82db1a\"/\"default-dockercfg-x5scf\""
Jul 07 15:02:22.915375 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.915359    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-82db1a\"/\"kube-root-ca.crt\""
Jul 07 15:02:22.915432 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.915362    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-82db1a\"/\"openshift-service-ca.crt\""
Jul 07 15:02:22.927354 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.927319    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"]
Jul 07 15:02:22.948036 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.947998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-model-cache\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:22.948036 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.948039    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0751a403-ec07-41bd-b660-e08a4b77bf58-tls-certs\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:22.948251 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.948056    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-dshm\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:22.948251 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.948194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-home\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:22.948251 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.948231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfslc\" (UniqueName: \"kubernetes.io/projected/0751a403-ec07-41bd-b660-e08a4b77bf58-kube-api-access-hfslc\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:22.948375 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:22.948305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-tmp-dir\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.049771 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.049723    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-tmp-dir\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.049995 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.049793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-model-cache\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.049995 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.049809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0751a403-ec07-41bd-b660-e08a4b77bf58-tls-certs\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.049995 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.049828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-dshm\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.049995 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.049871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-home\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.049995 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.049898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfslc\" (UniqueName: \"kubernetes.io/projected/0751a403-ec07-41bd-b660-e08a4b77bf58-kube-api-access-hfslc\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.050287 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.050257    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-tmp-dir\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.050355 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.050268    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-model-cache\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.050410 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.050360    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-home\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.052290 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.052255    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-dshm\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.052421 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.052399    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0751a403-ec07-41bd-b660-e08a4b77bf58-tls-certs\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.061346 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.061321    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfslc\" (UniqueName: \"kubernetes.io/projected/0751a403-ec07-41bd-b660-e08a4b77bf58-kube-api-access-hfslc\") pod \"sub-test-model-82db1a-kserve-6dc96ff467-wvphs\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") " pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.220069 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.220028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:23.364433 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.364405    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"]
Jul 07 15:02:23.366879 ip-10-0-141-139 kubenswrapper[2583]: W0707 15:02:23.366847    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0751a403_ec07_41bd_b660_e08a4b77bf58.slice/crio-195ae844de2b57ec7e609a61d0babcaebe574174075562c63ef8500e295bd11c WatchSource:0}: Error finding container 195ae844de2b57ec7e609a61d0babcaebe574174075562c63ef8500e295bd11c: Status 404 returned error can't find the container with id 195ae844de2b57ec7e609a61d0babcaebe574174075562c63ef8500e295bd11c
Jul 07 15:02:23.929749 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.929702    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs" event={"ID":"0751a403-ec07-41bd-b660-e08a4b77bf58","Type":"ContainerStarted","Data":"aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed"}
Jul 07 15:02:23.929749 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.929750    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs" event={"ID":"0751a403-ec07-41bd-b660-e08a4b77bf58","Type":"ContainerStarted","Data":"195ae844de2b57ec7e609a61d0babcaebe574174075562c63ef8500e295bd11c"}
Jul 07 15:02:23.954755 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:23.954693    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs" podStartSLOduration=1.954673579 podStartE2EDuration="1.954673579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:23.952042693 +0000 UTC m=+2275.979550798" watchObservedRunningTime="2026-07-07 15:02:23.954673579 +0000 UTC m=+2275.982181687"
Jul 07 15:02:33.221102 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:33.221065    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:33.221519 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:33.221114    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:33.233415 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:33.233389    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:02:33.994560 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:02:33.994533    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:03:58.962474 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:03:58.962432    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"]
Jul 07 15:04:13.982617 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:13.982560    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs" podUID="0751a403-ec07-41bd-b660-e08a4b77bf58" containerName="main" containerID="cri-o://aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed" gracePeriod=45
Jul 07 15:04:13.986833 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:13.986801    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs" podUID="0751a403-ec07-41bd-b660-e08a4b77bf58" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": EOF"
Jul 07 15:04:14.233609 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.233547    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:04:14.303974 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.303934    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-dshm\") pod \"0751a403-ec07-41bd-b660-e08a4b77bf58\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") "
Jul 07 15:04:14.304161 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304002    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-model-cache\") pod \"0751a403-ec07-41bd-b660-e08a4b77bf58\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") "
Jul 07 15:04:14.304161 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304034    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0751a403-ec07-41bd-b660-e08a4b77bf58-tls-certs\") pod \"0751a403-ec07-41bd-b660-e08a4b77bf58\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") "
Jul 07 15:04:14.304161 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304056    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-tmp-dir\") pod \"0751a403-ec07-41bd-b660-e08a4b77bf58\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") "
Jul 07 15:04:14.304161 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304082    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-home\") pod \"0751a403-ec07-41bd-b660-e08a4b77bf58\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") "
Jul 07 15:04:14.304161 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304119    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfslc\" (UniqueName: \"kubernetes.io/projected/0751a403-ec07-41bd-b660-e08a4b77bf58-kube-api-access-hfslc\") pod \"0751a403-ec07-41bd-b660-e08a4b77bf58\" (UID: \"0751a403-ec07-41bd-b660-e08a4b77bf58\") "
Jul 07 15:04:14.304432 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304345    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-home" (OuterVolumeSpecName: "home") pod "0751a403-ec07-41bd-b660-e08a4b77bf58" (UID: "0751a403-ec07-41bd-b660-e08a4b77bf58"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:04:14.304432 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304355    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-model-cache" (OuterVolumeSpecName: "model-cache") pod "0751a403-ec07-41bd-b660-e08a4b77bf58" (UID: "0751a403-ec07-41bd-b660-e08a4b77bf58"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:04:14.304432 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304370    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0751a403-ec07-41bd-b660-e08a4b77bf58" (UID: "0751a403-ec07-41bd-b660-e08a4b77bf58"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:04:14.304546 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304448    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-tmp-dir\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:04:14.304546 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304468    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-home\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:04:14.304546 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.304483    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-model-cache\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:04:14.306286 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.306265    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0751a403-ec07-41bd-b660-e08a4b77bf58-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0751a403-ec07-41bd-b660-e08a4b77bf58" (UID: "0751a403-ec07-41bd-b660-e08a4b77bf58"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:04:14.306286 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.306275    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0751a403-ec07-41bd-b660-e08a4b77bf58-kube-api-access-hfslc" (OuterVolumeSpecName: "kube-api-access-hfslc") pod "0751a403-ec07-41bd-b660-e08a4b77bf58" (UID: "0751a403-ec07-41bd-b660-e08a4b77bf58"). InnerVolumeSpecName "kube-api-access-hfslc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:04:14.306286 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.306269    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-dshm" (OuterVolumeSpecName: "dshm") pod "0751a403-ec07-41bd-b660-e08a4b77bf58" (UID: "0751a403-ec07-41bd-b660-e08a4b77bf58"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:04:14.405160 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.405127    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0751a403-ec07-41bd-b660-e08a4b77bf58-dshm\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:04:14.405160 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.405157    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0751a403-ec07-41bd-b660-e08a4b77bf58-tls-certs\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:04:14.405160 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.405167    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfslc\" (UniqueName: \"kubernetes.io/projected/0751a403-ec07-41bd-b660-e08a4b77bf58-kube-api-access-hfslc\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:04:14.507691 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.507602    2583 generic.go:356] "Generic (PLEG): container finished" podID="0751a403-ec07-41bd-b660-e08a4b77bf58" containerID="aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed" exitCode=0
Jul 07 15:04:14.507691 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.507650    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"
Jul 07 15:04:14.507691 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.507671    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs" event={"ID":"0751a403-ec07-41bd-b660-e08a4b77bf58","Type":"ContainerDied","Data":"aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed"}
Jul 07 15:04:14.507950 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.507712    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs" event={"ID":"0751a403-ec07-41bd-b660-e08a4b77bf58","Type":"ContainerDied","Data":"195ae844de2b57ec7e609a61d0babcaebe574174075562c63ef8500e295bd11c"}
Jul 07 15:04:14.507950 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.507733    2583 scope.go:117] "RemoveContainer" containerID="aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed"
Jul 07 15:04:14.516651 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.516634    2583 scope.go:117] "RemoveContainer" containerID="aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed"
Jul 07 15:04:14.516920 ip-10-0-141-139 kubenswrapper[2583]: E0707 15:04:14.516901    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed\": container with ID starting with aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed not found: ID does not exist" containerID="aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed"
Jul 07 15:04:14.516988 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.516934    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed"} err="failed to get container status \"aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed\": rpc error: code = NotFound desc = could not find container \"aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed\": container with ID starting with aeba5a12d439b600b33bbd5d5a5d34cbe1493c745cc7f33b6262aa6ccb89f8ed not found: ID does not exist"
Jul 07 15:04:14.528267 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.528244    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"]
Jul 07 15:04:14.530561 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:14.530539    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-82db1a/sub-test-model-82db1a-kserve-6dc96ff467-wvphs"]
Jul 07 15:04:16.468621 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:16.468586    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0751a403-ec07-41bd-b660-e08a4b77bf58" path="/var/lib/kubelet/pods/0751a403-ec07-41bd-b660-e08a4b77bf58/volumes"
Jul 07 15:04:28.614150 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:28.614124    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 15:04:28.615265 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:28.615247    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7z9z2_783ae988-c52f-431e-bdbe-bbd637aa6cba/ovn-acl-logging/0.log"
Jul 07 15:04:31.665676 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.665648    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"]
Jul 07 15:04:31.666186 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.666005    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0751a403-ec07-41bd-b660-e08a4b77bf58" containerName="main"
Jul 07 15:04:31.666186 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.666016    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0751a403-ec07-41bd-b660-e08a4b77bf58" containerName="main"
Jul 07 15:04:31.666186 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.666089    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0751a403-ec07-41bd-b660-e08a4b77bf58" containerName="main"
Jul 07 15:04:31.670356 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.670338    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.672818 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.672797    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-537d76\"/\"openshift-service-ca.crt\""
Jul 07 15:04:31.673780 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.673761    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-537d76\"/\"default-dockercfg-pswrt\""
Jul 07 15:04:31.673855 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.673822    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-537d76\"/\"rate-test-model-537d76-kserve-self-signed-certs\""
Jul 07 15:04:31.674034 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.674020    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-537d76\"/\"kube-root-ca.crt\""
Jul 07 15:04:31.686305 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.686268    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"]
Jul 07 15:04:31.769303 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.769155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-model-cache\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.769303 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.769199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tmp-dir\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.769303 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.769217    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tls-certs\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.769303 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.769236    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdcjw\" (UniqueName: \"kubernetes.io/projected/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-kube-api-access-qdcjw\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.774665 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.769433    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-home\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.774665 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.769522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-dshm\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.871381 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.870559    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-model-cache\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.871381 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.870618    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tmp-dir\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.871381 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.870645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tls-certs\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.871381 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.870672    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcjw\" (UniqueName: \"kubernetes.io/projected/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-kube-api-access-qdcjw\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.871381 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.870785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-home\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.871381 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.870871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-dshm\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.872406 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.872365    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-model-cache\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.872544 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.872448    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tmp-dir\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.872669 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.872646    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-home\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.874779 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.874754    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-dshm\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.875943 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.875921    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tls-certs\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.881372 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.881346    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdcjw\" (UniqueName: \"kubernetes.io/projected/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-kube-api-access-qdcjw\") pod \"rate-test-model-537d76-kserve-ff5f669f5-5d5r9\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") " pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:31.987002 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:31.986936    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:32.128392 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:32.128363    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"]
Jul 07 15:04:32.130218 ip-10-0-141-139 kubenswrapper[2583]: W0707 15:04:32.130183    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d3c4a4a_2c82_4901_9af1_32bd8e1e2391.slice/crio-19e41237a1046415a48964e7160e755a26d5dd816521a4672b4c1fcfea84755c WatchSource:0}: Error finding container 19e41237a1046415a48964e7160e755a26d5dd816521a4672b4c1fcfea84755c: Status 404 returned error can't find the container with id 19e41237a1046415a48964e7160e755a26d5dd816521a4672b4c1fcfea84755c
Jul 07 15:04:32.609806 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:32.609764    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9" event={"ID":"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391","Type":"ContainerStarted","Data":"6b09189755d68a594e6f17cf7eed171af6d92a73992b60240e1c871e89074666"}
Jul 07 15:04:32.610005 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:32.609818    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9" event={"ID":"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391","Type":"ContainerStarted","Data":"19e41237a1046415a48964e7160e755a26d5dd816521a4672b4c1fcfea84755c"}
Jul 07 15:04:32.630528 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:32.630472    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9" podStartSLOduration=1.630454659 podStartE2EDuration="1.630454659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:04:32.629565146 +0000 UTC m=+2404.657073254" watchObservedRunningTime="2026-07-07 15:04:32.630454659 +0000 UTC m=+2404.657962766"
Jul 07 15:04:41.988142 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:41.988108    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:41.988594 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:41.988169    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:42.000874 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:42.000846    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:04:42.678438 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:04:42.678407    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:05:22.685244 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:22.685158    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"]
Jul 07 15:05:24.588167 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:24.588126    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"]
Jul 07 15:05:24.592055 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:24.592024    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-82db1a-29723940-4q6gp"]
Jul 07 15:05:26.469014 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:26.468978    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5a53630-40ae-4259-b4a4-6a2bdf9c6171" path="/var/lib/kubelet/pods/f5a53630-40ae-4259-b4a4-6a2bdf9c6171/volumes"
Jul 07 15:05:37.705056 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:37.705013    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9" podUID="1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" containerName="main" containerID="cri-o://6b09189755d68a594e6f17cf7eed171af6d92a73992b60240e1c871e89074666" gracePeriod=45
Jul 07 15:05:37.952773 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:37.952738    2583 generic.go:356] "Generic (PLEG): container finished" podID="1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" containerID="6b09189755d68a594e6f17cf7eed171af6d92a73992b60240e1c871e89074666" exitCode=0
Jul 07 15:05:37.952913 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:37.952806    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9" event={"ID":"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391","Type":"ContainerDied","Data":"6b09189755d68a594e6f17cf7eed171af6d92a73992b60240e1c871e89074666"}
Jul 07 15:05:37.952913 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:37.952849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9" event={"ID":"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391","Type":"ContainerDied","Data":"19e41237a1046415a48964e7160e755a26d5dd816521a4672b4c1fcfea84755c"}
Jul 07 15:05:37.952913 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:37.952861    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19e41237a1046415a48964e7160e755a26d5dd816521a4672b4c1fcfea84755c"
Jul 07 15:05:37.958787 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:37.958734    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:05:38.012832 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.012802    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-home\") pod \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") "
Jul 07 15:05:38.012832 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.012830    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-dshm\") pod \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") "
Jul 07 15:05:38.013062 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.012863    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-model-cache\") pod \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") "
Jul 07 15:05:38.013062 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.012911    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tmp-dir\") pod \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") "
Jul 07 15:05:38.013062 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.012940    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdcjw\" (UniqueName: \"kubernetes.io/projected/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-kube-api-access-qdcjw\") pod \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") "
Jul 07 15:05:38.013062 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.013002    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tls-certs\") pod \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\" (UID: \"1d3c4a4a-2c82-4901-9af1-32bd8e1e2391\") "
Jul 07 15:05:38.013283 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.013152    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-home" (OuterVolumeSpecName: "home") pod "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" (UID: "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:05:38.013283 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.013170    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" (UID: "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:05:38.013283 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.013204    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" (UID: "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:05:38.013435 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.013389    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-home\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.013435 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.013408    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-model-cache\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.013435 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.013423    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tmp-dir\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.015127 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.015106    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-dshm" (OuterVolumeSpecName: "dshm") pod "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" (UID: "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:05:38.015127 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.015113    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-kube-api-access-qdcjw" (OuterVolumeSpecName: "kube-api-access-qdcjw") pod "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" (UID: "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391"). InnerVolumeSpecName "kube-api-access-qdcjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:05:38.015229 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.015181    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" (UID: "1d3c4a4a-2c82-4901-9af1-32bd8e1e2391"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:05:38.113982 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.113936    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-tls-certs\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.113982 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.113979    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-dshm\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.113982 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.113989    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdcjw\" (UniqueName: \"kubernetes.io/projected/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391-kube-api-access-qdcjw\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:05:38.957975 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.957932    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"
Jul 07 15:05:38.983166 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.983136    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"]
Jul 07 15:05:38.990717 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:38.990694    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-537d76/rate-test-model-537d76-kserve-ff5f669f5-5d5r9"]
Jul 07 15:05:40.469034 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:05:40.468991    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" path="/var/lib/kubelet/pods/1d3c4a4a-2c82-4901-9af1-32bd8e1e2391/volumes"
Jul 07 15:06:07.941670 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:07.941631    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"]
Jul 07 15:06:07.942165 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:07.941833    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy" containerID="cri-o://e6ac4119ef0b191ab1741756dff1c21ef23f116df7923c650417fc9d02ee31a0" gracePeriod=30
Jul 07 15:06:13.144045 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.144004    2583 generic.go:356] "Generic (PLEG): container finished" podID="68fbc46c-9c17-4169-a21f-23f735fee716" containerID="e6ac4119ef0b191ab1741756dff1c21ef23f116df7923c650417fc9d02ee31a0" exitCode=0
Jul 07 15:06:13.144439 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.144069    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" event={"ID":"68fbc46c-9c17-4169-a21f-23f735fee716","Type":"ContainerDied","Data":"e6ac4119ef0b191ab1741756dff1c21ef23f116df7923c650417fc9d02ee31a0"}
Jul 07 15:06:13.144439 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.144133    2583 scope.go:117] "RemoveContainer" containerID="cc6ce5a3b5dc13cef657c602881e47f192e102fb517450a536e5170ad0f17cd6"
Jul 07 15:06:13.194019 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.193989    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 15:06:13.235310 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235241    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68fbc46c-9c17-4169-a21f-23f735fee716-istio-podinfo\") pod \"68fbc46c-9c17-4169-a21f-23f735fee716\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") "
Jul 07 15:06:13.235310 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235295    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-credential-socket\") pod \"68fbc46c-9c17-4169-a21f-23f735fee716\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") "
Jul 07 15:06:13.235522 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235340    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68fbc46c-9c17-4169-a21f-23f735fee716-istiod-ca-cert\") pod \"68fbc46c-9c17-4169-a21f-23f735fee716\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") "
Jul 07 15:06:13.235522 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235399    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-socket\") pod \"68fbc46c-9c17-4169-a21f-23f735fee716\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") "
Jul 07 15:06:13.235522 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235459    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8qzd\" (UniqueName: \"kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-kube-api-access-m8qzd\") pod \"68fbc46c-9c17-4169-a21f-23f735fee716\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") "
Jul 07 15:06:13.235522 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235487    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-data\") pod \"68fbc46c-9c17-4169-a21f-23f735fee716\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") "
Jul 07 15:06:13.235522 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-istio-token\") pod \"68fbc46c-9c17-4169-a21f-23f735fee716\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") "
Jul 07 15:06:13.235802 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235551    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-envoy\") pod \"68fbc46c-9c17-4169-a21f-23f735fee716\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") "
Jul 07 15:06:13.235802 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235580    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-certs\") pod \"68fbc46c-9c17-4169-a21f-23f735fee716\" (UID: \"68fbc46c-9c17-4169-a21f-23f735fee716\") "
Jul 07 15:06:13.235802 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235688    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68fbc46c-9c17-4169-a21f-23f735fee716" (UID: "68fbc46c-9c17-4169-a21f-23f735fee716"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:13.235802 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235786    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68fbc46c-9c17-4169-a21f-23f735fee716-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68fbc46c-9c17-4169-a21f-23f735fee716" (UID: "68fbc46c-9c17-4169-a21f-23f735fee716"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:06:13.236045 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235910    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68fbc46c-9c17-4169-a21f-23f735fee716-istiod-ca-cert\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:06:13.236045 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235949    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-socket\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:06:13.236045 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.235610    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68fbc46c-9c17-4169-a21f-23f735fee716" (UID: "68fbc46c-9c17-4169-a21f-23f735fee716"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:13.236216 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.236105    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68fbc46c-9c17-4169-a21f-23f735fee716" (UID: "68fbc46c-9c17-4169-a21f-23f735fee716"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:13.236589 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.236561    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-data" (OuterVolumeSpecName: "istio-data") pod "68fbc46c-9c17-4169-a21f-23f735fee716" (UID: "68fbc46c-9c17-4169-a21f-23f735fee716"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:13.237728 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.237700    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-istio-token" (OuterVolumeSpecName: "istio-token") pod "68fbc46c-9c17-4169-a21f-23f735fee716" (UID: "68fbc46c-9c17-4169-a21f-23f735fee716"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:06:13.237990 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.237943    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68fbc46c-9c17-4169-a21f-23f735fee716-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68fbc46c-9c17-4169-a21f-23f735fee716" (UID: "68fbc46c-9c17-4169-a21f-23f735fee716"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 15:06:13.238094 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.238026    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-kube-api-access-m8qzd" (OuterVolumeSpecName: "kube-api-access-m8qzd") pod "68fbc46c-9c17-4169-a21f-23f735fee716" (UID: "68fbc46c-9c17-4169-a21f-23f735fee716"). InnerVolumeSpecName "kube-api-access-m8qzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:06:13.238094 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.238036    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68fbc46c-9c17-4169-a21f-23f735fee716" (UID: "68fbc46c-9c17-4169-a21f-23f735fee716"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:13.336895 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.336859    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-credential-socket\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:06:13.336895 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.336886    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8qzd\" (UniqueName: \"kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-kube-api-access-m8qzd\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:06:13.336895 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.336896    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-data\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:06:13.337152 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.336905    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68fbc46c-9c17-4169-a21f-23f735fee716-istio-token\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:06:13.337152 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.336919    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-istio-envoy\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:06:13.337152 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.336928    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68fbc46c-9c17-4169-a21f-23f735fee716-workload-certs\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:06:13.337152 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:13.336935    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68fbc46c-9c17-4169-a21f-23f735fee716-istio-podinfo\") on node \"ip-10-0-141-139.ec2.internal\" DevicePath \"\""
Jul 07 15:06:14.150529 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:14.150501    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"
Jul 07 15:06:14.150529 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:14.150523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4" event={"ID":"68fbc46c-9c17-4169-a21f-23f735fee716","Type":"ContainerDied","Data":"002ecb8c02376447e2bfb40d8c515ee2ec0a1a6e8f59d863e4e41478023fd3c5"}
Jul 07 15:06:14.151062 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:14.150574    2583 scope.go:117] "RemoveContainer" containerID="e6ac4119ef0b191ab1741756dff1c21ef23f116df7923c650417fc9d02ee31a0"
Jul 07 15:06:14.182638 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:14.182602    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"]
Jul 07 15:06:14.185083 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:14.185055    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-82db1a-openshift-default-7d76485dff-b22k4"]
Jul 07 15:06:14.468715 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:14.468677    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" path="/var/lib/kubelet/pods/68fbc46c-9c17-4169-a21f-23f735fee716/volumes"
Jul 07 15:06:22.724089 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:22.724010    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6495c9587b-hct9s_4d594c98-af02-450d-afa7-14e13b317a2c/manager/0.log"
Jul 07 15:06:23.447831 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:23.447798    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f546bc4-rgxhw_6385807e-73af-454c-948f-3758fc23f853/copy-manifests/0.log"
Jul 07 15:06:23.486969 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:23.486944    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f546bc4-rgxhw_6385807e-73af-454c-948f-3758fc23f853/manager/0.log"
Jul 07 15:06:24.433362 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.433328    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc_b79e467f-bdcf-4821-8310-788215191cd8/util/0.log"
Jul 07 15:06:24.443065 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.443040    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc_b79e467f-bdcf-4821-8310-788215191cd8/pull/0.log"
Jul 07 15:06:24.451763 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.451742    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc_b79e467f-bdcf-4821-8310-788215191cd8/extract/0.log"
Jul 07 15:06:24.570494 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.570465    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68_8df17cb8-1c2f-4576-a826-d395796b6739/util/0.log"
Jul 07 15:06:24.579835 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.579814    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68_8df17cb8-1c2f-4576-a826-d395796b6739/pull/0.log"
Jul 07 15:06:24.589137 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.589119    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68_8df17cb8-1c2f-4576-a826-d395796b6739/extract/0.log"
Jul 07 15:06:24.712741 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.712717    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv_e578bbce-33c7-49ab-bbf5-84ba6acdd56d/util/0.log"
Jul 07 15:06:24.727388 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.727363    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv_e578bbce-33c7-49ab-bbf5-84ba6acdd56d/pull/0.log"
Jul 07 15:06:24.746076 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.746056    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv_e578bbce-33c7-49ab-bbf5-84ba6acdd56d/extract/0.log"
Jul 07 15:06:24.862440 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.862416    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc_7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a/util/0.log"
Jul 07 15:06:24.872195 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.872172    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc_7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a/pull/0.log"
Jul 07 15:06:24.883132 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:24.883116    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc_7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a/extract/0.log"
Jul 07 15:06:26.373167 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:26.373133    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4k78gf_dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a/istio-proxy/0.log"
Jul 07 15:06:26.499058 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:26.499028    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p798p_632935bd-c9ef-449c-8b37-c62899a312e7/discovery/0.log"
Jul 07 15:06:26.881282 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:26.881250    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-swksf_5a35aa32-5c14-44ff-943e-a618a794d82f/istio-proxy/1.log"
Jul 07 15:06:27.178753 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:27.178671    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mrld9_944e6024-65da-4e3e-b9f3-f1d3f70a9c72/payload-processing/0.log"
Jul 07 15:06:27.660792 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:27.660754    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zpt26_bf0b89a6-6b7f-48bb-a892-4ef56171eca6/main/0.log"
Jul 07 15:06:27.909054 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:27.909022    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fggkg_3873d66d-ae14-4d10-980f-519cd92c05fd/main/0.log"
Jul 07 15:06:28.156738 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:28.156710    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-d8gvh_6b52c98e-8595-4503-907e-0287b261943d/main/0.log"
Jul 07 15:06:28.672934 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:28.672901    2583 scope.go:117] "RemoveContainer" containerID="a2d572858346821d20da4c191f6d2cffd3d58729e4ec7f452b0283c573cec1ac"
Jul 07 15:06:35.703096 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:35.703069    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hwrbj_4b62ed01-d6a2-41a9-8725-5da7f402e07c/global-pull-secret-syncer/0.log"
Jul 07 15:06:35.971157 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:35.971082    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j9b2b_b370c905-2d81-4dcf-87a1-24cc322046db/konnectivity-agent/0.log"
Jul 07 15:06:36.056768 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:36.056735    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-139.ec2.internal_5d0582c3b390fb22f9648ea732036658/haproxy/0.log"
Jul 07 15:06:40.438394 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.438362    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc_b79e467f-bdcf-4821-8310-788215191cd8/extract/0.log"
Jul 07 15:06:40.466651 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.466619    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc_b79e467f-bdcf-4821-8310-788215191cd8/util/0.log"
Jul 07 15:06:40.496831 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.496806    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xqqcc_b79e467f-bdcf-4821-8310-788215191cd8/pull/0.log"
Jul 07 15:06:40.530484 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.530451    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68_8df17cb8-1c2f-4576-a826-d395796b6739/extract/0.log"
Jul 07 15:06:40.563527 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.563490    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68_8df17cb8-1c2f-4576-a826-d395796b6739/util/0.log"
Jul 07 15:06:40.591910 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.591885    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b5g68_8df17cb8-1c2f-4576-a826-d395796b6739/pull/0.log"
Jul 07 15:06:40.643636 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.643602    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv_e578bbce-33c7-49ab-bbf5-84ba6acdd56d/extract/0.log"
Jul 07 15:06:40.673752 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.673719    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv_e578bbce-33c7-49ab-bbf5-84ba6acdd56d/util/0.log"
Jul 07 15:06:40.700530 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.700504    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mpdpv_e578bbce-33c7-49ab-bbf5-84ba6acdd56d/pull/0.log"
Jul 07 15:06:40.734218 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.734190    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc_7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a/extract/0.log"
Jul 07 15:06:40.767168 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.767139    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc_7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a/util/0.log"
Jul 07 15:06:40.799407 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:40.799377    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d85fc_7e0f8002-f23d-4bd7-96c6-0b5f74a3ea1a/pull/0.log"
Jul 07 15:06:43.808327 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:43.808298    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66b447b58-q2nmq_b85fcd7c-a9b5-403c-b4bf-0ceee89b995d/metrics-server/0.log"
Jul 07 15:06:43.838744 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:43.838723    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-6f4nd_f74ac3c4-5d83-4b46-9fad-65b5dcdb4057/monitoring-plugin/0.log"
Jul 07 15:06:44.085398 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:44.085317    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vx92d_6b988da9-1bae-4ecb-ac03-c82f5944eaa3/node-exporter/0.log"
Jul 07 15:06:44.117511 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:44.117474    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vx92d_6b988da9-1bae-4ecb-ac03-c82f5944eaa3/kube-rbac-proxy/0.log"
Jul 07 15:06:44.150314 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:44.150287    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vx92d_6b988da9-1bae-4ecb-ac03-c82f5944eaa3/init-textfile/0.log"
Jul 07 15:06:44.599546 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:44.599512    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-vp8np_b91c417b-b2c3-41bb-a4d1-31cb5b201563/prometheus-operator-admission-webhook/0.log"
Jul 07 15:06:44.648710 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:44.648682    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8d85ddb8-7p99p_b89d8e94-8a86-4e0b-b725-1d35f967f1bb/telemeter-client/0.log"
Jul 07 15:06:44.681800 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:44.681775    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8d85ddb8-7p99p_b89d8e94-8a86-4e0b-b725-1d35f967f1bb/reload/0.log"
Jul 07 15:06:44.712967 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:44.712942    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8d85ddb8-7p99p_b89d8e94-8a86-4e0b-b725-1d35f967f1bb/kube-rbac-proxy/0.log"
Jul 07 15:06:45.715760 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.715723    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"]
Jul 07 15:06:45.716601 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.716282    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy"
Jul 07 15:06:45.716601 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.716301    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy"
Jul 07 15:06:45.716601 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.716327    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" containerName="main"
Jul 07 15:06:45.716601 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.716337    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" containerName="main"
Jul 07 15:06:45.716601 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.716367    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy"
Jul 07 15:06:45.716601 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.716377    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy"
Jul 07 15:06:45.716601 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.716452    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d3c4a4a-2c82-4901-9af1-32bd8e1e2391" containerName="main"
Jul 07 15:06:45.716601 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.716464    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy"
Jul 07 15:06:45.716601 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.716470    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="68fbc46c-9c17-4169-a21f-23f735fee716" containerName="istio-proxy"
Jul 07 15:06:45.719311 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.719296    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.722001 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.721974    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qxj2b\"/\"openshift-service-ca.crt\""
Jul 07 15:06:45.722001 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.721989    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qxj2b\"/\"kube-root-ca.crt\""
Jul 07 15:06:45.722230 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.722073    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qxj2b\"/\"default-dockercfg-q76xq\""
Jul 07 15:06:45.730369 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.730347    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"]
Jul 07 15:06:45.836089 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.836052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcvk4\" (UniqueName: \"kubernetes.io/projected/f213c231-6d05-4b59-b53a-a88d8803d15f-kube-api-access-mcvk4\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.836089 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.836093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-lib-modules\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.836347 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.836132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-proc\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.836347 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.836155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-sys\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.836347 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.836173    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-podres\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.936857 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.936824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-podres\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.937102 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.936928    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcvk4\" (UniqueName: \"kubernetes.io/projected/f213c231-6d05-4b59-b53a-a88d8803d15f-kube-api-access-mcvk4\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.937102 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.936950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-lib-modules\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.937102 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.937008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-proc\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.937102 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.937021    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-podres\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.937102 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.937079    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-sys\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.937102 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.937085    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-proc\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.937102 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.937031    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-sys\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.937362 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.937118    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f213c231-6d05-4b59-b53a-a88d8803d15f-lib-modules\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:45.948229 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:45.948206    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcvk4\" (UniqueName: \"kubernetes.io/projected/f213c231-6d05-4b59-b53a-a88d8803d15f-kube-api-access-mcvk4\") pod \"perf-node-gather-daemonset-7cxfw\" (UID: \"f213c231-6d05-4b59-b53a-a88d8803d15f\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:46.029816 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:46.029735    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:46.141308 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:46.141277    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-6cj2l_5262e097-9359-4f92-a8e4-eb82cbd5bd59/networking-console-plugin/0.log"
Jul 07 15:06:46.166836 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:46.166814    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"]
Jul 07 15:06:46.168692 ip-10-0-141-139 kubenswrapper[2583]: W0707 15:06:46.168659    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf213c231_6d05_4b59_b53a_a88d8803d15f.slice/crio-d4283386658e7825bbca21869baab5aa1a8cd6a66c3b4d168f258a9e35087919 WatchSource:0}: Error finding container d4283386658e7825bbca21869baab5aa1a8cd6a66c3b4d168f258a9e35087919: Status 404 returned error can't find the container with id d4283386658e7825bbca21869baab5aa1a8cd6a66c3b4d168f258a9e35087919
Jul 07 15:06:46.317525 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:46.317428    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw" event={"ID":"f213c231-6d05-4b59-b53a-a88d8803d15f","Type":"ContainerStarted","Data":"3f1f7c5dbea5a077eeea542d974acc35c3021ed9de99a31971b04de34012d1b2"}
Jul 07 15:06:46.317684 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:46.317584    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:46.317684 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:46.317630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw" event={"ID":"f213c231-6d05-4b59-b53a-a88d8803d15f","Type":"ContainerStarted","Data":"d4283386658e7825bbca21869baab5aa1a8cd6a66c3b4d168f258a9e35087919"}
Jul 07 15:06:46.345733 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:46.345658    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw" podStartSLOduration=1.345638557 podStartE2EDuration="1.345638557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:06:46.343647904 +0000 UTC m=+2538.371156013" watchObservedRunningTime="2026-07-07 15:06:46.345638557 +0000 UTC m=+2538.373146667"
Jul 07 15:06:47.346344 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:47.346312    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d86b4d767-pts52_ab3812bc-d26c-4644-bcd4-8369a0e7a1a3/console/0.log"
Jul 07 15:06:47.404098 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:47.404040    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-vdmrz_3b709fff-2821-4969-8132-611f41fc4de2/download-server/0.log"
Jul 07 15:06:49.519257 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:49.519223    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vvsck_536150c4-2e30-4b5a-a24e-ceb149440515/dns/0.log"
Jul 07 15:06:49.553202 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:49.553171    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vvsck_536150c4-2e30-4b5a-a24e-ceb149440515/kube-rbac-proxy/0.log"
Jul 07 15:06:49.690098 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:49.690070    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kz2tg_81a0adae-7087-46ed-ab48-0fa69eaf7ba0/dns-node-resolver/0.log"
Jul 07 15:06:50.305120 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:50.305087    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6f995d989d-6skxq_8ffdf414-4820-4169-8f7b-6fb25f9f8ad6/registry/0.log"
Jul 07 15:06:50.350255 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:50.350224    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7hjnz_ce806fe6-2831-4f5b-b098-0ca02394d02b/node-ca/0.log"
Jul 07 15:06:51.594975 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:51.594934    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4k78gf_dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a/istio-proxy/0.log"
Jul 07 15:06:51.725855 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:51.725820    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p798p_632935bd-c9ef-449c-8b37-c62899a312e7/discovery/0.log"
Jul 07 15:06:51.912341 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:51.912232    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-swksf_5a35aa32-5c14-44ff-943e-a618a794d82f/istio-proxy/0.log"
Jul 07 15:06:51.939162 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:51.939130    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-swksf_5a35aa32-5c14-44ff-943e-a618a794d82f/istio-proxy/1.log"
Jul 07 15:06:52.069291 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:52.069263    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mrld9_944e6024-65da-4e3e-b9f3-f1d3f70a9c72/payload-processing/0.log"
Jul 07 15:06:52.333279 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:52.333254    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-7cxfw"
Jul 07 15:06:53.038412 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:53.038388    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lz46q_75c7bb46-b20d-48f9-b4ff-17d80865ad59/serve-healthcheck-canary/0.log"
Jul 07 15:06:53.794090 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:53.794065    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gvdln_30a0365e-e775-4d29-81d4-a86a2ece5931/kube-rbac-proxy/0.log"
Jul 07 15:06:53.837880 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:53.837845    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gvdln_30a0365e-e775-4d29-81d4-a86a2ece5931/exporter/0.log"
Jul 07 15:06:53.881624 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:53.881594    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gvdln_30a0365e-e775-4d29-81d4-a86a2ece5931/extractor/0.log"
Jul 07 15:06:56.080211 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:56.080181    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4k78gf_dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a/istio-proxy/0.log"
Jul 07 15:06:56.192667 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:56.192636    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p798p_632935bd-c9ef-449c-8b37-c62899a312e7/discovery/0.log"
Jul 07 15:06:56.254431 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:56.254390    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-swksf_5a35aa32-5c14-44ff-943e-a618a794d82f/istio-proxy/0.log"
Jul 07 15:06:56.280818 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:56.280734    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-swksf_5a35aa32-5c14-44ff-943e-a618a794d82f/istio-proxy/1.log"
Jul 07 15:06:56.353434 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:56.353406    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mrld9_944e6024-65da-4e3e-b9f3-f1d3f70a9c72/payload-processing/0.log"
Jul 07 15:06:57.266231 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:57.266197    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6495c9587b-hct9s_4d594c98-af02-450d-afa7-14e13b317a2c/manager/0.log"
Jul 07 15:06:57.593004 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:57.592909    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4k78gf_dcaaeaf7-abcf-4376-9f8a-1ac4d5e9705a/istio-proxy/0.log"
Jul 07 15:06:57.673845 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:57.673814    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f546bc4-rgxhw_6385807e-73af-454c-948f-3758fc23f853/manager/0.log"
Jul 07 15:06:57.699221 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:57.699195    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p798p_632935bd-c9ef-449c-8b37-c62899a312e7/discovery/0.log"
Jul 07 15:06:57.722817 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:57.722796    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f546bc4-rgxhw_6385807e-73af-454c-948f-3758fc23f853/copy-manifests/0.log"
Jul 07 15:06:57.769850 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:57.769818    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-swksf_5a35aa32-5c14-44ff-943e-a618a794d82f/istio-proxy/0.log"
Jul 07 15:06:57.797452 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:57.797420    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-swksf_5a35aa32-5c14-44ff-943e-a618a794d82f/istio-proxy/1.log"
Jul 07 15:06:57.877631 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:57.877545    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mrld9_944e6024-65da-4e3e-b9f3-f1d3f70a9c72/payload-processing/0.log"
Jul 07 15:06:59.104516 ip-10-0-141-139 kubenswrapper[2583]: I0707 15:06:59.104475    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b9884d45d-jm2sq_72766a8d-c1a3-4835-b787-5fd8fe4e9011/manager/0.log"